Return to the institutional site
    • español
    • English
View Item 
  •   Séneca Home
  • TRABAJOS DE GRADO
  • Maestría
  • View Item
    • español
    • English
  •   Séneca Home
  • TRABAJOS DE GRADO
  • Maestría
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Browse

All of SénecaCommunities and CollectionsAuthorsTitlesSubjectsTypes of contentsAuthor profilesThis CollectionFaculties and ProgramsAuthorsTitlesSubjectsTypes of contents

My Account

LoginRegister

Statistics

View Usage Statistics

Information of interest

What is SénecaHow publishGuidelinesContact us

Controlled markov chains : some stability problems

RISMendeley
URI: http://hdl.handle.net/1992/13901
Author: Avila Girardot, Daniel Felipe
Director(s)/Advisor(s): Junca Peláez, Mauricio JoséUniandes authority
Publication date: 2016
Content type: masterThesis
Keywords:
Procesos de Markov
Procesos estocásticos
Programación dinámica
Abstract:
"Along this work we study some stability-related problems in the context of Controlled Markov chains. As a first problem, we consider a division of the state space, and the goal is to construct a control policy such that the chain stabilize as much as possible in each portlon of the division without leaving it. As a second problem, we characterize the domain of attraction and escape set of a controlled Markov chain via a function v, which happens to be the solution of a Bellman's equation. The interpretation of v as the solutlon of a Bellman's equation also provides a way to calculate such function via a linear program. Finally, under some assumptions, we find a policy that maximize the probability of reaching certain set A. Our approach uses certain cost functions and dynamical programming, so it can be solved using a linear program."
Show full item record

Files in this item

Thumbnail
Name:
u753782.pdf
Size:
341.7Kb
Format:
PDF

Statistics

View Usage Statistics
Donaciones

Los Andes

Donaciones


Icono Repositorio

Los Andes

Repositorio


Icono Egresados

Los Andes

Egresados


Icono Eventos

Los Andes

Eventos



Cra 1 Nº 18A - 12

Bogotá - Colombia

Postal code: 111711

+(571) 339 49 99

+(571) 339 49 49


Normatividad Institucional

  • Actos internos e incremento
  • Bienestar
  • Derechos pecunarios
  • Estatuto docente
  • Estatuto general
  • Ley de transparencia
  • Porcentaje de incremento
  • Reglamentos de estudiantes
  • Uso de datos personales

Enlaces Rápidos

  • ATC (Acceso Temporal al Campus)
  • Universidad de los Andes Caribe
  • Convivencia y transparencia
  • Educación Continuada
  • Emergencias: Extensión 0000
  • Nuestros profesores
  • Mapa del sitio
  • Multimedia
  • Noticias
  • Preguntas frecuentes

Redes sociales

  • Facebook
  • twitter
  • youtube
  • linkedin
  • instagram
  • snapchat
  • vimeo
  • google

Directorio de redes