You searched for subject:(Stochastic optimal control)
.
Showing records 1 – 30 of
163 total matches.
◁ [1] [2] [3] [4] [5] [6] ▶

University of New South Wales
1.
Wu, Wei.
Limitations of dynamic programming approach: singularity and time inconsistency.
Degree: Mathematics & Statistics, 2016, University of New South Wales
URL: http://handle.unsw.edu.au/1959.4/56208
;
https://unsworks.unsw.edu.au/fapi/datastream/unsworks:40264/SOURCE02?view=true
► Two failures of the dynamic programming (DP) approach to the stochastic optimal control problem are investigated. The first failure arises when we wish to solve…
(more)
▼ Two failures of the dynamic programming (DP) approach to the
stochastic optimal control problem are investigated. The first failure arises when we wish to solve a class of certain singular
stochastic control problems in continuous time. It has been shown by Lasry and Lions (2000) that this difficulty can be overcome by introducing equivalent standard
stochastic control problems. To solve this class of singular
stochastic control problems, it remains to solve the equivalent standard
stochastic control problems. Since standard
stochastic control problems can be solved by applying the DP approach, this then solves the first failure. In the first part of the thesis, we clarify the idea of Lasry and Lions and extend their work to the case of controlled processes with jumps. This is particularly important in financial modelling where such processes are widely applied. For the purpose of application, we applied our result to an
optimal trade execution problem studied by Lasry and Lions (2007b). The second failure of the DP approach arises when we wish to solve a multiperiod portfolio selection problem in which a mean-standard-deviation type criterion (a non-separable criterion) is used. We formulate such a problem as a discrete time
stochastic control problem. By adapting a pseudo dynamic programming principle, we obtain a closed form
optimal strategy for investors whose risk tolerances are larger than a lower bound. As a consequence, we develop a multiperiod portfolio selection scheme. The analysis is performed in the market of risky assets only, however, we allow both market transitions and intermediate cash injections and offtakes. This work provides a good basis for future studies of portfolio selection problems with selection criteria chosen from the class of translation-invariant and positive-homogeneous risk measures.
Advisors/Committee Members: Goldys, Beniamin, The University of Sydney, Penev, Spiridon , Mathematics & Statistics, Faculty of Science, UNSW.
Subjects/Keywords: Stochastic optimal control; Dynamic programming; Stochastic control
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Wu, W. (2016). Limitations of dynamic programming approach: singularity and time inconsistency. (Doctoral Dissertation). University of New South Wales. Retrieved from http://handle.unsw.edu.au/1959.4/56208 ; https://unsworks.unsw.edu.au/fapi/datastream/unsworks:40264/SOURCE02?view=true
Chicago Manual of Style (16th Edition):
Wu, Wei. “Limitations of dynamic programming approach: singularity and time inconsistency.” 2016. Doctoral Dissertation, University of New South Wales. Accessed March 04, 2021.
http://handle.unsw.edu.au/1959.4/56208 ; https://unsworks.unsw.edu.au/fapi/datastream/unsworks:40264/SOURCE02?view=true.
MLA Handbook (7th Edition):
Wu, Wei. “Limitations of dynamic programming approach: singularity and time inconsistency.” 2016. Web. 04 Mar 2021.
Vancouver:
Wu W. Limitations of dynamic programming approach: singularity and time inconsistency. [Internet] [Doctoral dissertation]. University of New South Wales; 2016. [cited 2021 Mar 04].
Available from: http://handle.unsw.edu.au/1959.4/56208 ; https://unsworks.unsw.edu.au/fapi/datastream/unsworks:40264/SOURCE02?view=true.
Council of Science Editors:
Wu W. Limitations of dynamic programming approach: singularity and time inconsistency. [Doctoral Dissertation]. University of New South Wales; 2016. Available from: http://handle.unsw.edu.au/1959.4/56208 ; https://unsworks.unsw.edu.au/fapi/datastream/unsworks:40264/SOURCE02?view=true

Georgia Tech
2.
Williams, Grady Robert.
Model predictive path integral control: Theoretical foundations and applications to autonomous driving.
Degree: PhD, Computer Science, 2019, Georgia Tech
URL: http://hdl.handle.net/1853/62666
► This thesis presents a new approach for stochastic model predictive (optimal) control: model predictive path integral control, which is based on massive parallel sampling of…
(more)
▼ This thesis presents a new approach for
stochastic model predictive (
optimal)
control: model predictive path integral
control, which is based on massive parallel sampling of
control trajectories. We first show the theoretical foundations of model predictive path integral
control, which are based on a combination of path integral
control theory and an information theoretic interpretation of
stochastic optimal control. We then apply the method to high speed autonomous driving on a 1/5 scale vehicle and analyze the performance and robustness of the method. Extensive experimental results are used to identify and solve key problems relating to robustness of the approach, which leads to a robust
stochastic model predictive
control algorithm capable of consistently pushing the limits of performance on the 1/5 scale vehicle.
Advisors/Committee Members: Theodorou, Evangelos A. (advisor), Rehg, James M. (committee member), Egerstedt, Magnus (committee member), Boots, Byron (committee member), Todorov, Emanuel (committee member).
Subjects/Keywords: Stochastic optimal control; Autonomous driving
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Williams, G. R. (2019). Model predictive path integral control: Theoretical foundations and applications to autonomous driving. (Doctoral Dissertation). Georgia Tech. Retrieved from http://hdl.handle.net/1853/62666
Chicago Manual of Style (16th Edition):
Williams, Grady Robert. “Model predictive path integral control: Theoretical foundations and applications to autonomous driving.” 2019. Doctoral Dissertation, Georgia Tech. Accessed March 04, 2021.
http://hdl.handle.net/1853/62666.
MLA Handbook (7th Edition):
Williams, Grady Robert. “Model predictive path integral control: Theoretical foundations and applications to autonomous driving.” 2019. Web. 04 Mar 2021.
Vancouver:
Williams GR. Model predictive path integral control: Theoretical foundations and applications to autonomous driving. [Internet] [Doctoral dissertation]. Georgia Tech; 2019. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/1853/62666.
Council of Science Editors:
Williams GR. Model predictive path integral control: Theoretical foundations and applications to autonomous driving. [Doctoral Dissertation]. Georgia Tech; 2019. Available from: http://hdl.handle.net/1853/62666

Boston University
3.
Ren, Dan.
Stochastic optimization and applications in finance.
Degree: PhD, Mathematics & Statistics, 2013, Boston University
URL: http://hdl.handle.net/2144/13130
► My PhD thesis concentrates on the field of stochastic analysis, with focus on stochastic optimization and applications in finance. It is composed of two parts:…
(more)
▼ My PhD thesis concentrates on the field of stochastic analysis, with focus on stochastic optimization and applications in finance. It is composed of two parts: the first part studies an optimal stopping problem, and the second part studies an optimal control problem.
The first topic considers a one-dimensional transient and downwards drifting diffusion process X, and detects the optimal times of a random time(denoted as ρ). In particular, we consider two classes of random times: (1) the last time when the process exits a certain level l; (2) the time when the process reaches its maximum. For each random time, we solve the optimization problem
infτ E[λ(τ- ρ)+ +(1-λ)(ρ - τ)+]
overall all stopping times. For the last exit time, the process should stop optimally when it runs below some fixed level k the first time, where k is the solution of an explicit defined equation. For the ultimate maximum time, the process should stop optimally when it runs below a boundary which is the maximal positive solution (if exists) of a first-order ordinary differential equation which lies below the line λs for all s > 0 .
The second topic solves an optimal consumption and investment problem for a risk-averse investor who is sensitive to declines than to increases of standard living (i.e., the investor is loss averse), and the investment opportunities are constant. We use the tools of stochastic control and duality methods to solve the resulting free-boundary problem in an infinite time horizon. Briefly, the investor consumes constantly when holding a moderate amount of wealth. In bliss time, the investor increases the consumption so that the consumption-wealth ratio reaches some fixed minimum level; in gloom time, the investor decreases the consumption gradually. Moreover, high loss aversion tends to raise the consumption-wealth ratio, but cut the investment-wealth ratio overall.
Subjects/Keywords: Mathematics; Financial mathematics; Optimal consumption; Optimal control; Optimal stopping; Stochastic optimization
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Ren, D. (2013). Stochastic optimization and applications in finance. (Doctoral Dissertation). Boston University. Retrieved from http://hdl.handle.net/2144/13130
Chicago Manual of Style (16th Edition):
Ren, Dan. “Stochastic optimization and applications in finance.” 2013. Doctoral Dissertation, Boston University. Accessed March 04, 2021.
http://hdl.handle.net/2144/13130.
MLA Handbook (7th Edition):
Ren, Dan. “Stochastic optimization and applications in finance.” 2013. Web. 04 Mar 2021.
Vancouver:
Ren D. Stochastic optimization and applications in finance. [Internet] [Doctoral dissertation]. Boston University; 2013. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/2144/13130.
Council of Science Editors:
Ren D. Stochastic optimization and applications in finance. [Doctoral Dissertation]. Boston University; 2013. Available from: http://hdl.handle.net/2144/13130

University of Southern California
4.
Theodorou, Evangelos A.
Iterative path integral stochastic optimal control: theory
and applications to motor control.
Degree: PhD, Computer Science, 2011, University of Southern California
URL: http://digitallibrary.usc.edu/cdm/compoundobject/collection/p15799coll127/id/468575/rec/3680
► Motivated by the limitations of current optimal control and reinforcement learning methods in terms of their efficiency and scalability, this thesis proposes an iterative stochastic…
(more)
▼ Motivated by the limitations of current
optimal
control and reinforcement learning methods in terms of their
efficiency and scalability, this thesis proposes an iterative
stochastic optimal control approach based on the generalized path
integral formalism. More precisely, we suggest the use of the
framework of
stochastic optimal control with path integrals to
derive a novel approach to RL with parameterized policies. While
solidly grounded in value function estimation and
optimal control
based on the
stochastic Hamilton Jacobi Bellman (HJB) equation,
policy improvements can be transformed into an approximation
problem of a path integral which has no open algorithmic parameters
other than the exploration noise. The resulting algorithm can be
conceived of as model-based, semi-model-based, or even model free,
depending on how the learning problem is structured. The new
algorithm, Policy Improvement with Path Integrals (PI2),
demonstrates interesting similarities with previous RL research in
the framework of probability matching and provides intuition why
the slightly heuristically motivated probability matching approach
can actually perform well. Applications to high dimensional robotic
systems are presented for a variety of tasks that require
optimal
planning and gain scheduling.; In addition to the work on
generalized path integral
stochastic optimal control, in this
thesis we extend model based iterative
optimal control algorithms
to the
stochastic setting. More precisely we derive the
Differential Dynamic Programming algorithm for
stochastic systems
with state and
control multiplicative noise. Finally, in the last
part of this thesis, model based iterative
optimal control methods
are applied to bio-mechanical models of the index finger with the
goal to find the underlying tendon forces applied for the movements
of, tapping and flexing.
Advisors/Committee Members: Schaal, Stefan (Committee Chair), Valero-Cuevas, Francisco (Committee Member), Sukhatme, Gaurav S. (Committee Member), Todorov, Emo (Committee Member), Schweighofer, Nicolas (Committee Member).
Subjects/Keywords: stochastic optimal control; reinforcement learning,; robotics
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Theodorou, E. A. (2011). Iterative path integral stochastic optimal control: theory
and applications to motor control. (Doctoral Dissertation). University of Southern California. Retrieved from http://digitallibrary.usc.edu/cdm/compoundobject/collection/p15799coll127/id/468575/rec/3680
Chicago Manual of Style (16th Edition):
Theodorou, Evangelos A. “Iterative path integral stochastic optimal control: theory
and applications to motor control.” 2011. Doctoral Dissertation, University of Southern California. Accessed March 04, 2021.
http://digitallibrary.usc.edu/cdm/compoundobject/collection/p15799coll127/id/468575/rec/3680.
MLA Handbook (7th Edition):
Theodorou, Evangelos A. “Iterative path integral stochastic optimal control: theory
and applications to motor control.” 2011. Web. 04 Mar 2021.
Vancouver:
Theodorou EA. Iterative path integral stochastic optimal control: theory
and applications to motor control. [Internet] [Doctoral dissertation]. University of Southern California; 2011. [cited 2021 Mar 04].
Available from: http://digitallibrary.usc.edu/cdm/compoundobject/collection/p15799coll127/id/468575/rec/3680.
Council of Science Editors:
Theodorou EA. Iterative path integral stochastic optimal control: theory
and applications to motor control. [Doctoral Dissertation]. University of Southern California; 2011. Available from: http://digitallibrary.usc.edu/cdm/compoundobject/collection/p15799coll127/id/468575/rec/3680

Université de Grenoble
5.
Salch, Alexandre.
Ordonnancement stochastique avec impatience : Stochastic scheduling with impatience.
Degree: Docteur es, Mathématiques et informatique, 2013, Université de Grenoble
URL: http://www.theses.fr/2013GRENM062
► Le sujet de cette thèse est l'étude de systèmes de production avec impatience. Ces systèmes sont modélisés comme des problèmes d'ordonnancement stochastiques avec des dates…
(more)
▼ Le sujet de cette thèse est l'étude de systèmes de production avec impatience. Ces systèmes sont modélisés comme des problèmes d'ordonnancement stochastiques avec des dates d'échéance. Dans la littérature, peu de résultats existent sur le contrôle optimal de ce genre de systèmes. C'est dans ce cadre que s'inscrit cette thèse. Nous considérons un système générique avec une machine, sur laquelle des tâches sont à exécuter. Les durées d'exécution, les dates d'échéance (ou durées d'impatience) et les dates de disponibilité des tâches sont des variables aléatoires. À chaque tâche est associé un poids et l'objectif est de minimiser l'espérance du nombre pondéré de tâches en retard. Dans notre étude, nous utilisons différentes modélisations, rendant compte des différentes contraintes régissant des systèmes réels. Notamment, nous faisons la différence entre l'impatience, le fait d'avoir attendu trop longtemps, et l'abandon, le fait de quitter le système suite à l'impatience. Dans la classe des politiques statiques, nous donnons des ordonnancements optimaux pour des problèmes avec impatience. Dans la classe des politiques dynamiques avec préemption, nous donnons de nouvelles conditions garantissant l'optimalité d'une politique stricte pour des problèmes avec abandon et nous proposons une heuristique plus efficace que celles que l'on trouve dans la littérature. Enfin, nous explorons des variantes et des extensions de ces problèmes, lorsque le système comporte plusieurs machines et lorsque la préemption n'est pas autorisée.
In this thesis, production systems facing abandonments are studied. These problems are modeled as stochastic scheduling problems with due dates. In the literature, few results exist concerning the optimal control of such systems. This thesis aims at providing optimal control policies for systems with impatience. We consider a generic system with a single machine, on which jobs have to be processed. Processing times, due dates (or patience time) and release dates are random variables. A weight is associated to each job and the objective is to minimize the expected weighted number of late jobs. In our study, we use different models, taking into account the specific features of real life problems. For example, we make a difference between impatience, when a customer has been waiting for too long, and abandonment, when a customer leaves the system after getting impatient. In the class of static list scheduling policies, we provide optimal schedules for problems with impatience. In the class of preemptive dynamic policies, we specify conditions under which a strict priority rule is optimal and we give a new heuristic, both extending previous results from the literature. We study variants and extensions of these problems, when several machines are available or when preemption is not authorized.
Advisors/Committee Members: Gayon, Jean-Philippe (thesis director), Lemaire, Pierre (thesis director).
Subjects/Keywords: Ordonnancement; Contrôle optimal; Aléatoire; Scheduling; Optimal control; Stochastic; 004
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Salch, A. (2013). Ordonnancement stochastique avec impatience : Stochastic scheduling with impatience. (Doctoral Dissertation). Université de Grenoble. Retrieved from http://www.theses.fr/2013GRENM062
Chicago Manual of Style (16th Edition):
Salch, Alexandre. “Ordonnancement stochastique avec impatience : Stochastic scheduling with impatience.” 2013. Doctoral Dissertation, Université de Grenoble. Accessed March 04, 2021.
http://www.theses.fr/2013GRENM062.
MLA Handbook (7th Edition):
Salch, Alexandre. “Ordonnancement stochastique avec impatience : Stochastic scheduling with impatience.” 2013. Web. 04 Mar 2021.
Vancouver:
Salch A. Ordonnancement stochastique avec impatience : Stochastic scheduling with impatience. [Internet] [Doctoral dissertation]. Université de Grenoble; 2013. [cited 2021 Mar 04].
Available from: http://www.theses.fr/2013GRENM062.
Council of Science Editors:
Salch A. Ordonnancement stochastique avec impatience : Stochastic scheduling with impatience. [Doctoral Dissertation]. Université de Grenoble; 2013. Available from: http://www.theses.fr/2013GRENM062

University of Manchester
6.
Blair, James.
Modelling approaches for optimal liquidation under a
limit-order book structure.
Degree: 2016, University of Manchester
URL: http://www.manchester.ac.uk/escholar/uk-ac-man-scw:300421
► This thesis introduces a selection of models for optimal execution of financial assets at the tactical level. As opposed to optimal scheduling, which defines a…
(more)
▼ This thesis introduces a selection of models for
optimal execution of financial assets at the tactical level. As
opposed to optimal scheduling, which defines a trading schedule for
the trader, this thesis investigates how the trader should interact
with the order book. If a trader is aggressive he will execute his
order using market orders, which will negatively feedback on his
execution price through market impact. Alternatively, the models we
focus on consider a passive trader who places limit orders into the
limit-order book and waits for these orders to be filled by market
orders from other traders. We assume these models do not exhibit
market impact. However, given we await market orders from other
participants to fill our limit orders a new risk is borne:
execution risk.We begin with an extension of Guéant et al. (2012b)
who through the use of an exponential utility, standard Brownian
motion, and an absolute decay parameter were able to cleverly build
symmetry into their model which significantly reduced the
complexity. Our model consists of geometric Brownian motion (and
mean-reverting processes) for the asset price, a proportional
control parameter (the additional amount we ask for the asset), and
a proportional decay parameter, implying that the symmetry found in
Guéant et al. (2012b) no longer exists. This novel combination
results in asset-dependent trading strategies, which to our
knowledge is a unique concept in this framework of literature.
Detailed asymptotic analyses, coupled with advanced numerical
techniques (informing the asymptotics) are exploited to extract the
relevant dynamics, before looking at further extensions using
similar methods.We examine our above mentioned framework, as well
as that of Guéant et al. (2012), for a trader who has a basket of
correlated assets to liquidate. This leads to a higher-dimensional
model which increases the complexity of both numerically solving
the problem and asymptotically examining it. The solutions we
present are of interest, and comparable with Markowitz portfolio
theory. We return to our framework of a single underlying and
consider four extensions: a stochastic volatility model which
results in an added dimension to the problem, a constrained
optimisation problem in which the control has an explicit lower
bound, changing the exponential intensity to a power intensity
which results in a reformulation as a singular stochastic control
problem, and allowing the trader to trade using both market orders
and limit orders resulting in a free-boundary problem.We complete
the study with an empirical analysis using limit-order book data
which contains multiple levels of the book. This involves a novel
calibration of the intensity functions which represent the
limit-order book, before backtesting and analysing the performance
of the strategies.
NA
NA
Advisors/Committee Members: JOHNSON, PAUL PV, Duck, Peter, Johnson, Paul.
Subjects/Keywords: Stochastic Optimal Control; Mathematical Finance; Optimal Execution; Algorithmic Trading
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Blair, J. (2016). Modelling approaches for optimal liquidation under a
limit-order book structure. (Doctoral Dissertation). University of Manchester. Retrieved from http://www.manchester.ac.uk/escholar/uk-ac-man-scw:300421
Chicago Manual of Style (16th Edition):
Blair, James. “Modelling approaches for optimal liquidation under a
limit-order book structure.” 2016. Doctoral Dissertation, University of Manchester. Accessed March 04, 2021.
http://www.manchester.ac.uk/escholar/uk-ac-man-scw:300421.
MLA Handbook (7th Edition):
Blair, James. “Modelling approaches for optimal liquidation under a
limit-order book structure.” 2016. Web. 04 Mar 2021.
Vancouver:
Blair J. Modelling approaches for optimal liquidation under a
limit-order book structure. [Internet] [Doctoral dissertation]. University of Manchester; 2016. [cited 2021 Mar 04].
Available from: http://www.manchester.ac.uk/escholar/uk-ac-man-scw:300421.
Council of Science Editors:
Blair J. Modelling approaches for optimal liquidation under a
limit-order book structure. [Doctoral Dissertation]. University of Manchester; 2016. Available from: http://www.manchester.ac.uk/escholar/uk-ac-man-scw:300421

University of Manchester
7.
Blair, James.
Modelling approaches for optimal liquidation under a limit-order book structure.
Degree: PhD, 2016, University of Manchester
URL: https://www.research.manchester.ac.uk/portal/en/theses/modelling-approaches-for-optimal-liquidation-under-a-limitorder-book-structure(a7c23b2a-e2f8-4b4a-9865-8783d9837198).html
;
http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.689582
► This thesis introduces a selection of models for optimal execution of financial assets at the tactical level. As opposed to optimal scheduling, which defines a…
(more)
▼ This thesis introduces a selection of models for optimal execution of financial assets at the tactical level. As opposed to optimal scheduling, which defines a trading schedule for the trader, this thesis investigates how the trader should interact with the order book. If a trader is aggressive he will execute his order using market orders, which will negatively feedback on his execution price through market impact. Alternatively, the models we focus on consider a passive trader who places limit orders into the limit-order book and waits for these orders to be filled by market orders from other traders. We assume these models do not exhibit market impact. However, given we await market orders from other participants to fill our limit orders a new risk is borne: execution risk. We begin with an extension of Guéant et al. (2012b) who through the use of an exponential utility, standard Brownian motion, and an absolute decay parameter were able to cleverly build symmetry into their model which significantly reduced the complexity. Our model consists of geometric Brownian motion (and mean-reverting processes) for the asset price, a proportional control parameter (the additional amount we ask for the asset), and a proportional decay parameter, implying that the symmetry found in Guéant et al. (2012b) no longer exists. This novel combination results in asset-dependent trading strategies, which to our knowledge is a unique concept in this framework of literature. Detailed asymptotic analyses, coupled with advanced numerical techniques (informing the asymptotics) are exploited to extract the relevant dynamics, before looking at further extensions using similar methods. We examine our above mentioned framework, as well as that of Guéant et al. (2012), for a trader who has a basket of correlated assets to liquidate. This leads to a higher-dimensional model which increases the complexity of both numerically solving the problem and asymptotically examining it. The solutions we present are of interest, and comparable with Markowitz portfolio theory. We return to our framework of a single underlying and consider four extensions: a stochastic volatility model which results in an added dimension to the problem, a constrained optimisation problem in which the control has an explicit lower bound, changing the exponential intensity to a power intensity which results in a reformulation as a singular stochastic control problem, and allowing the trader to trade using both market orders and limit orders resulting in a free-boundary problem. We complete the study with an empirical analysis using limit-order book data which contains multiple levels of the book. This involves a novel calibration of the intensity functions which represent the limit-order book, before backtesting and analysing the performance of the strategies.
Subjects/Keywords: 519.5; Stochastic Optimal Control; Mathematical Finance; Optimal Execution; Algorithmic Trading
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Blair, J. (2016). Modelling approaches for optimal liquidation under a limit-order book structure. (Doctoral Dissertation). University of Manchester. Retrieved from https://www.research.manchester.ac.uk/portal/en/theses/modelling-approaches-for-optimal-liquidation-under-a-limitorder-book-structure(a7c23b2a-e2f8-4b4a-9865-8783d9837198).html ; http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.689582
Chicago Manual of Style (16th Edition):
Blair, James. “Modelling approaches for optimal liquidation under a limit-order book structure.” 2016. Doctoral Dissertation, University of Manchester. Accessed March 04, 2021.
https://www.research.manchester.ac.uk/portal/en/theses/modelling-approaches-for-optimal-liquidation-under-a-limitorder-book-structure(a7c23b2a-e2f8-4b4a-9865-8783d9837198).html ; http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.689582.
MLA Handbook (7th Edition):
Blair, James. “Modelling approaches for optimal liquidation under a limit-order book structure.” 2016. Web. 04 Mar 2021.
Vancouver:
Blair J. Modelling approaches for optimal liquidation under a limit-order book structure. [Internet] [Doctoral dissertation]. University of Manchester; 2016. [cited 2021 Mar 04].
Available from: https://www.research.manchester.ac.uk/portal/en/theses/modelling-approaches-for-optimal-liquidation-under-a-limitorder-book-structure(a7c23b2a-e2f8-4b4a-9865-8783d9837198).html ; http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.689582.
Council of Science Editors:
Blair J. Modelling approaches for optimal liquidation under a limit-order book structure. [Doctoral Dissertation]. University of Manchester; 2016. Available from: https://www.research.manchester.ac.uk/portal/en/theses/modelling-approaches-for-optimal-liquidation-under-a-limitorder-book-structure(a7c23b2a-e2f8-4b4a-9865-8783d9837198).html ; http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.689582

University of Ottawa
8.
Iolov, Alexandre V.
Parameter Estimation, Optimal Control and Optimal Design in Stochastic Neural Models
.
Degree: 2016, University of Ottawa
URL: http://hdl.handle.net/10393/34866
► This thesis solves estimation and control problems in computational neuroscience, mathematically dealing with the first-passage times of diffusion stochastic processes. We first derive estimation algorithms…
(more)
▼ This thesis solves estimation and control problems in computational
neuroscience, mathematically dealing with the first-passage times of diffusion
stochastic processes. We first derive estimation algorithms for model parameters
from first-passage time observations, and then we derive algorithms for the
control of first-passage times. Finally, we solve an optimal design
problem which combines elements of the first two: we ask how to elicit
first-passage times such as to facilitate model estimation based on said
first-passage observations.
The main mathematical tools used are the Fokker-Planck partial differential
equation for evolution of probability densities, the Hamilton-Jacobi-Bellman
equation of optimal control and the adjoint optimization principle from optimal
control theory.
The focus is on developing computational schemes for the
solution of the problems. The schemes are implemented and are tested for a wide
range of parameters.
Subjects/Keywords: Stochastic Optimal Control;
Stochastic Leaky Integrate-and-Fire Neural Model;
Optimal Design;
First-Passage Times
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Iolov, A. V. (2016). Parameter Estimation, Optimal Control and Optimal Design in Stochastic Neural Models
. (Thesis). University of Ottawa. Retrieved from http://hdl.handle.net/10393/34866
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Chicago Manual of Style (16th Edition):
Iolov, Alexandre V. “Parameter Estimation, Optimal Control and Optimal Design in Stochastic Neural Models
.” 2016. Thesis, University of Ottawa. Accessed March 04, 2021.
http://hdl.handle.net/10393/34866.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
MLA Handbook (7th Edition):
Iolov, Alexandre V. “Parameter Estimation, Optimal Control and Optimal Design in Stochastic Neural Models
.” 2016. Web. 04 Mar 2021.
Vancouver:
Iolov AV. Parameter Estimation, Optimal Control and Optimal Design in Stochastic Neural Models
. [Internet] [Thesis]. University of Ottawa; 2016. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/10393/34866.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Council of Science Editors:
Iolov AV. Parameter Estimation, Optimal Control and Optimal Design in Stochastic Neural Models
. [Thesis]. University of Ottawa; 2016. Available from: http://hdl.handle.net/10393/34866
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
9.
Filo, Maurice George.
Topics in Stochastic Stability, Optimal Control and Estimation Theory.
Degree: 2018, University of California – eScholarship, University of California
URL: http://www.escholarship.org/uc/item/7nh0k0dp
► This dissertation consists of four parts that revolve around structured stochastic uncertainty and optimal control/estimation theory.In the first part, we consider the continuous-time setting of…
(more)
▼ This dissertation consists of four parts that revolve around structured stochastic uncertainty and optimal control/estimation theory.In the first part, we consider the continuous-time setting of linear time-invariant (LTI) systems in feedback with multiplicative stochastic uncertainties. The objective is to characterize the conditions of Mean-Square Stability (MSS) using a purely input-output approach. This approach leads to uncovering new tools such as stochastic block diagrams. Various stochastic interpretations are considered, such as It\=o and Stratonovich, and block diagram conversion schemes between different interpretations are devised. The MSS conditions are given in terms of the spectral radius of a matrix operator that takes different forms when different stochastic interpretations are considered. The second part applies the developed theory to analyze the mean-square stability and performance of stochastic cochlear models. The analysis is carried out for a generalized class of biomechanical models of the cochlea, that is formulated as a stochastic spatially distributed system, by allowing stochastic spatio-temporal perturbations within the cochlear amplifier. The simulation-free analysis explains the underlying mechanisms that give rise to cochlear instabilities such as spontaneous otoacoustic emissions and/or tinnitus. Furthermore, nonlinear stochastic simulations are carried out to validate the predictions of the theoretical analysis. The third part revisits the development of numerical methods to solve optimal control problems using a function-space approach. This approach has the advantage of unifying the framework upon which the various (existing) numerical methods are based on. In fact, this approach motivates the definition of various system and projection operators that make the derivations conceptually transparent. Furthermore, the function-space approach builds useful geometric intuitions that inspire the development of new projection-based methods.In the last part, we propose a methodology of optimal path design for sensors through a distributed environment. We consider time-limited scenarios where the sensors can only make a small number of measurements, but where some portion of a physics-based model is available for the field of interest (such as temperature). We consider both point-wise and tomographic sensors. The main idea is to recast the sensor path planning problem as a deterministic optimal control problem to minimize metrics related to the optimal estimation error covariance.
Subjects/Keywords: Engineering; Acoustic Tomography; Cochlea; Optimal Control; Optimal Estimation; Stochastic Stability; Stochastic Uncertainty
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Filo, M. G. (2018). Topics in Stochastic Stability, Optimal Control and Estimation Theory. (Thesis). University of California – eScholarship, University of California. Retrieved from http://www.escholarship.org/uc/item/7nh0k0dp
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Chicago Manual of Style (16th Edition):
Filo, Maurice George. “Topics in Stochastic Stability, Optimal Control and Estimation Theory.” 2018. Thesis, University of California – eScholarship, University of California. Accessed March 04, 2021.
http://www.escholarship.org/uc/item/7nh0k0dp.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
MLA Handbook (7th Edition):
Filo, Maurice George. “Topics in Stochastic Stability, Optimal Control and Estimation Theory.” 2018. Web. 04 Mar 2021.
Vancouver:
Filo MG. Topics in Stochastic Stability, Optimal Control and Estimation Theory. [Internet] [Thesis]. University of California – eScholarship, University of California; 2018. [cited 2021 Mar 04].
Available from: http://www.escholarship.org/uc/item/7nh0k0dp.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Council of Science Editors:
Filo MG. Topics in Stochastic Stability, Optimal Control and Estimation Theory. [Thesis]. University of California – eScholarship, University of California; 2018. Available from: http://www.escholarship.org/uc/item/7nh0k0dp
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation

Georgia Tech
10.
Shao, Yuanxun.
Advanced Convex Relaxations for Nonconvex Stochastic Programs and AC Optimal Power Flow.
Degree: PhD, Chemical and Biomolecular Engineering, 2020, Georgia Tech
URL: http://hdl.handle.net/1853/64205
► Mathematical optimization problems arise in nearly all areas of engineering design, operations, and control. However, optimization models of practical interest are often nonconvex, large-scale, and…
(more)
▼ Mathematical optimization problems arise in nearly all areas of engineering design, operations, and
control. However, optimization models of practical interest are often nonconvex, large-scale, and uncertain. All of these factors severely complicate the solution of these problems and make it much more difficult to locate true global solutions rather than inferior local solutions. The new algorithms developed in this Ph.D. work enable more efficient solutions of nonconvex
stochastic optimization problems,
stochastic optimal control problems, and AC
optimal power flow problems than previously possible. Moreover, this work contributes fundamental advances to global optimization theory that may lead to efficient solutions of larger and more complex optimization problems in other areas as well. Higher quality decision-making in such systems could possibly save energy and provide affordable products to impoverished areas.
Advisors/Committee Members: Scott, Joseph K. (advisor), Medford, Andrew J. (advisor), Boukouvala, Fani (committee member), Dey, Santanu S. (committee member), Grover, Martha A. (committee member).
Subjects/Keywords: Convex Relaxation; Global Optimization; Stochastic Optimization; Stochastic Optimal Control; Bounds Tightening; Optimal Power Flow
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Shao, Y. (2020). Advanced Convex Relaxations for Nonconvex Stochastic Programs and AC Optimal Power Flow. (Doctoral Dissertation). Georgia Tech. Retrieved from http://hdl.handle.net/1853/64205
Chicago Manual of Style (16th Edition):
Shao, Yuanxun. “Advanced Convex Relaxations for Nonconvex Stochastic Programs and AC Optimal Power Flow.” 2020. Doctoral Dissertation, Georgia Tech. Accessed March 04, 2021.
http://hdl.handle.net/1853/64205.
MLA Handbook (7th Edition):
Shao, Yuanxun. “Advanced Convex Relaxations for Nonconvex Stochastic Programs and AC Optimal Power Flow.” 2020. Web. 04 Mar 2021.
Vancouver:
Shao Y. Advanced Convex Relaxations for Nonconvex Stochastic Programs and AC Optimal Power Flow. [Internet] [Doctoral dissertation]. Georgia Tech; 2020. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/1853/64205.
Council of Science Editors:
Shao Y. Advanced Convex Relaxations for Nonconvex Stochastic Programs and AC Optimal Power Flow. [Doctoral Dissertation]. Georgia Tech; 2020. Available from: http://hdl.handle.net/1853/64205

Macquarie University
11.
Zhang, Jinhui.
Optimal consumption, investment and insurance strategy applications.
Degree: 2017, Macquarie University
URL: http://hdl.handle.net/1959.14/1273089
► Thesis by publication.
Bibliography: pages 129-143.
1. Introduction – 2. Paper 1 – 3. Paper 2. – 4. Paper 3 – 5. Conclusion – References.…
(more)
▼ Thesis by publication.
Bibliography: pages 129-143.
1. Introduction – 2. Paper 1 – 3. Paper 2. – 4. Paper 3 – 5. Conclusion – References.
Drawing on the existing literature, a utility-maximising agent is studied in the application of a life-cycle optimal strategy of consumption, investment and insurance to different, and unexplored, scenarios. Key factors, including time inconsistent preferences, an optimal stopping time and a dynamic risk environment,can affect agents' behaviour and thereby influence their financial strategies .In this thesis three research papers are developed to apply optimal strategies in various circumstances.
In the first research paper, an optimal portfolio management model with hyperbolic discounting and luxury-type bequest motives is used to explain the annuity puzzle - the low demand for voluntary life annuities. Using hyperbolic discounting, agents' time-inconsistent preferences can be described and measured in the model. Two extreme types of agents' time-inconsistent behaviours, "naïve" behaviour and "sophisticated" behaviour, are then examined and studied. To build a more realistic model, the luxury-type bequest motives are further incorporated into the model. The model in paper 1 is calibrated to Swiss data to obtain numerical results.
In the second research paper, the financial planning problem of a retiree seeking to enter a retirement village at a future time is studied. As the retiree is assumed to be utility-driven and would fully annuitise her wealth at the time of entry, her optimal strategy is a solution to problems of both optimal control and optimal stopping. Within the context of dynamic health states, the optimal strategy should include an optimal plan of consumption, investment, bequest and insurance prior to the entry date, and an optimal stopping time to conduct the full annuitisation for entering the retirement village. For a case that has an initial deposit requirement for entering the retirement village, the optimal solution incorporates an American option replication. The model in paper 2 uses Australian data to present our numerical results
In the final research paper, an optimal strategy is applied in a dynamic risk environment. Jumps and regime switching are incorporated in the risky asset diffusion to describe the dynamic risk environment. By extending the model in Richard (1975), a system of paired Hamilton-Jacobi-Bellman (HJB) equations is obtained and solved. Using numerical methods and calibrating to American data, the numerical results of agents' behaviours for different risk environments are obtained.
1 online resource (xviii, 143 pages) graphs, tables
Advisors/Committee Members: Macquarie University. Department of Applied Finance and Actuarial Studies.
Subjects/Keywords: Financial risk management Mathematical models; Stochastic control theory; optimal investment; Richard's model; stochastic optimal control; optimal stopping
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Zhang, J. (2017). Optimal consumption, investment and insurance strategy applications. (Doctoral Dissertation). Macquarie University. Retrieved from http://hdl.handle.net/1959.14/1273089
Chicago Manual of Style (16th Edition):
Zhang, Jinhui. “Optimal consumption, investment and insurance strategy applications.” 2017. Doctoral Dissertation, Macquarie University. Accessed March 04, 2021.
http://hdl.handle.net/1959.14/1273089.
MLA Handbook (7th Edition):
Zhang, Jinhui. “Optimal consumption, investment and insurance strategy applications.” 2017. Web. 04 Mar 2021.
Vancouver:
Zhang J. Optimal consumption, investment and insurance strategy applications. [Internet] [Doctoral dissertation]. Macquarie University; 2017. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/1959.14/1273089.
Council of Science Editors:
Zhang J. Optimal consumption, investment and insurance strategy applications. [Doctoral Dissertation]. Macquarie University; 2017. Available from: http://hdl.handle.net/1959.14/1273089

Georgia Tech
12.
Exarchos, Ioannis.
Stochastic optimal control - a forward and backward sampling approach.
Degree: PhD, Aerospace Engineering, 2017, Georgia Tech
URL: http://hdl.handle.net/1853/59263
► Stochastic optimal control has seen significant recent development, motivated by its success in a plethora of engineering applications, such as autonomous systems, robotics, neuroscience, and…
(more)
▼ Stochastic optimal control has seen significant recent development, motivated by its success in a plethora of engineering applications, such as autonomous systems, robotics, neuroscience, and financial engineering. Despite the many theoretical and algorithmic advancements that made such a success possible, several obstacles remain; most notable are (i) the mitigation of the curse of dimensionality inherent in
optimal control problems, (ii) the design of efficient algorithms that allow for fast, online computation, and (iii) the expansion of the class of
optimal control problems that can be addressed by algorithms in engineering practice. The aim of this dissertation is the development of a learning
stochastic control framework which capitalizes on the innate relationship between certain nonlinear partial differential equations (PDEs) and forward and backward
stochastic differential equations (FBSDEs), demonstrated by a nonlinear version of the Feynman-Kac lemma. By means of this lemma, we are able to obtain a probabilistic representation of the solution to the nonlinear Hamilton-Jacobi-Bellman PDE, expressed in form of a system of decoupled FBSDEs. This system of FBSDEs can then be simulated by employing linear regression techniques. We present a novel discretization scheme for FBSDEs, and enhance the resulting algorithm with importance sampling, thereby constructing an iterative scheme that is capable of learning the
optimal control without an initial guess, even in systems with highly nonlinear, underactuated dynamics. The framework we develop within this dissertation addresses several classes of
stochastic optimal control, such as L2, L1, risk sensitive
control, as well as some classes of differential games, in both fixed-final-time as well as first-exit settings.
Advisors/Committee Members: Tsiotras, Panagiotis (advisor), Theodorou, Evangelos A. (advisor), Haddad, Wassim M. (committee member), Zhou, Haomin (committee member), Popescu, Ionel (committee member).
Subjects/Keywords: Stochastic optimal control; Forward and backward stochastic differential equations
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Exarchos, I. (2017). Stochastic optimal control - a forward and backward sampling approach. (Doctoral Dissertation). Georgia Tech. Retrieved from http://hdl.handle.net/1853/59263
Chicago Manual of Style (16th Edition):
Exarchos, Ioannis. “Stochastic optimal control - a forward and backward sampling approach.” 2017. Doctoral Dissertation, Georgia Tech. Accessed March 04, 2021.
http://hdl.handle.net/1853/59263.
MLA Handbook (7th Edition):
Exarchos, Ioannis. “Stochastic optimal control - a forward and backward sampling approach.” 2017. Web. 04 Mar 2021.
Vancouver:
Exarchos I. Stochastic optimal control - a forward and backward sampling approach. [Internet] [Doctoral dissertation]. Georgia Tech; 2017. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/1853/59263.
Council of Science Editors:
Exarchos I. Stochastic optimal control - a forward and backward sampling approach. [Doctoral Dissertation]. Georgia Tech; 2017. Available from: http://hdl.handle.net/1853/59263

Georgia Tech
13.
Okamoto, Kazuhide.
Optimal covariance steering: Theory and its application to autonomous driving.
Degree: PhD, Aerospace Engineering, 2019, Georgia Tech
URL: http://hdl.handle.net/1853/62260
► Optimal control under uncertainty has been one of the central research topics in the control community for decades. While a number of theories have been…
(more)
▼ Optimal control under uncertainty has been one of the central research topics in the
control community for decades. While a number of theories have been developed to
control a single state from an initial state to a target state, in some situations, it is preferable to simultaneously compute
control commands for multiple states that start from an initial distribution and converge to a target distribution. This dissertation aims to develop a
stochastic optimal control theory that, in addition to the mean, explicitly steers the state covariance. Specifically, we focus on the
control of linear time-varying (LTV) systems with additive Gaussian noise. The task is to steer a Gaussian-distributed initial system state distribution to a target Gaussian distribution, while minimizing a state and
control expectation-dependent quadratic cost under probabilistic state constraints. Notice that, in such systems, the system state keeps being Gaussian distributed. Because Gaussian distributions can be fully described by the first two moments, the proposed
optimal covariance steering (OCS) theory allows us to
control the whole distribution of the state and quantify the effect of uncertainty without conducting Monte-Carlo simulations. We propose to use a
control policy that is an affine function of filtered disturbances, which utilizes the results of convex optimization theory and efficiently finds the solution. After the OCS theory for LTV systems is introduced, we extend the theory to vehicle path planning problems. While several path planning algorithms have been proposed, many of them have dealt with deterministic dynamics or
stochastic dynamics with open-loop un- certainty, i.e., the uncertainty of the system state is not controlled and, typically, increases with time due to exogenous disturbances, which may lead to the design of potentially conservative nominal paths. A typical approach to deal with disturbances is to use a lower-level local feedback controller after the nominal path is computed. This unidirectional dependence of the feedback controller on the path planner makes the nominal path unnecessarily conservative. The path-planning approach we develop based on the OCS theory computes the nominal path based on the closed-loop evolution of the system uncertainty by simultaneously optimizing the feedforward and feedback
control commands. We validate the performance using numerical simulations with single and multiple vehicle path planning problems. Furthermore, we introduce an
optimal covariance steering controller for linear systems with input hard constraints. As many real-world systems have input constraints (e.g., air- craft and spacecraft have minimum/maximum thrust), this problem formulation will allow us to deal with realistic scenarios. In order to incorporate input hard constraints in the OCS theory framework, we use element-wise saturation functions and limit the effect of disturbance to the
control commands. We prove that this problem formulation leads to a convex programming problem and demonstrate the…
Advisors/Committee Members: Tsiotras, Panagiotis (advisor), Clarke, Jahn-Paul (committee member), Chernova, Sonia (committee member), Rogers, Jonathan (committee member), Chen, Yongxin (committee member).
Subjects/Keywords: Stochastic control; Optimal control; Model predictive control; Vehicle path planning
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Okamoto, K. (2019). Optimal covariance steering: Theory and its application to autonomous driving. (Doctoral Dissertation). Georgia Tech. Retrieved from http://hdl.handle.net/1853/62260
Chicago Manual of Style (16th Edition):
Okamoto, Kazuhide. “Optimal covariance steering: Theory and its application to autonomous driving.” 2019. Doctoral Dissertation, Georgia Tech. Accessed March 04, 2021.
http://hdl.handle.net/1853/62260.
MLA Handbook (7th Edition):
Okamoto, Kazuhide. “Optimal covariance steering: Theory and its application to autonomous driving.” 2019. Web. 04 Mar 2021.
Vancouver:
Okamoto K. Optimal covariance steering: Theory and its application to autonomous driving. [Internet] [Doctoral dissertation]. Georgia Tech; 2019. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/1853/62260.
Council of Science Editors:
Okamoto K. Optimal covariance steering: Theory and its application to autonomous driving. [Doctoral Dissertation]. Georgia Tech; 2019. Available from: http://hdl.handle.net/1853/62260

University of Texas – Austin
14.
-0056-8793.
Existence, characterization and approximation in the generalized monotone follower problem.
Degree: PhD, Mathematics, 2015, University of Texas – Austin
URL: http://hdl.handle.net/2152/31517
► We revisit the classical monotone-follower problem and consider it in a generalized formulation. Our approach, based on a compactness substitute for nondecreasing processes, the Meyer-Zheng…
(more)
▼ We revisit the classical monotone-follower problem and consider it in a generalized formulation. Our approach, based on a compactness substitute for nondecreasing processes, the Meyer-Zheng weak convergence, and the maximum principle of Pontryagin, establishes existence under minimal conditions, produces general approximation results and further elucidates the celebrated connection between
optimal stochastic control and stopping.
Advisors/Committee Members: Žitković, Gordan (advisor), Chen, Thomas (committee member), Larsen, Kasper (committee member), Sirbu, Mihai (committee member), Zariphopoulou, Thaleia (committee member).
Subjects/Keywords: Maximum principle; Meyer-Zheng convergence; Monotone-follower problem; Optimal stochastic control; Optimal stopping; Singular control
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
-0056-8793. (2015). Existence, characterization and approximation in the generalized monotone follower problem. (Doctoral Dissertation). University of Texas – Austin. Retrieved from http://hdl.handle.net/2152/31517
Note: this citation may be lacking information needed for this citation format:
Author name may be incomplete
Chicago Manual of Style (16th Edition):
-0056-8793. “Existence, characterization and approximation in the generalized monotone follower problem.” 2015. Doctoral Dissertation, University of Texas – Austin. Accessed March 04, 2021.
http://hdl.handle.net/2152/31517.
Note: this citation may be lacking information needed for this citation format:
Author name may be incomplete
MLA Handbook (7th Edition):
-0056-8793. “Existence, characterization and approximation in the generalized monotone follower problem.” 2015. Web. 04 Mar 2021.
Note: this citation may be lacking information needed for this citation format:
Author name may be incomplete
Vancouver:
-0056-8793. Existence, characterization and approximation in the generalized monotone follower problem. [Internet] [Doctoral dissertation]. University of Texas – Austin; 2015. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/2152/31517.
Note: this citation may be lacking information needed for this citation format:
Author name may be incomplete
Council of Science Editors:
-0056-8793. Existence, characterization and approximation in the generalized monotone follower problem. [Doctoral Dissertation]. University of Texas – Austin; 2015. Available from: http://hdl.handle.net/2152/31517
Note: this citation may be lacking information needed for this citation format:
Author name may be incomplete

Washington University in St. Louis
15.
Qi, Ji.
Control of Deterministic and Stochastic Linear Ensemble Systems.
Degree: PhD, Electrical & Systems Engineering, 2014, Washington University in St. Louis
URL: https://openscholarship.wustl.edu/eng_etds/71
► The behavior of physical, chemical, and biological systems can exhibit significant sensitivity to uncertainty or variation in system parameters. This factor arises in practical…
(more)
▼ The behavior of physical, chemical, and biological systems can exhibit significant sensitivity to uncertainty or variation in system parameters. This factor arises in practical
control problems in many areas of science and engineering when there is uncertainty in the parameters of a single
control system, or when a collection of structurally similar systems with variations in common parameters must be steered using a common
control signal. Analysis of these cases has given rise to the
subject of ensemble
control, which was motivated by practical
control design problems in the fields of nuclear magnetic resonance spectroscopy and imaging, neuroscience, and sensorless robotic manipulation. This dissertation focuses on the investigation of fundamental properties and the development of
optimal controls for deterministic and
stochastic linear ensemble systems. Although the ensemble controllability for deterministic linear ensemble systems has been characterized in previous studies, explicit controllability conditions remain undiscovered. In this dissertation, explicit controllability conditions for a class of time-invariant linear ensemble systems with linear parameter variation are constructed. This class of ensemble
control systems arises from practical engineering and physical applications, such as the transport of quantum particles and
control of uncertain harmonic systems. The construction is based on the notion of polynomial approximation, and the conditions are related to the rank of the system matrices and are easy to verify. In addition to the study of deterministic ensemble
control systems, we extend our work to a
stochastic case where the ensemble systems are
subject to random dynamic disturbances. Such disturbances can greatly affect the behavior of systems, which can become particularly challenging to
control in a desired manner as a result, especially when feedback cannot be used to attenuate disturbances. We study
optimal steering problems involving
stochastic linear ensemble systems driven by Gaussian noise and Poisson counters. In particular, we seek to minimize the statistical objectives of the mean square error (MSE) and the error in the mean of the terminal state of the ensemble with respect to the desired state.
Advisors/Committee Members: Hiro Mukai, Heinz Schaettler, Istvan Kiss.
Subjects/Keywords: controllability; ensemble control; optimal control; polynomial approxiamtion; stochastic; Engineering
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Qi, J. (2014). Control of Deterministic and Stochastic Linear Ensemble Systems. (Doctoral Dissertation). Washington University in St. Louis. Retrieved from https://openscholarship.wustl.edu/eng_etds/71
Chicago Manual of Style (16th Edition):
Qi, Ji. “Control of Deterministic and Stochastic Linear Ensemble Systems.” 2014. Doctoral Dissertation, Washington University in St. Louis. Accessed March 04, 2021.
https://openscholarship.wustl.edu/eng_etds/71.
MLA Handbook (7th Edition):
Qi, Ji. “Control of Deterministic and Stochastic Linear Ensemble Systems.” 2014. Web. 04 Mar 2021.
Vancouver:
Qi J. Control of Deterministic and Stochastic Linear Ensemble Systems. [Internet] [Doctoral dissertation]. Washington University in St. Louis; 2014. [cited 2021 Mar 04].
Available from: https://openscholarship.wustl.edu/eng_etds/71.
Council of Science Editors:
Qi J. Control of Deterministic and Stochastic Linear Ensemble Systems. [Doctoral Dissertation]. Washington University in St. Louis; 2014. Available from: https://openscholarship.wustl.edu/eng_etds/71

University of Manchester
16.
Martyr, Randall.
Optimal prediction games in local electricity
markets.
Degree: 2015, University of Manchester
URL: http://www.manchester.ac.uk/escholar/uk-ac-man-scw:281877
► Local electricity markets can be defined broadly as "future electricity market designs involving domestic customers, demand-side response and energy storage". Like current deregulated electricity markets,…
(more)
▼ Local electricity markets can be defined broadly as
"future electricity market designs involving domestic customers,
demand-side response and energy storage". Like current deregulated
electricity markets, these localised derivations present specific
stochastic optimisation problems in which the dynamic and random
nature of the market is intertwined with the physical needs of its
participants. Moreover, the types of contracts and constraints in
this setting are such that ``games'' naturally emerge between the
agents. Advanced modelling techniques beyond classical mathematical
finance are therefore key to their analysis. This thesis aims to
study contracts in these local electricity markets using the
mathematical theories of
stochastic optimal control and
games.Chapter 1 motivates the research, provides an overview of the
electricity market in Great Britain, and summarises the content of
this thesis. It introduces three problems which are studied later
in the thesis: a simple
control problem involving demand-side
management for domestic customers, and two examples of games within
local electricity markets, one of them involving energy storage.
Chapter 2 then reviews the literature most relevant to the topics
discussed in this work.Chapter 3 investigates how electric space
heating loads can be made responsive to time varying prices in an
electricity spot market. The problem is formulated mathematically
within the framework of deterministic
optimal control, and is
analysed using methods such as Pontryagin's Maximum Principle and
Dynamic Programming. Numerical simulations are provided to
illustrate how the
control strategies perform on real market
data.The problem of Chapter 3 is reformulated in Chapter 4 as one
of
optimal switching in discrete-time. A martingale approach is
used to establish the existence of an
optimal strategy in a very
general setup, and also provides an algorithm for computing the
value function and the
optimal strategy. The theory is exemplified
by a numerical example for the motivating problem. Chapter 5 then
continues the study of finite horizon
optimal switching problems,
but in continuous time. It also uses martingale methods to prove
the existence of an
optimal strategy in a fairly general
model.Chapter 6 introduces a mathematical model for a game
contingent claim between an electricity supplier and generator
described in the introduction. A theory for using
optimal switching
to solve such games is developed and subsequently evidenced by a
numerical example. An
optimal switching formulation of the
aforementioned game contingent claim is provided for an abstract
Markovian model of the electricity market.The final chapter studies
a balancing services contract between an electricity transmission
system operator (SO) and the owner of an electric energy storage
device (battery operator or BO). The objectives of the SO and BO
are combined in a non-zero sum
stochastic differential game where
one player (BO) uses a classic
control with continuous effects,
whereas the other player (SO) uses an impulse…
Advisors/Committee Members: PESKIR, GORAN G, Moriarty, John, Peskir, Goran.
Subjects/Keywords: optimal control; stochastic control; optimal stopping; stochastic games; optimal switching; optimal impulse control; power system economics; electricity markets; contracts for difference; electricity market reform; balancing services; demand response; energy storage
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Martyr, R. (2015). Optimal prediction games in local electricity
markets. (Doctoral Dissertation). University of Manchester. Retrieved from http://www.manchester.ac.uk/escholar/uk-ac-man-scw:281877
Chicago Manual of Style (16th Edition):
Martyr, Randall. “Optimal prediction games in local electricity
markets.” 2015. Doctoral Dissertation, University of Manchester. Accessed March 04, 2021.
http://www.manchester.ac.uk/escholar/uk-ac-man-scw:281877.
MLA Handbook (7th Edition):
Martyr, Randall. “Optimal prediction games in local electricity
markets.” 2015. Web. 04 Mar 2021.
Vancouver:
Martyr R. Optimal prediction games in local electricity
markets. [Internet] [Doctoral dissertation]. University of Manchester; 2015. [cited 2021 Mar 04].
Available from: http://www.manchester.ac.uk/escholar/uk-ac-man-scw:281877.
Council of Science Editors:
Martyr R. Optimal prediction games in local electricity
markets. [Doctoral Dissertation]. University of Manchester; 2015. Available from: http://www.manchester.ac.uk/escholar/uk-ac-man-scw:281877

King Abdullah University of Science and Technology
17.
Caballero, Renzo.
Stochastic Optimal Control of Renewable Energy.
Degree: Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division, 2019, King Abdullah University of Science and Technology
URL: http://hdl.handle.net/10754/655846
► Uruguay is a pioneer in the use of renewable sources of energy and can usually satisfy its total demand from renewable sources. Control and optimization…
(more)
▼ Uruguay is a pioneer in the use of renewable sources of energy and can usually satisfy its total demand from renewable sources.
Control and optimization of the system is complicated by half of the installed power - wind and solar sources - be- ing non-controllable with high uncertainty and variability. In this work we present a novel optimization technique for efficient use of the production facilities. The dy- namical system is
stochastic, and we deal with its non-Markovian dynamics through a Lagrangian relaxation. Continuous-time
optimal control and value function are found from the solution to a sequence of Hamilton-Jacobi-Bellman partial differential equations associated with the system. We introduce a monotone scheme to avoid spurious oscillations in the numerical solution and apply the technique to a number of examples taken from the Uruguayan grid. We use parallelization and change of variables to reduce the computational times. Finally, we study the usefulness of extra system storage capacity offered by batteries.
Advisors/Committee Members: Tempone, Raul (advisor), Parsani, Matteo (committee member), Ghanem, Bernard (committee member).
Subjects/Keywords: optimal control; renewable energy; Hamilton-Jacobi-Bellman; wind power optimiztion; stochastic optimal control; optimal energy dispatch
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Caballero, R. (2019). Stochastic Optimal Control of Renewable Energy. (Thesis). King Abdullah University of Science and Technology. Retrieved from http://hdl.handle.net/10754/655846
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Chicago Manual of Style (16th Edition):
Caballero, Renzo. “Stochastic Optimal Control of Renewable Energy.” 2019. Thesis, King Abdullah University of Science and Technology. Accessed March 04, 2021.
http://hdl.handle.net/10754/655846.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
MLA Handbook (7th Edition):
Caballero, Renzo. “Stochastic Optimal Control of Renewable Energy.” 2019. Web. 04 Mar 2021.
Vancouver:
Caballero R. Stochastic Optimal Control of Renewable Energy. [Internet] [Thesis]. King Abdullah University of Science and Technology; 2019. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/10754/655846.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Council of Science Editors:
Caballero R. Stochastic Optimal Control of Renewable Energy. [Thesis]. King Abdullah University of Science and Technology; 2019. Available from: http://hdl.handle.net/10754/655846
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation

University of California – Berkeley
18.
Miller, Christopher Wells.
Methods for Optimal Stochastic Control and Optimal Stopping Problems Featuring Time-Inconsistency.
Degree: Applied Mathematics, 2016, University of California – Berkeley
URL: http://www.escholarship.org/uc/item/56f5715d
► This thesis presents novel methods for computing optimal pre-commitment strategies in time-inconsistent optimal stochastic control and optimal stopping problems. We demonstrate how a time-inconsistent problem…
(more)
▼ This thesis presents novel methods for computing optimal pre-commitment strategies in time-inconsistent optimal stochastic control and optimal stopping problems. We demonstrate how a time-inconsistent problem can often be re-written in terms of a sequential optimization problem involving the value function of a time-consistent optimal control problem in a higher-dimensional state-space. In particular, we obtain optimal pre-commitment strategies in a non-linear optimal stopping problem, in an optimal stochastic control problem involving conditional value-at-risk, and in an optimal stopping problem with a distribution constraint on the admissible stopping times. In each case, we relate the original problem to auxiliary time-consistent problems, the value functions of which may be characterized in terms of viscosity solutions of a Hamilton-Jacobi-Bellman equation.
Subjects/Keywords: Applied mathematics; Mathematical finance; Optimal stochastic control; Optimal stopping problems; Time-inconsistency
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Miller, C. W. (2016). Methods for Optimal Stochastic Control and Optimal Stopping Problems Featuring Time-Inconsistency. (Thesis). University of California – Berkeley. Retrieved from http://www.escholarship.org/uc/item/56f5715d
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Chicago Manual of Style (16th Edition):
Miller, Christopher Wells. “Methods for Optimal Stochastic Control and Optimal Stopping Problems Featuring Time-Inconsistency.” 2016. Thesis, University of California – Berkeley. Accessed March 04, 2021.
http://www.escholarship.org/uc/item/56f5715d.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
MLA Handbook (7th Edition):
Miller, Christopher Wells. “Methods for Optimal Stochastic Control and Optimal Stopping Problems Featuring Time-Inconsistency.” 2016. Web. 04 Mar 2021.
Vancouver:
Miller CW. Methods for Optimal Stochastic Control and Optimal Stopping Problems Featuring Time-Inconsistency. [Internet] [Thesis]. University of California – Berkeley; 2016. [cited 2021 Mar 04].
Available from: http://www.escholarship.org/uc/item/56f5715d.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Council of Science Editors:
Miller CW. Methods for Optimal Stochastic Control and Optimal Stopping Problems Featuring Time-Inconsistency. [Thesis]. University of California – Berkeley; 2016. Available from: http://www.escholarship.org/uc/item/56f5715d
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation

Georgia Tech
19.
Li, Wuchen.
A study of stochastic differential equations and Fokker-Planck equations with applications.
Degree: PhD, Mathematics, 2016, Georgia Tech
URL: http://hdl.handle.net/1853/54999
► Fokker-Planck equations, along with stochastic differential equations, play vital roles in physics, population modeling, game theory and optimization (finite or infinite dimensional). In this thesis,…
(more)
▼ Fokker-Planck equations, along with
stochastic differential equations, play vital roles in physics, population modeling, game theory and optimization (finite or infinite dimensional). In this thesis, we study three topics, both theoretically and computationally, centered around them. In part one, we consider the
optimal transport for finite discrete states, which are on a finite but arbitrary graph. By defining a discrete 2-Wasserstein metric, we derive Fokker-Planck equations on finite graphs as gradient flows of free energies. By using dynamical viewpoint, we obtain an exponential convergence result to equilibrium. This derivation provides tools for many applications, including numerics for nonlinear partial differential equations and evolutionary game theory. In part two, we introduce a new
stochastic differential equation based framework for
optimal control with constraints. The framework can efficiently solve several real world problems in differential games and Robotics, including the path-planning problem. In part three, we introduce a new noise model for
stochastic oscillators. With this model, we prove global boundedness of trajectories. In addition, we derive a pair of associated Fokker-Planck equations.
Advisors/Committee Members: Dieci, Luca (advisor), Chow, Shui Nee (committee member), Zhou, Haomin (committee member), Egerstedt, Magnus (committee member), Gangbo, Wilfrid (committee member).
Subjects/Keywords: Stochastic differential equations; Fokker-Planck equations; Gradient flow; Optimal control; Optimal transport
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Li, W. (2016). A study of stochastic differential equations and Fokker-Planck equations with applications. (Doctoral Dissertation). Georgia Tech. Retrieved from http://hdl.handle.net/1853/54999
Chicago Manual of Style (16th Edition):
Li, Wuchen. “A study of stochastic differential equations and Fokker-Planck equations with applications.” 2016. Doctoral Dissertation, Georgia Tech. Accessed March 04, 2021.
http://hdl.handle.net/1853/54999.
MLA Handbook (7th Edition):
Li, Wuchen. “A study of stochastic differential equations and Fokker-Planck equations with applications.” 2016. Web. 04 Mar 2021.
Vancouver:
Li W. A study of stochastic differential equations and Fokker-Planck equations with applications. [Internet] [Doctoral dissertation]. Georgia Tech; 2016. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/1853/54999.
Council of Science Editors:
Li W. A study of stochastic differential equations and Fokker-Planck equations with applications. [Doctoral Dissertation]. Georgia Tech; 2016. Available from: http://hdl.handle.net/1853/54999

University of Manchester
20.
Cheng, Mingliang.
CORPORATE VALUATION AND OPTIMAL OPERATION UNDER LIQUIDITY
CONSTRAINTS.
Degree: 2016, University of Manchester
URL: http://www.manchester.ac.uk/escholar/uk-ac-man-scw:298233
► We investigate the impact of cash reserves upon the optimal behaviour of a modelled firm that has uncertain future revenues. To achieve this, we build…
(more)
▼ We investigate the impact of cash reserves upon the
optimal behaviour of a modelled firm that has uncertain future
revenues. To achieve this, we build up a corporate financing model
of a firm from a Real Options foundation, with the option to close
as a core business decision maintained throughout. We model the
firm by employing an
optimal stochastic control mathematical
approach, which is based upon a partial differential equations
perspective. In so doing, we are able to assess the incremental
impacts upon the
optimal operation of the cash constrained firm, by
sequentially including: an
optimal dividend distribution;
optimal
equity financing; and
optimal debt financing (conducted in a novel
equilibrium setting between firm and creditor). We present
efficient numerical schemes to solve these models, which are
generally built from the Projected Successive Over Relaxation
(PSOR) method, and the Semi-Lagrangian approach. Using these
numerical tools, and our gained economic insights, we then allow
the firm the option to also expand the operation, so they may also
take advantage of favourable economic conditions.
Advisors/Committee Members: JOHNSON, PAUL PV, Johnson, Paul, Evatt, Geoffrey.
Subjects/Keywords: Corporate Finance; Real Options; Debt Financing; Optimal Investment; Stochastic Control; Semi-Lagrangian Methods; Optimal Dividends
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Cheng, M. (2016). CORPORATE VALUATION AND OPTIMAL OPERATION UNDER LIQUIDITY
CONSTRAINTS. (Doctoral Dissertation). University of Manchester. Retrieved from http://www.manchester.ac.uk/escholar/uk-ac-man-scw:298233
Chicago Manual of Style (16th Edition):
Cheng, Mingliang. “CORPORATE VALUATION AND OPTIMAL OPERATION UNDER LIQUIDITY
CONSTRAINTS.” 2016. Doctoral Dissertation, University of Manchester. Accessed March 04, 2021.
http://www.manchester.ac.uk/escholar/uk-ac-man-scw:298233.
MLA Handbook (7th Edition):
Cheng, Mingliang. “CORPORATE VALUATION AND OPTIMAL OPERATION UNDER LIQUIDITY
CONSTRAINTS.” 2016. Web. 04 Mar 2021.
Vancouver:
Cheng M. CORPORATE VALUATION AND OPTIMAL OPERATION UNDER LIQUIDITY
CONSTRAINTS. [Internet] [Doctoral dissertation]. University of Manchester; 2016. [cited 2021 Mar 04].
Available from: http://www.manchester.ac.uk/escholar/uk-ac-man-scw:298233.
Council of Science Editors:
Cheng M. CORPORATE VALUATION AND OPTIMAL OPERATION UNDER LIQUIDITY
CONSTRAINTS. [Doctoral Dissertation]. University of Manchester; 2016. Available from: http://www.manchester.ac.uk/escholar/uk-ac-man-scw:298233

University of California – Santa Cruz
21.
Anderson, Ross.
Uncertainty-Anticipating Stochastic Optimal Feedback Control of Autonomous Vehicle Models.
Degree: Applied Mathematics and Statistics, 2014, University of California – Santa Cruz
URL: http://www.escholarship.org/uc/item/3400q1w1
► Control of autonomous vehicle teams has emerged as a key topic in the control and robotics communities, owing to a growing range of applications that…
(more)
▼ Control of autonomous vehicle teams has emerged as a key topic in the control and robotics communities, owing to a growing range of applications that can benefit from the increased functionality provided by multiple vehicles. However, the mathematical analysis of the vehicle control problems is complicated by their nonholonomic and kinodynamic constraints, and, due to environmental uncertainties and information flow constraints, the vehicles operate with heightened uncertainty about the team's future motion. In this dissertation, we are motivated by autonomous vehicle control problems that highlight these uncertainties, with in particular attention paid to the uncertainty in the future motion of a secondary agent. Focusing on the Dubins vehicle and unicycle model, we propose a stochastic modeling and optimal feedback control approach that anticipates the uncertainty inherent to the systems. We first consider the application of a Dubins vehicle that should maintain a nominal distance from a target with an unknown future trajectory, such as a tagged animal or vehicle. Stochasticity is introduced in the problem by assuming that the target's motion can be modeled as a Wiener process, and the possibility for the loss of target observations is modeled using stochastic transitions between discrete states. An optimal control policy that is consistent with the stochastic kinematics is computed and is shown to perform well both in the case of a Brownian target and for natural, smooth target motion. We also characterize the resulting optimal feedback control laws in comparison to their deterministic counterparts for the case of a Dubins vehicle in a stochastically varying wind. Turning to the case of multiple vehicles, we develop a method using a Kalman smoothing algorithm for multiple vehicles to enhance an underlying analytic feedback control. The vehicles achieve a formation optimally and in a manner that is robust to uncertainty. To deal with a key implementation issue of these controllers on autonomous vehicle systems, we propose a self-triggering scheme for stochastic control systems, whereby the time points at which the control loop should be closed are computed from predictions of the process in a way that ensures stability.
Subjects/Keywords: Applied mathematics; Robotics; dubins vehicle; nonlinear control; path-integral control; self-triggered control; stochastic optimal control; stochastic processes
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Anderson, R. (2014). Uncertainty-Anticipating Stochastic Optimal Feedback Control of Autonomous Vehicle Models. (Thesis). University of California – Santa Cruz. Retrieved from http://www.escholarship.org/uc/item/3400q1w1
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Chicago Manual of Style (16th Edition):
Anderson, Ross. “Uncertainty-Anticipating Stochastic Optimal Feedback Control of Autonomous Vehicle Models.” 2014. Thesis, University of California – Santa Cruz. Accessed March 04, 2021.
http://www.escholarship.org/uc/item/3400q1w1.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
MLA Handbook (7th Edition):
Anderson, Ross. “Uncertainty-Anticipating Stochastic Optimal Feedback Control of Autonomous Vehicle Models.” 2014. Web. 04 Mar 2021.
Vancouver:
Anderson R. Uncertainty-Anticipating Stochastic Optimal Feedback Control of Autonomous Vehicle Models. [Internet] [Thesis]. University of California – Santa Cruz; 2014. [cited 2021 Mar 04].
Available from: http://www.escholarship.org/uc/item/3400q1w1.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Council of Science Editors:
Anderson R. Uncertainty-Anticipating Stochastic Optimal Feedback Control of Autonomous Vehicle Models. [Thesis]. University of California – Santa Cruz; 2014. Available from: http://www.escholarship.org/uc/item/3400q1w1
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation

North Carolina State University
22.
Marten, Alex Lennart.
Essays on the Application and Computation of Real Options.
Degree: PhD, Economics, 2009, North Carolina State University
URL: http://www.lib.ncsu.edu/resolver/1840.16/3725
► This dissertation presents a series of three essays that examine applications and computational issues associated with the use of stochastic optimal control modeling in the…
(more)
▼ This dissertation presents a series of three essays that examine applications and computational issues associated with the use of
stochastic optimal control modeling in the field of economics. In the first essay we examine the problem of valuing brownfield remediation and redevelopment projects amid regulatory and market uncertainty. A real options framework is developed to model the dynamic behavior of developers working with environmentally contaminated land in an investment environment with
stochastic real estate prices and an uncertain entitlement process. In a case study of an actual brownfield regeneration project we examine the impact of entitlement risk on the value of the site and
optimal developer behavior. The second essay presents a numerical method for solving
optimal switching models combined with a
stochastic control. For this class of hybrid
control problems the value function and the
optimal control policy are the solution to a Hamilton-Jacobi-Bellman quasi-variational inequality. We present a technique whereby approximating the value function using projection methods the Hamilton-Jacobi-Bellman quasi-variational inequality may be recast as extended vertical non-linear complementarity problem that may be solved using Newton's method. In the third essay we present a new method for estimating the parameters of
stochastic differential equations using low observation frequency data. The technique utilizes a quasi-maximum likelihood framework with the assumption of a Gaussian conditional transition density for the process. In order to reduce the error associated with the normality assumption sub-intervals are incorporated and integrated out using the Chapman-Kolmogorov equation and multi-dimensional Gauss Hermite quadrature. Further improvements are made through the use of Richardson extrapolation and higher order approximations for the conditional mean and variance of the process, resulting in an algorithm that may easily produce third and fourth order approximations for the conditional transition density.
Advisors/Committee Members: Roger von Haefen, Committee Member (advisor), Paul Fackler, Committee Chair (advisor), Denis Pelletier, Committee Member (advisor), John Seater, Committee Member (advisor).
Subjects/Keywords: stochastic optimal control; real options; conditional transition density; brownfields; stochastic differential equations
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Marten, A. L. (2009). Essays on the Application and Computation of Real Options. (Doctoral Dissertation). North Carolina State University. Retrieved from http://www.lib.ncsu.edu/resolver/1840.16/3725
Chicago Manual of Style (16th Edition):
Marten, Alex Lennart. “Essays on the Application and Computation of Real Options.” 2009. Doctoral Dissertation, North Carolina State University. Accessed March 04, 2021.
http://www.lib.ncsu.edu/resolver/1840.16/3725.
MLA Handbook (7th Edition):
Marten, Alex Lennart. “Essays on the Application and Computation of Real Options.” 2009. Web. 04 Mar 2021.
Vancouver:
Marten AL. Essays on the Application and Computation of Real Options. [Internet] [Doctoral dissertation]. North Carolina State University; 2009. [cited 2021 Mar 04].
Available from: http://www.lib.ncsu.edu/resolver/1840.16/3725.
Council of Science Editors:
Marten AL. Essays on the Application and Computation of Real Options. [Doctoral Dissertation]. North Carolina State University; 2009. Available from: http://www.lib.ncsu.edu/resolver/1840.16/3725

University of Toronto
23.
Rubisov, Anton.
Statistical Arbitrage Using Limit Order Book Imbalance.
Degree: 2015, University of Toronto
URL: http://hdl.handle.net/1807/70567
► This dissertation demonstrates that there is high revenue potential in using limit order book imbalance as a state variable in an algorithmic trading strategy. Beginning…
(more)
▼ This dissertation demonstrates that there is high revenue potential in using limit order book imbalance as a state variable in an algorithmic trading strategy. Beginning with the hypothesis that imbalance of bid/ask order volumes is an indicator for future price changes, exploratory data analysis suggests that modelling the joint distribution of imbalance and observed price changes as a continuous-time Markov chain presents a monetizable opportunity. The arbitrage problem is then formalized mathematically as a stochastic optimal control problem using limit orders and market orders with the aim of maximizing terminal wealth. The problem is solved in both continuous and discrete time using the dynamic programming principle, which produces both conditions for market order execution, as well as limit order posting depths, as functions of time, inventory, and imbalance. The optimal controls are calibrated and backtested on historical NASDAQ ITCH data, which produces consistent and substantial revenue.
M.A.S.
Advisors/Committee Members: D'Eleuterio, Gabriele M.T., Jaimungal, Sebastian, Aerospace Science and Engineering.
Subjects/Keywords: dynamic programming; limit order book; statistical arbitrage; stochastic optimal control; 0508
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Rubisov, A. (2015). Statistical Arbitrage Using Limit Order Book Imbalance. (Masters Thesis). University of Toronto. Retrieved from http://hdl.handle.net/1807/70567
Chicago Manual of Style (16th Edition):
Rubisov, Anton. “Statistical Arbitrage Using Limit Order Book Imbalance.” 2015. Masters Thesis, University of Toronto. Accessed March 04, 2021.
http://hdl.handle.net/1807/70567.
MLA Handbook (7th Edition):
Rubisov, Anton. “Statistical Arbitrage Using Limit Order Book Imbalance.” 2015. Web. 04 Mar 2021.
Vancouver:
Rubisov A. Statistical Arbitrage Using Limit Order Book Imbalance. [Internet] [Masters thesis]. University of Toronto; 2015. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/1807/70567.
Council of Science Editors:
Rubisov A. Statistical Arbitrage Using Limit Order Book Imbalance. [Masters Thesis]. University of Toronto; 2015. Available from: http://hdl.handle.net/1807/70567

Wayne State University
24.
Nguyen, Nhat Do Minh.
On A Multi-Dimensional Singular Stochastic Control Problem: The Parabolic Case.
Degree: PhD, Mathematics, 2015, Wayne State University
URL: https://digitalcommons.wayne.edu/oa_dissertations/1379
► This dissertation considers a stochastic dynamic system which is governed by a multidimensional diffusion process with time dependent coefficients. The control acts additively on…
(more)
▼ This dissertation considers a
stochastic dynamic system which is governed by a multidimensional diffusion process with time dependent coefficients. The
control acts additively on the state of the system. The objective is to minimize the expected cumulative cost associated with the position of the system and the amount of
control exerted. It is proved that Hamilton-Jacobi-Bellman’s equation of the problem has a solution, which corresponds to the
optimal cost of the problem. We also investigate the smoothness of the free boundary arising from the problem.
In the second part of the dissertation, we study the backward parabolic problem for a nonlinear parabolic equation of the form u
t + Au(t) = f (t, u(t)), u(T ) = ϕ, where A is a positive self-adjoint unbounded operator and f is a Lipschitz function. The problem is ill-posed, in the sense that if the solution does exist, it will not depend continuously on the data. To regularize the problem, we use the quasi-reversibility method to establish a modified problem. We present approximated solutions that depend on a small parameter ε > 0 and give error estimates for our regularization. These
results extend some work on the nonlinear backward problem. Some numerical examples are given to justify the theoretical analysis.
Advisors/Committee Members: Jose L. Menaldi.
Subjects/Keywords: dynamic programming; free boundary; optimal stochastic control; Mathematics
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Nguyen, N. D. M. (2015). On A Multi-Dimensional Singular Stochastic Control Problem: The Parabolic Case. (Doctoral Dissertation). Wayne State University. Retrieved from https://digitalcommons.wayne.edu/oa_dissertations/1379
Chicago Manual of Style (16th Edition):
Nguyen, Nhat Do Minh. “On A Multi-Dimensional Singular Stochastic Control Problem: The Parabolic Case.” 2015. Doctoral Dissertation, Wayne State University. Accessed March 04, 2021.
https://digitalcommons.wayne.edu/oa_dissertations/1379.
MLA Handbook (7th Edition):
Nguyen, Nhat Do Minh. “On A Multi-Dimensional Singular Stochastic Control Problem: The Parabolic Case.” 2015. Web. 04 Mar 2021.
Vancouver:
Nguyen NDM. On A Multi-Dimensional Singular Stochastic Control Problem: The Parabolic Case. [Internet] [Doctoral dissertation]. Wayne State University; 2015. [cited 2021 Mar 04].
Available from: https://digitalcommons.wayne.edu/oa_dissertations/1379.
Council of Science Editors:
Nguyen NDM. On A Multi-Dimensional Singular Stochastic Control Problem: The Parabolic Case. [Doctoral Dissertation]. Wayne State University; 2015. Available from: https://digitalcommons.wayne.edu/oa_dissertations/1379

Universidade Nova
25.
Valacchi, Giulia.
An intertemporal pricing model for CO2 allowances: The impact of the clean development mechanism.
Degree: 2013, Universidade Nova
URL: http://www.rcaap.pt/detail.jsp?id=oai:run.unl.pt:10362/11603
► A Work Project, presented as part of the requirements for the Award of a Masters Degree in Finance from the NOVA – School of Business…
(more)
▼ A Work Project, presented as part of the requirements for the Award of a Masters Degree in Finance from the NOVA – School of Business and Economics
The increasing global attention to greenhouse emissions and the recent creation of EU Emission Trading Scheme has clearly suggested the need of consistent methods to value projects aimed to reduce gases. This need particularly concerns companies that have to find a way to both remain profitable and conform to new legal requirements. Multiple ways of cutting emission costs are available nowadays: short term abatement measures, which primary involve switching production machinery from coal to gas; long term abatement measures, which envisage the implementation of new types of projects .e.g Clean Development Mechanism or Joint Implementation Mechanism suggested by Kyoto Protocol -. In this work we study the impact of the introduction of both kinds of policy in a pricing model for CO2 allowances.
Advisors/Committee Members: Georgiev, Iliyan.
Subjects/Keywords: CO2 emission certificates; EU-ETS system; CDM projects; Stochastic optimal control
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Valacchi, G. (2013). An intertemporal pricing model for CO2 allowances: The impact of the clean development mechanism. (Thesis). Universidade Nova. Retrieved from http://www.rcaap.pt/detail.jsp?id=oai:run.unl.pt:10362/11603
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Chicago Manual of Style (16th Edition):
Valacchi, Giulia. “An intertemporal pricing model for CO2 allowances: The impact of the clean development mechanism.” 2013. Thesis, Universidade Nova. Accessed March 04, 2021.
http://www.rcaap.pt/detail.jsp?id=oai:run.unl.pt:10362/11603.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
MLA Handbook (7th Edition):
Valacchi, Giulia. “An intertemporal pricing model for CO2 allowances: The impact of the clean development mechanism.” 2013. Web. 04 Mar 2021.
Vancouver:
Valacchi G. An intertemporal pricing model for CO2 allowances: The impact of the clean development mechanism. [Internet] [Thesis]. Universidade Nova; 2013. [cited 2021 Mar 04].
Available from: http://www.rcaap.pt/detail.jsp?id=oai:run.unl.pt:10362/11603.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Council of Science Editors:
Valacchi G. An intertemporal pricing model for CO2 allowances: The impact of the clean development mechanism. [Thesis]. Universidade Nova; 2013. Available from: http://www.rcaap.pt/detail.jsp?id=oai:run.unl.pt:10362/11603
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation

Texas A&M University
26.
Parunandi, Karthikeya Sharma.
Perturbation Feedback Approaches in Stochastic Optimal Control: Applications to Model-Based and Model-Free Problems in Robotics.
Degree: MS, Aerospace Engineering, 2019, Texas A&M University
URL: http://hdl.handle.net/1969.1/188787
► Decision making under uncertainty is an important problem in engineering that is traditionally approached differently in each of the Stochastic optimal control, Reinforcement learning and…
(more)
▼ Decision making under uncertainty is an important problem in engineering that is traditionally approached differently in each of the
Stochastic optimal control, Reinforcement learning and Motion planning disciplines. One prominent challenge that is common to all is the ‘curse of dimensionality’ i.e, the complexity of the problem scaling exponentially as the state dimension increases. As a consequence, traditional
stochastic optimal control methods that attempt to obtain an
optimal feedback policy for nonlinear systems are computationally intractable. This thesis explores the application of a near-
optimal decoupling principle to obtain tractable solutions in both model-based and model-free problems in robotics. The thesis begins with the derivation of a near-
optimal decoupling principle between the open loop plan and the closed loop linear feedback gains, based on the analysis performed with the second-order expansion of the cost-to-go function. This leads to a deterministic perturbation feedback
control based solution to fully observable
stochastic optimal control problems. Basing on this idea of near-
optimal decoupling, a model-based trajectory optimization algorithm called the ‘Trajectory-optimized Perturbation Feedback Controller’ (T-PFC) is proposed. Rather than aiming to solve for the general
optimal policy, this algorithm solves for an open-loop trajectory first, followed by the feedback that is automatically entailed by the algorithm from the open-loop plan. The performance is compared against a set of baselines in several difficult robotic planning and
control examples that show near identical performance to non-linear model predictive
control (NMPC) while requiring much lesser computational effort. Next, we turn on to the investigation of the model-free version of the problem, where a policy is learnt from the data, without incorporating system’s theoretical model. We present a novel decoupled data-based
control (D2C) algorithm that addresses this problem using a decoupled ‘open loop - closed loop’ approach. First, an open-loop deterministic trajectory optimization problem is solved using a black-box simulation model of the dynamical system.
Then, a closed loop
control is developed around this open loop trajectory by linearization of the dynamics about this nominal trajectory. By virtue of linearization, a linear quadratic regulator based algorithm is used for the demonstration of the closed loop
control. Simulation performance suggests a significant reduction in training time compared to other state of the art reinforcement learning algorithms. Finally, an alternative method for solving the open-loop trajectory in D2C is presented (called as ‘D2C-2.0’). Stemming from the idea of model-based ‘Differential Dynamic Programming’ (DDP), it possesses second-order convergence property (under certain assumptions) and hence is significantly faster to compute the solution than the original D2C algorithm. An efficient way of sampling from the environment to convert it to a model-free algorithm, along with the…
Advisors/Committee Members: Chakravorty, Suman (advisor), Kalathil, Dileep (advisor), Shell, Dylan (committee member), Majji, Manoranjan (committee member).
Subjects/Keywords: Reinforcement Learning; Stochastic Optimal Control; Motion Planning; Trajectory Optimization; Robotics
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Parunandi, K. S. (2019). Perturbation Feedback Approaches in Stochastic Optimal Control: Applications to Model-Based and Model-Free Problems in Robotics. (Masters Thesis). Texas A&M University. Retrieved from http://hdl.handle.net/1969.1/188787
Chicago Manual of Style (16th Edition):
Parunandi, Karthikeya Sharma. “Perturbation Feedback Approaches in Stochastic Optimal Control: Applications to Model-Based and Model-Free Problems in Robotics.” 2019. Masters Thesis, Texas A&M University. Accessed March 04, 2021.
http://hdl.handle.net/1969.1/188787.
MLA Handbook (7th Edition):
Parunandi, Karthikeya Sharma. “Perturbation Feedback Approaches in Stochastic Optimal Control: Applications to Model-Based and Model-Free Problems in Robotics.” 2019. Web. 04 Mar 2021.
Vancouver:
Parunandi KS. Perturbation Feedback Approaches in Stochastic Optimal Control: Applications to Model-Based and Model-Free Problems in Robotics. [Internet] [Masters thesis]. Texas A&M University; 2019. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/1969.1/188787.
Council of Science Editors:
Parunandi KS. Perturbation Feedback Approaches in Stochastic Optimal Control: Applications to Model-Based and Model-Free Problems in Robotics. [Masters Thesis]. Texas A&M University; 2019. Available from: http://hdl.handle.net/1969.1/188787

University of the Western Cape
27.
Adebiyi, Ayodeji O.
Mathematical modeling of the population dynamics of tuberculosis
.
Degree: 2016, University of the Western Cape
URL: http://hdl.handle.net/11394/4928
► Tuberculosis (TB) is currently one of the major public health challenges in South Africa, and in many countries. Mycobacterium tuberculosis is among the leading causes…
(more)
▼ Tuberculosis (TB) is currently one of the major public health challenges in South Africa, and in many countries. Mycobacterium tuberculosis is among the leading causes of morbidity and mortality. It is known that tuberculosis is a curable infectious disease. In the case of incomplete treatment, however, the remains of Mycobacterium tuberculosis in the human system often results in the bacterium developing resistance to antibiotics. This leads to relapse and treatment against the resistant bacterium is extremely expensive and difficult. The aim of this work is to present and analyse mathematical models of the population dynamics of tuberculosis for the purpose of studying the effects of efficient treatment versus incomplete treatment. We analyse the spread, asymptotic behavior and possible eradication of the disease, versus persistence of tuberculosis. In particular, we
consider inflow of infectives into the population, and we study the effects of screening. A sub-model will be studied to analyse the transmission dynamics of TB in an isolated population. The full model will take care of the inflow of susceptibles as well as inflow of TB infectives into the population. This dissertation enriches the existing literature with contributions in the form of
optimal control and
stochastic perturbation. We also show how
stochastic perturbation can improve the stability of an equilibrium point. Our methods include Lyapunov functions,
optimal control and
stochastic differential equations. In the stability analysis of the DFE we show how backward bifurcation appears. Various phenomena are illustrated by way of simulations.
Advisors/Committee Members: Witbooi, Peter J (advisor).
Subjects/Keywords: Tuberculosis;
Backward bifurcation;
Stochastic asymptotic stability;
Optimal control
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Adebiyi, A. O. (2016). Mathematical modeling of the population dynamics of tuberculosis
. (Thesis). University of the Western Cape. Retrieved from http://hdl.handle.net/11394/4928
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Chicago Manual of Style (16th Edition):
Adebiyi, Ayodeji O. “Mathematical modeling of the population dynamics of tuberculosis
.” 2016. Thesis, University of the Western Cape. Accessed March 04, 2021.
http://hdl.handle.net/11394/4928.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
MLA Handbook (7th Edition):
Adebiyi, Ayodeji O. “Mathematical modeling of the population dynamics of tuberculosis
.” 2016. Web. 04 Mar 2021.
Vancouver:
Adebiyi AO. Mathematical modeling of the population dynamics of tuberculosis
. [Internet] [Thesis]. University of the Western Cape; 2016. [cited 2021 Mar 04].
Available from: http://hdl.handle.net/11394/4928.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Council of Science Editors:
Adebiyi AO. Mathematical modeling of the population dynamics of tuberculosis
. [Thesis]. University of the Western Cape; 2016. Available from: http://hdl.handle.net/11394/4928
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation

Technical University of Lisbon
28.
Barros, Gilson Lopes Barbosa.
Problemas de consumo e investimento em mercados financeiros.
Degree: 2014, Technical University of Lisbon
URL: http://www.rcaap.pt/detail.jsp?id=oai:www.repository.utl.pt:10400.5/7413
► Mestrado em Matemática Financeira
Um agente económico pretende decidir de que forma alocar a sua riqueza no que diz respeito ao seu nível de consumo…
(more)
▼ Mestrado em Matemática Financeira
Um agente económico pretende decidir de que forma alocar a sua riqueza no que diz respeito ao seu nível de consumo e ao investimento num mercado financeiro subjacente de forma a maximizar a sua utilidade esperada, derivada do consumo instantâneo ao longo de um dado intervalo de tempo e da sua riqueza no instante final desse intervalo. Assumimos que o mercado financeiro é composto por um activo sem risco e um activo com risco, com a particularidade da evolução temporal do activo com risco ser dada por uma equação diferencial estocástica com coeficientes com reversão à média. Este é um problema de controlo óptimo estocástico, que vai ser estudado com recurso a técnicas de programação dinâmica. O objectivo final deste trabalho é determinar as estratégias de consumo e investimento óptimas e compará-las com as estratégias clássicas do problema de consumo e investimento de Merton.
An economic agent is faced with the problem of deciding how to allocate her wealth among consumption and investment in an underlying financial market, in order to maximize the expected utility derived from the instantaneous consumption over a given time interval and her wealth at the final horizon. We assume that the financial market under consideration consists of a riskless asset and a risky asset, the latter having the special feature that its temporal evolution is given by a stochastic differential equation with mean reversion coefficients. Dynamic programming techniques will be employed to solve this Stochastic Optimal Control problem with the goal of finding the optimal strategies for consumption and investment and compare it with Merton's optimal strategies.
Advisors/Committee Members: Pinheiro, Diogo Araújo.
Subjects/Keywords: Controlo óptimo estocástico; consumo-investimento óptimo; programação dinâmica; volatilidade estocástica; Stochastic optimal control; optimal consumption-investment; dynamic programming; stochastic volatility
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Barros, G. L. B. (2014). Problemas de consumo e investimento em mercados financeiros. (Thesis). Technical University of Lisbon. Retrieved from http://www.rcaap.pt/detail.jsp?id=oai:www.repository.utl.pt:10400.5/7413
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Chicago Manual of Style (16th Edition):
Barros, Gilson Lopes Barbosa. “Problemas de consumo e investimento em mercados financeiros.” 2014. Thesis, Technical University of Lisbon. Accessed March 04, 2021.
http://www.rcaap.pt/detail.jsp?id=oai:www.repository.utl.pt:10400.5/7413.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
MLA Handbook (7th Edition):
Barros, Gilson Lopes Barbosa. “Problemas de consumo e investimento em mercados financeiros.” 2014. Web. 04 Mar 2021.
Vancouver:
Barros GLB. Problemas de consumo e investimento em mercados financeiros. [Internet] [Thesis]. Technical University of Lisbon; 2014. [cited 2021 Mar 04].
Available from: http://www.rcaap.pt/detail.jsp?id=oai:www.repository.utl.pt:10400.5/7413.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Council of Science Editors:
Barros GLB. Problemas de consumo e investimento em mercados financeiros. [Thesis]. Technical University of Lisbon; 2014. Available from: http://www.rcaap.pt/detail.jsp?id=oai:www.repository.utl.pt:10400.5/7413
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation

University of Oxford
29.
Fleming, James.
Robust and stochastic MPC of uncertain-parameter systems.
Degree: PhD, 2016, University of Oxford
URL: https://ora.ox.ac.uk/objects/uuid:c19ff07c-0756-45f6-977b-9d54a5214310
;
https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.730224
► Constraint handling is difficult in model predictive control (MPC) of linear differential inclusions (LDIs) and linear parameter varying (LPV) systems. The designer is faced with…
(more)
▼ Constraint handling is difficult in model predictive control (MPC) of linear differential inclusions (LDIs) and linear parameter varying (LPV) systems. The designer is faced with a choice of using conservative bounds that may give poor performance, or accurate ones that require heavy online computation. This thesis presents a framework to achieve a more flexible trade-off between these two extremes by using a state tube, a sequence of parametrised polyhedra that is guaranteed to contain the future state. To define controllers using a tube, one must ensure that the polyhedra are a sub-set of the region defined by constraints. Necessary and sufficient conditions for these subset relations follow from duality theory, and it is possible to apply these conditions to constrain predicted system states and inputs with only a little conservatism. This leads to a general method of MPC design for uncertain-parameter systems. The resulting controllers have strong theoretical properties, can be implemented using standard algorithms and outperform existing techniques. Crucially, the online optimisation used in the controller is a convex problem with a number of constraints and variables that increases only linearly with the length of the prediction horizon. This holds true for both LDI and LPV systems. For the latter it is possible to optimise over a class of gain-scheduled control policies to improve performance, with a similar linear increase in problem size. The framework extends to stochastic LDIs with chance constraints, for which there are efficient suboptimal methods using online sampling. Sample approximations of chance constraint-admissible sets are generally not positively invariant, which motivates the novel concept of âsample-admissible' sets with this property to ensure recursive feasibility when using sampling methods. The thesis concludes by introducing a simple, convex alternative to chance-constrained MPC that applies a robust bound to the time average of constraint violations in closed-loop.
Subjects/Keywords: 629.8; Convex Optimization; Stochastic Control; Chance Constrained Programming; Robust Control; Model Predictive Control; Optimal Control; Control; Receding-horizon; Optimal; Convex; Robust; Stochastic; Optimisation; MPC; Tube MPC; Constraints
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Fleming, J. (2016). Robust and stochastic MPC of uncertain-parameter systems. (Doctoral Dissertation). University of Oxford. Retrieved from https://ora.ox.ac.uk/objects/uuid:c19ff07c-0756-45f6-977b-9d54a5214310 ; https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.730224
Chicago Manual of Style (16th Edition):
Fleming, James. “Robust and stochastic MPC of uncertain-parameter systems.” 2016. Doctoral Dissertation, University of Oxford. Accessed March 04, 2021.
https://ora.ox.ac.uk/objects/uuid:c19ff07c-0756-45f6-977b-9d54a5214310 ; https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.730224.
MLA Handbook (7th Edition):
Fleming, James. “Robust and stochastic MPC of uncertain-parameter systems.” 2016. Web. 04 Mar 2021.
Vancouver:
Fleming J. Robust and stochastic MPC of uncertain-parameter systems. [Internet] [Doctoral dissertation]. University of Oxford; 2016. [cited 2021 Mar 04].
Available from: https://ora.ox.ac.uk/objects/uuid:c19ff07c-0756-45f6-977b-9d54a5214310 ; https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.730224.
Council of Science Editors:
Fleming J. Robust and stochastic MPC of uncertain-parameter systems. [Doctoral Dissertation]. University of Oxford; 2016. Available from: https://ora.ox.ac.uk/objects/uuid:c19ff07c-0756-45f6-977b-9d54a5214310 ; https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.730224
30.
Li, Liangchen.
Stochastic nonzero-sum duopoly games with economic applications.
Degree: 2019, University of California – eScholarship, University of California
URL: http://www.escholarship.org/uc/item/28x554n4
► We study a class of stochastic duopoly games inspired by the two time-scale feature of many markets. The firms convert their short-term “local” advantage driven…
(more)
▼ We study a class of stochastic duopoly games inspired by the two time-scale feature of many markets. The firms convert their short-term “local” advantage driven by exogenous infinitesimal shocks into a more durable gain through long-term market dominance. As an extension of existing literature, we consider two asymmetric players each of whom adopts timing strategies to increase her profitability and possibly bring negative externality to the rival. In turn, this leads us to more general settings of nonzero-sum games. Characterizing Nash equilibrium as a fixed-point of each player’s best-response to her rival, we construct threshold-type Feedback Nash Equilibrium via best response iteration. Our main contribution is explicitly constructing equilibria for types of duopoly games that represent a wide range of industries. Motivated by the competition among sectors of power generators, we consider a duopoly of producers with finite options to increase their production capacity. We study nonzero-sum games in which two players compete for market dominance via switching controls. We also study mixed switching and impulses games inspired by the vertical competition among the producers and consumers of a commodity. Our analysis quantifies the dynamic competition effects and brings economic insights.
Subjects/Keywords: Applied mathematics; Operations research; Economics; dynamic duopoly; nonzero-sum stochastic game; optimal stochastic control; optimal stopping; special type of equilibria; stochastic impulse control
Record Details
Similar Records
Cite
Share »
Record Details
Similar Records
Cite
« Share





❌
APA ·
Chicago ·
MLA ·
Vancouver ·
CSE |
Export
to Zotero / EndNote / Reference
Manager
APA (6th Edition):
Li, L. (2019). Stochastic nonzero-sum duopoly games with economic applications. (Thesis). University of California – eScholarship, University of California. Retrieved from http://www.escholarship.org/uc/item/28x554n4
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Chicago Manual of Style (16th Edition):
Li, Liangchen. “Stochastic nonzero-sum duopoly games with economic applications.” 2019. Thesis, University of California – eScholarship, University of California. Accessed March 04, 2021.
http://www.escholarship.org/uc/item/28x554n4.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
MLA Handbook (7th Edition):
Li, Liangchen. “Stochastic nonzero-sum duopoly games with economic applications.” 2019. Web. 04 Mar 2021.
Vancouver:
Li L. Stochastic nonzero-sum duopoly games with economic applications. [Internet] [Thesis]. University of California – eScholarship, University of California; 2019. [cited 2021 Mar 04].
Available from: http://www.escholarship.org/uc/item/28x554n4.
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
Council of Science Editors:
Li L. Stochastic nonzero-sum duopoly games with economic applications. [Thesis]. University of California – eScholarship, University of California; 2019. Available from: http://www.escholarship.org/uc/item/28x554n4
Note: this citation may be lacking information needed for this citation format:
Not specified: Masters Thesis or Doctoral Dissertation
◁ [1] [2] [3] [4] [5] [6] ▶
.