Average customer rating:
|
Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley Series in Probability and Statistics)
Martin L. Puterman Manufacturer: Wiley-Interscience ProductGroup: Book Binding: Paperback Similar Items:
ASIN: 0471727822 |
Book Description
The Wiley-Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists.Customer Reviews:
Excellent and detailed, although focusing on exact algorithms only.......2007-06-04
Average customer rating:
|
Numerical Solution of Stochastic Differential Equations (Stochastic Modelling and Applied Probability)
Peter E. Kloeden , and Eckhard Platen Manufacturer: Springer ProductGroup: Book Binding: Hardcover Similar Items:
ASIN: 3540540628 |
Book Description
The numerical analysis of stochastic differential equations differs significantly from that of ordinary differential equations, due to the peculiarities of stochastic calculus. The book proposes to the reader whose background knowledge is limited to undergraduate level methods for engineering and physics, and easily accessible introductions to SDE and then applications as well as the numerical methods for dealing with them. To help the reader develop an intuitive understanding and hand-on numerical skills, numerous exercises including PC-exercises are included.Customer Reviews:
Excellent.......2002-04-10
As preparation for the study of SDEs, the authors detail some preliminary background on probability, statistics, and stochastic processes in Part 1 of the book. Particularly well-written is the discussion on random number generators and efficient methods for generating random numbers, such as the Box-Muller and Polar Marsaglia methods. Both discrete and continuous Markov processes are discussed, and the authors review the connection between Weiner processes (Brownian motion for the physicist reader) and white noise. The measure-theory foundations of the subject are outlined briefly for the interested reader.
Part 2 begins naturally with an overview of stochastic calculus, with the Ito calculus chosen to show how to generalize ordinary calculus to the stochastic realm. The authors motivate the subject as one in which the functional form of stochastic processes was emphasized, with Ito attempting to find out just when local properties such as the drift and diffusion coefficients can characterize the stochastic process. The Ito formula is shown to be a generalization of the chain rule of ordinary calculus to the case where stochasticity is present. The authors are also careful to distinguish between "random" differential equations and "stochastic" differential equations. The former can be solved by integrating over differentiable sample paths, but in the latter one has to face the nondifferentiability of the sample paths, and hence solutions are more difficult to obtain. The authors give many examples of SDEs that can be solved explicitly, and prove existence and uniqueness theorems for strong solutions of the SDEs. And since ordinary differential equations are usually tackled by Taylor series expansions, it is perhaps not surprising that this technique would be generalized to SDEs, which the authors do in detail in this part. They also outline the differences between the Ito and Stratonovich interpretations of stochastic integrals and SDEs.
Part 3 is definitely of great interest to those who must develop mathematical models using SDEs. The authors carefully outline the reasons where Ito versus the Stratonovich formulations are used, this being largely dependent on the degree of autocorrelation in the processes at hand. The Stratonovich SDE is recommended for cases when the white noise is used as an idealization of a (smooth) real noise process. The authors also show how to approximate Markov chain problems with diffusion processes, which are the solutions of Ito SDEs. Several very interesting examples are given of the applications of stochastic differential equations; the particular ones of direct interest to me were the ones on population dynamics, protein kinetics, and genetics; option pricing, and blood clotting dynamics/cellular energetics.
After a review of discrete time approzimations in ordinary deterministic differential equations, in part 4 the authors show to solve SDEs using this approximation. The familiar Euler approximation is considered, with a simple example having an explicit solution compared with its Euler approximate solution. They also show how to use simulations when an explicit solution is lacking. The importance notions of strong and weak convergence of the approximate solutions are discussed in detail. Strong convergence is basically a convergence in norm (absolute value), while weak convergence is taken with respect to a collection of test functions. Both of these types of convergence reduce to the ordinary deterministic sense of convergence when the random elements are removed.
The discussion of convergence in part 4 leads to a very extensive discussion of strongly convergent approximations in part 5, and weakly convergent approximations in part 6. Stochastic Taylor expansions done with respect to the strong convergence criterion are discussed, beginning with the Euler approximation. More complicated strongly convergent stochastic approximation schemes are also considered, such as the Milstein scheme, which reduces to the Euler scheme when the diffusion coefficients only depend on time. The strong Taylor schemes of all orders are treated in detail. Since Taylor approximations make evaluations of the derivatives necessary, which is computational intensive, the authors discuss strong approximation schemes that do not require this, much like the Runge-Kutta methods in the deterministic case , but the authors are careful to point out that the Runge-Kutta analogy is problematic in the stochastic case. Several of these "derivative-free" schemes are considered by the authors. The authors also consider implicit strong approximation schemes for stiff SDEs, wherein numerical instabilities are problematic. Interesting applications are given for strong approximations for SDEs, such as the Duffing-Van der Pol oscillator, which is very important system in engineering mechanics and phyics, and has been subjected to an incredible amount of research.
More detailed consideration of weak Taylor approximations is given in part 6. The Euler scheme is examined first in the weak approximation, with the higher-order schemes following. Since weak convergence is more stringent than strong convergence, it should come as no surprise that fewer terms are required to obtain convergence, as compared with strong convergence at the same order. This intuition is indeed verified in the discussion, and the authors treat both explicit and implicit weak approximations, along with extrapolation and predictor-corrector methods. And most importantly, the authors give an introduction to the Girsanov methods for variance reduction of weak approximations to Ito diffusions, along with other techniques for doing the same. Those readers involved in constructive quantum field theory will value the treatment on using weak approximations to calculate functional integrals. The approximation of Lyapunov exponents for stochastic dynamical systems is also treated, along with the approximation of invariant measures.
Average customer rating:
|
Randomized Algorithms
Rajeev Motwani , and Prabhakar Raghavan Manufacturer: Cambridge University Press ProductGroup: Book Binding: Hardcover Similar Items:
ASIN: 0521474655 |
Book Description
For many applications, a randomized algorithm is either the simplest or the fastest algorithm available, and sometimes both. This book introduces the basic concepts in the design and analysis of randomized algorithms. The first part of the text presents basic tools such as probability theory and probabilistic analysis that are frequently used in algorithmic applications. Algorithmic examples are also given to illustrate the use of each tool in a concrete setting. In the second part of the book, each chapter focuses on an important area to which randomized algorithms can be applied, providing a comprehensive and representative selection of the algorithms that might be used in each of these areas. Although written primarily as a text for advanced undergraduates and graduate students, this book should also prove invaluable as a reference for professionals and researchers.Customer Reviews:
Book that didn't meet my expectations.......2006-09-18
More work should be done in proofs.......2004-11-02
A subtle introduction to probablistic algoritms.......2002-01-14
An enciclopedia for randomized algorithms........2001-07-21
extremely informative but obscure.......1999-10-16
Average customer rating:
|
Stochastic Finance: An Introduction In Discrete Time 2 (De Gruyter Studies in Mathematics)
Hans Follmer , and Alexander Schied Manufacturer: Walter de Gruyter ProductGroup: Book Binding: Hardcover Similar Items:
ASIN: 3110183463 |
Book Description
This book is an introduction to financial mathematics for mathematicians. It is intended both for graduate students with a certain background in probability theory as well as for professional mathematicians in industry and academia. In contrast to many textbooks on mathematical finance, only discrete-time stochastic models are considered. This setting has the advantage that the text can concentrate from the beginning on typical problems which are suggested by financial applications. Moreover, certain principles, such as the general incompleteness of realistic market models, become thus more transparent and visible. On the other hand, all models are based on general probability spaces, and so the text captures the interplay between probability theory and functional analysis which is typical for modern mathematical finance.The first part of the book contains a study of financial investments in a static one-period market model. Here, an investor faces intrinsic risk and uncertainty, which cannot be hedged away. The tools presented to deal with this situation range from the classical theory of expected utility until the more recent development of measures of risk.
In the second part of the book, the idea of dynamic hedging and arbitrage-free pricing of contingent claims is developed in a multi-period framework. Such market models are typically incomplete, and particular focus is given to
methods combining the dynamic hedging of a risky position with the tools of assessing risk and uncertainty as presented in part.
Contents: Mathematical finance in one period: Arbitrage theory. Expected utility. Optimal investments. Measures of risk Dynamic Arbitrage Theory: Dynamic hedging of contingent claims. American contingent claims. Optional decomposition and super-hedging. Efficient hedging in incomplete markets. Minimizing the hedging error. Hedging under constraints References. Index
Customer Reviews:
Excellent book on mathematical finance.......2004-04-20
A word of caution: Though the text restricts itself to the "simpler" discrete-time case, thus avoiding stochastic integration, it nevertheless demands a solid background in analysis, including graduate level probability theory and functional analysis. Though not technically a requirement, some background in mathematical finance is necessary in order to understand what this book is about.
In conclusion, therefore, don't make this your first book on mathematical finance -- get Bingham&Kiesel instead. But if you have the mathematical background, and are analytically inclined, do buy it. This book is a phenomenal achievement.
Average customer rating:
|
Discrete Stochastic Processes (The International Series in Engineering and Computer Science)
Robert G. Gallager Manufacturer: Springer ProductGroup: Book Binding: Hardcover Similar Items:
Accessories:
ASIN: 0792395832 |
Book Description
Stochastic processes are found in probabilistic systems that evolve with time. Discrete stochastic processes change by only integer time steps (for some time scale), or are characterized by discrete occurrences at arbitrary times. Discrete Stochastic Processes helps the reader develop the understanding and intuition necessary to apply stochastic process theory in engineering, science and operations research. The book approaches the subject via many simple examples which build insight into the structure of stochastic processes and the general effect of these phenomena in real systems. The book presents mathematical ideas without recourse to measure theory, using only minimal mathematical analysis. In the proofs and explanations, clarity is favored over formal rigor, and simplicity over generality. Numerous examples are given to show how results fail to hold when all the conditions are not satisfied. Audience: An excellent textbook for a graduate level course in engineering and operations research. Also an invaluable reference for all those requiring a deeper understanding of the subject.Customer Reviews:
Terrific Text, better than going to class.......2007-03-14
Provides excellent intuitive explanations.......2005-12-15
Must have prior knowledge.......2005-11-05
Worth having!.......2003-04-30
Great Book.......1999-10-15
Average customer rating: |
Applications Of Multi-Objective Evolutionary Algorithms (Advances in Natural Computation)
Manufacturer: World Scientific Publishing Company ProductGroup: Book Binding: Hardcover ASIN: 9812561064 |
Book Description
This book presents an extensive variety of multi-objective problems across diverse disciplines, along with statistical solutions using multi-objective evolutionary algorithms (MOEAs). The topics discussed serve to promote a wider understanding as well as the use of MOEAs, the aim being to find good solutions for high-dimensional real-world design applications. The book contains a large collection of MOEA applications from many researchers, and thus provides the practitioner with detailed algorithmic direction to achieve good results in their selected problem domain.
Average customer rating: |
Design and Analysis of Randomized Algorithms: Introduction to Design Paradigms (Texts in Theoretical Computer Science. An EATCS Series)
J. Hromkovic Manufacturer: Springer ProductGroup: Book Binding: Hardcover Similar Items:
Accessories:
ASIN: 3540239499 |
Book Description
Randomness is a powerful phenomenon that can be harnessed to solve various problems in all areas of computer science. Randomized algorithms are often more efficient, simpler and, surprisingly, also more reliable than their deterministic counterparts. Computing tasks exist that require billions of years of computer work when solved using the fastest known deterministic algorithms, but they can be solved using randomized algorithms in a few minutes with negligible error probabilities.
Introducing the fascinating world of randomness, this book systematically teaches the main algorithm design paradigms – foiling an adversary, abundance of witnesses, fingerprinting, amplification, and random sampling, etc. – while also providing a deep insight into the nature of success in randomization. Taking sufficient time to present motivations and to develop the reader's intuition, while being rigorous throughout, this text is a very effective and efficient introduction to this exciting field.
Average customer rating: |
Introduction to the Numerical Solution of Markov Chains
William J. Stewart Manufacturer: Princeton University Press ProductGroup: Book Binding: Hardcover Similar Items:
ASIN: 0691036993 |
Book Description
A cornerstone of applied probability, Markov chains can be used to help model how plants grow, chemicals react, and atoms diffuse--and applications are increasingly being found in such areas as engineering, computer science, economics, and education. To apply the techniques to real problems, however, it is necessary to understand how Markov chains can be solved numerically. In this book, the first to offer a systematic and detailed treatment of the numerical solution of Markov chains, William Stewart provides scientists on many levels with the power to put this theory to use in the actual world, where it has applications in areas as diverse as engineering, economics, and education. His efforts make for essential reading in a rapidly growing field.
Here Stewart explores all aspects of numerically computing solutions of Markov chains, especially when the state is huge. He provides extensive background to both discrete-time and continuous-time Markov chains and examines many different numerical computing methods--direct, single-and multi-vector iterative, and projection methods. More specifically, he considers recursive methods often used when the structure of the Markov chain is upper Hessenberg, iterative aggregation/disaggregation methods that are particularly appropriate when it is NCD (nearly completely decomposable), and reduced schemes for cases in which the chain is periodic. There are chapters on methods for computing transient solutions, on stochastic automata networks, and, finally, on currently available software. Throughout Stewart draws on numerous examples and comparisons among the methods he so thoroughly explains.
Average customer rating: |
Numerical Solution of SDE Through Computer Experiments (Universitext)
Peter Eris Kloeden , Eckhard Platen , and Henri Schurz Manufacturer: Springer ProductGroup: Book Binding: Paperback Similar Items:
ASIN: 3540570748 |
Book Description
The book provides an easily accessible computationally oriented introduction into the numerical solution of stochastic differential equations using computer experiments. It develops in the reader an ability to apply numerical methods solving stochastic differential equations in their own fields. Furthermore, it creates an intuitive understanding of the necessary theoretical background from stochastic and numeric analysis. A downloadable softward containing programs for over 100 problems is provided at each of the following homepages:
http://www.math.uni-frankfurt.de/~numerik/kloeden/
http://www.business.uts.edu.au/finance/staff/eckhard.html
http.//www.math.siu.edu/schurz/SOFTWARE/
to enable the reader to develop an intuitive understanding of the issues involved. Applications include stochastic dynamical systems, filtering, parametric estimation and finance modeling.
The book is intended for readers without specialist stochastic background who want to apply such numerical methods to stochastic differential equations that arise in their own filed.
Average customer rating: |
Maximum Entropy and Bayesian Methods Garching, Germany 1998 (Fundamental Theories of Physics)
Manufacturer: Springer ProductGroup: Book Binding: Hardcover ASIN: 0792357663 |
Book Description
This volume, arising from the 1998 MaxEnt conference, contains a wide range of applications of Bayesian probability theory and maximum entropy methods to problems of concern in such fields as physics, image processing, coding theory, machine learning, economics, data analysis and various other problems. It presents papers by the leading researchers in the field of Bayesian statistics and maximum entropy methods, and represents the latest developments in the field.
Audience: This book will be of interest to researchers in applied statistics, information theory, coding theory, image and signal processing.
Books:
Recommended Books