Applied Markov Chains

Discrete-Time Markov Chains: Two-Time-Scale Methods and Applications  eBooks & eLearning

Posted by step778 at Feb. 14, 2017
Discrete-Time Markov Chains: Two-Time-Scale Methods and Applications

George Yin, Qing Zhang, "Discrete-Time Markov Chains: Two-Time-Scale Methods and Applications"
2004 | pages: 354 | ISBN: 038721948X | PDF | 2,2 mb
Discrete Probability Models and Methods: Probability on Graphs and Trees, Markov Chains and Random Fields, Entropy and Coding

Discrete Probability Models and Methods: Probability on Graphs and Trees, Markov Chains and Random Fields, Entropy and Coding (Probability Theory and Stochastic Modelling) by Pierre Brémaud
English | 16 Feb. 2017 | ISBN: 3319434756 | 559 Pages | PDF | 5.31 MB

The emphasis in this book is placed on general models (Markov chains, random fields, random graphs), universal methods (the probabilistic method, the coupling method, the Stein-Chen method, martingale methods, the method of types) and versatile tools (Chernoff's bound, Hoeffding's inequality, Holley's inequality) whose domain of application extends first chapters give in considerable detail the background necessary to understand the rest of the book.

Markov Processes and Controlled Markov Chains  eBooks & eLearning

Posted by step778 at Nov. 8, 2016
Markov Processes and Controlled Markov Chains

Zhenting Hou, Jerzy A. Filar, Anyue Chen, "Markov Processes and Controlled Markov Chains"
2002 | pages: 501 | ISBN: 1461379687 | PDF | 11,5 mb

Markov Chains and Stochastic Stability  eBooks & eLearning

Posted by tanas.olesya at Oct. 28, 2016
Markov Chains and Stochastic Stability

Markov Chains and Stochastic Stability (Cambridge Mathematical Library) by Sean Meyn
English | 2 Apr. 2009 | ISBN: 0521731828 | 624 Pages | PDF | 7 MB

The pursuit of more efficient simulation algorithms for complex Markovian models, or algorithms for computation of optimal policies for controlled Markov models, has opened new directions for research on Markov chains.

Markov Chains and Stochastic Stability  eBooks & eLearning

Posted by step778 at Aug. 25, 2016
Markov Chains and Stochastic Stability

Sean P. Meyn, Richard L. Tweedie, "Markov Chains and Stochastic Stability"
1993 | pages: 557 | ISBN: 1447132696 | DJVU | 5,5 mb
Finite Markov Chains: With a New Appendix "Generalization of a Fundamental Matrix" (Repost)

John G. Kemeny, J. Laurie Snell, "Finite Markov Chains: With a New Appendix "Generalization of a Fundamental Matrix""
1983 | pages: 232 | ISBN: 0387901922 | PDF | 54,4 mb

Understanding Markov Chains: Examples and Applications  eBooks & eLearning

Posted by ksveta6 at March 30, 2016
Understanding Markov Chains: Examples and Applications

Understanding Markov Chains: Examples and Applications (Springer Undergraduate Mathematics Series) by Nicolas Privault
2013 | ISBN: 9814451509 | English | 354 pages | EPUB | 4 MB

Markov Chains and Decision Processes for Engineers and Managers (repost)  eBooks & eLearning

Posted by roxul at Jan. 23, 2016
Markov Chains and Decision Processes for Engineers and Managers (repost)

Theodore J. Sheskin, "Markov Chains and Decision Processes for Engineers and Managers"
2010 | ISBN-10: 1420051113 | 492 pages | PDF | 5 MB

Queuing Networks and Markov Chains [Repost]  eBooks & eLearning

Posted by tanas.olesya at Jan. 14, 2016
Queuing Networks and Markov Chains [Repost]

Queuing Networks and Markov Chains: Modeling and Performance Evaluation with Computer Science Applications by Gunter Bolch
English | 12 Oct. 1998 | ISBN: 0471193666 | 744 Pages | PDF | 51 MB

Queueing Networks and Markov Chains provides comprehensive coverage of the theory and application of computer performance evaluation based on queueing networks and Markov chains. Progressing from basic concepts to more complex topics, this book offers a clear and concise treatment of the state of the art in this important field.
Probability and Statistics by Example: Volume 2, Markov Chains: A Primer in Random Processes and their Applications

Probability and Statistics by Example: Volume 2, Markov Chains: A Primer in Random Processes and their Applications
by Yuri Suhov, Mark Kelbert
English | 2008 | ISBN: 0521847672 | 498 pages | PDF | 2.24 MB