Applied Probability and Stochastic Processes

1. Front Matter

   Pages i-xii

   PDF

2. Basic Probability Review

   • Richard M. Feldman, Ciriaco Valdez-Flores

   Pages 1-43

3. Basics of Monte Carlo Simulation

   • Richard M. Feldman, Ciriaco Valdez-Flores

   Pages 45-72

4. Basic Statistical Review

   • Richard M. Feldman, Ciriaco Valdez-Flores

   Pages 73-113

5. Poisson Processes

   • Richard M. Feldman, Ciriaco Valdez-Flores

   Pages 115-139

6. Markov Chains

   • Richard M. Feldman, Ciriaco Valdez-Flores

   Pages 141-179

7. Markov Processes

   • Richard M. Feldman, Ciriaco Valdez-Flores

   Pages 181-199

8. Queueing Processes

   • Richard M. Feldman, Ciriaco Valdez-Flores

   Pages 201-225

9. Queueing Networks

   • Richard M. Feldman, Ciriaco Valdez-Flores

   Pages 227-249

10. Event-Driven Simulation and Output Analyses

    • Richard M. Feldman, Ciriaco Valdez-Flores

    Pages 251-284

11. Inventory Theory

    • Richard M. Feldman, Ciriaco Valdez-Flores

    Pages 285-303

12. Replacement Theory

    • Richard M. Feldman, Ciriaco Valdez-Flores

    Pages 305-321

13. Markov Decision Processes

    • Richard M. Feldman, Ciriaco Valdez-Flores

    Pages 323-354

14. Advanced Queues

    • Richard M. Feldman, Ciriaco Valdez-Flores

    Pages 355-379

15. Back Matter

    Pages 1-17

    PDF

This book is a result of teaching stochastic processes to junior and senior undergr- uates and beginning graduate students over many years. In teaching such a course, we have realized a need to furnish students with material that gives a mathematical presentation while at the same time providing proper foundations to allow students to build an intuitive feel for probabilistic reasoning. We have tried to maintain a b- ance in presenting advanced but understandable material that sparks an interest and challenges students, without the discouragement that often comes as a consequence of not understanding the material. Our intent in this text is to develop stochastic p- cesses in an elementary but mathematically precise style and to provide suf?cient examples and homework exercises that will permit students to understand the range of application areas for stochastic processes. We also practice active learning in the classroom. In other words, we believe that the traditional practice of lecturing continuously for 50 to 75 minutes is not a very effective method for teaching. Students should somehow engage in the subject m- ter during the teaching session. One effective method for active learning is, after at most 20 minutes of lecture, to assign a small example problem for the students to work and one important tool that the instructor can utilize is the computer. So- times we are fortunate to lecture students in a classroom containing computers with a spreadsheet program, usually Microsoft’s Excel.

• Inventory Theory
• Markov Chains
• Markov Decicision Processes
• Markov Processes
• Markov chain
• Markov decision process
• Markov process
• Monte Carlo Simulation
• Poisson Processes
• Poisson process
• Queueing Networks
• Queueing Processes
• Replacement Theory
• stochastic process
• Engineering Economics

amazon.con Customer Reviews on 1st edition:

5.0 out of 5 stars It's worth at least six stars!, February 19, 2000
By Lisa Ann Ball (Seattle, WA United States) - See all my reviews

I randomly ran across this book in my math library trying to find an extra book to help with the difficult Stochastics Process class I was taking. Little did I know I would find a book I value as much as Douglas Kelly's Introduction to Probability. This book has applied problems and examples! It is not the dry, endless pages of confusing equations we have come to expect from Stochastics Processes books. There is something better out there! This book saved me as an undergraduate, and am now looking forward to it living up to my God like expectations as a post grad. If you are a professor, please use this book for you students. It ties together and lets you appreciate many fields such as linear analysis and even graph theory from computer science. This book will not disappoint.

5.0 out of 5 stars Best introductory book, February 22, 2001
By Brad (Austin, TX USA) - See all my reviews

Extremely clear, and easy to understand. It is the best introductory book on stochastic processes for non-mathematics major. After you read this book (one month is enough, how amazing it is!), it becomes easier to read "the first course in stochastic processes". The book focuses on the concept and intuition, instead of proof, and I find it is extremely useful for me -- CS major.
Strong recommend this great book

5.0 out of 5 stars Good book! , August 13, 2007
By Yuan J. Son (sunnyvale, CA) - See all my reviews
A lot of examples, easy to read. A lot of stochastic and queuing books are usually full of notations and theorems, thus hard to understand. However, the author of this book presented the materials in a way that we can actually understand the stochastic processes. If you want to learn queuing and do not have much background, this is the book!!!!

• Dept. Industrial & Systems Engineering, Texas A & M University, College Station, USA

  Richard M. Feldman

• Sielken & Associates Consulting, Inc., Bryan, USA

  Ciriaco Valdez-Flores

Richard M. Feldman is a Professor of Industrial and Systems Engineering at Texas A&M University. He received a B.A. degree in mathematics from Hope College, an M.S. degree in mathematics from Michigan State University, an M.S. degree in Industrial and Systems Engineering from Ohio University, and a Ph.D. in Industrial Engineering from Northwestern University. His teaching interests include simulation, applied probability, and queueing theory. His consulting and funded research activities have involved modeling and simulation within manufacturing, transportation, and biological contexts. He has received several teaching awards, published papers in applied probability and queueing theory, and co-authored four books.

Ciriaco Valdez-Flores is senior risk assessment consultant at Sielken & Associates Consulting, Inc. He received a bachelor’s degree from the Tecnológico at Cd. Victoria in México and master’s and Ph.D. degrees from Texas A&M University, all in Industrial Engineering. He has taught graduate courses at Texas A&M University focusing in the areas of operations research and applied stochastic processes. As a consultant, he applies his background to the development of new methods of quantitative health risk assessment that incorporate simulation and decision tree theory. He has published in health risk assessment and stochastic processes, co-authored one book and has contributed to books in engineering economy and risk assessment.

Policies and ethics