O'Reilly logo

Semi-Markov Processes: Applications in System Reliability and Maintenance by Franciszek Grabski

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

1

Discrete state space Markov processes

Abstract

The Markov processes are an important class of the stochastic processes. The Markov property means that evolution of the Markov process in the future depends only on the present state and does not depend on past history. The Markov process does not remember the past if the present state is given. Hence, the Markov process is called the process with memoryless property. This chapter covers some basic concepts, properties, and theorems on homogeneous Markov chains and continuous-time homogeneous Markov processes with a discrete set of states. The theory of those kinds of processes allows us to create models of real random processes, particularly in issues of reliability and maintenance.

Keywords ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required