Markov Chain and Transition Matrix

User Generated

cct1987

Mathematics

Description

20140802004426a.png


Unformatted Attachment Preview

1. A rat is put into the maze shown below. In each time period it randomly chooses a door of the compartment it is in and moves into another compartment. 2 H 4 1 3 a. Letting the compartment numbers represent the states of a markov chain, write the transition matrix. b. Determine the long run fraction of time the rat will spend in each compartment. C. Make compartments 3 and 4 into absorbing states by assuming that the rat must stay in those compartments once entered and write the new transition matrix. d. In part c. what is the average number of steps it will take a rat who begins in state 1 to be absorbed? e. In part c. what is the probability that a rat that begins in state 1 will be absorbed in compartment 3?
Purchase answer to see full attachment
User generated content is uploaded by users for the purposes of learning and should be used following Studypool's honor code & terms of service.

Explanation & Answer


Anonymous
Excellent resource! Really helped me get the gist of things.

Studypool
4.7
Trustpilot
4.5
Sitejabber
4.4