Markov Chains

Which states, if any, are periodic in the Markov chain pictured?

The only states of weather are sun and rain. If it's sunny today, there is an \(80\%\) chance it will be sunny tomorrow, and if it's rainy today, there is a \(60\%\) chance it's rainy tomorrow. In the long run, on what fraction of days will it be sunny?

What is the stationary distribution of the Markov chain pictured below?

\[ \left(\tfrac{1}{3}, \, \tfrac{1}{3}, \, \tfrac{1}{3}\right)\] \[ \left(\tfrac{2}{5}, \, \tfrac{2}{5}, \, \tfrac{1}{5}\right)\] \[ \left(\tfrac{1}{3}, \, \tfrac{4}{9}, \, \tfrac{2}{9}\right)\] \[ \left(\tfrac{7}{18}, \, \tfrac{4}{9}, \, \tfrac{1}{6}\right)\] \[ \left(\tfrac{7}{19}, \, \tfrac{8}{19}, \, \tfrac{4}{19}\right)\]

In a particular (very large) deck of cards, the suit of each card is dependent upon the suit of the previous card. If the dependencies are given by the Markov chain pictured, determine the stationary distribution of suits.

\[\left(\tfrac{18}{157},\, \tfrac{36}{157},\, \tfrac{48}{157},\, \tfrac{55}{157}\right)\] \[\left(\tfrac{20}{157},\, \tfrac{28}{157},\, \tfrac{52}{157},\, \tfrac{57}{157}\right)\] \[\left(\tfrac{24}{157},\, \tfrac{33}{157},\, \tfrac{48}{157},\, \tfrac{52}{157}\right)\] \[\left(\tfrac{25}{157},\, \tfrac{32}{157},\, \tfrac{40}{157},\, \tfrac{60}{157}\right)\] \[\left(\tfrac{30}{157},\, \tfrac{40}{157},\, \tfrac{42}{157},\, \tfrac{45}{157}\right)\]

A player wins a game of tennis by being the first to win \(2\) games more than the other player, provided they have won at least \(4\) games. If the game is tied at \(3\) to \(3\) and the probabilities are given by the Markov chain pictured, determine the probability that player A wins.

Waste less time on Facebook — follow Brilliant.

Excel in math and science

Master concepts by solving fun, challenging problems.

It's hard to learn from lectures and videos

Learn more effectively through short, conceptual quizzes.

Our wiki is made for math and science

Master advanced concepts through explanations, examples, and problems from the community.

Used and loved by 4 million people

Learn from a vibrant community of students and enthusiasts, including olympiad champions, researchers, and professionals.

Excel in math and science

Master concepts by solving fun, challenging problems.

It's hard to learn from lectures and videos

Learn more effectively through short, conceptual quizzes.

Our wiki is made for math and science

Master advanced concepts through explanations, examples, and problems from the community.

Used and loved by 4 million people

Learn from a vibrant community of students and enthusiasts, including olympiad champions, researchers, and professionals.

Concept Quizzes

Markov Chains - Stationary Distributions

Excel in math and science

Master concepts by solving fun, challenging problems.

It's hard to learn from lectures and videos

Learn more effectively through short, conceptual quizzes.

Our wiki is made for math and science

Master advanced concepts through explanations, examples, and problems from the community.

Used and loved by 4 million people

Learn from a vibrant community of students and enthusiasts, including olympiad champions, researchers, and professionals.

Excel in math and science

Master concepts by solving fun, challenging problems.

It's hard to learn from lectures and videos

Learn more effectively through short, conceptual quizzes.

Our wiki is made for math and science

Master advanced concepts through explanations, examples, and problems from the community.

Used and loved by 4 million people

Learn from a vibrant community of students and enthusiasts, including olympiad champions, researchers, and professionals.

Excel in math and science

Master concepts by solving fun, challenging problems.

It's hard to learn from lectures and videos

Learn more effectively through short, conceptual quizzes.

Our wiki is made for math and science

Master advanced concepts through explanations, examples, and problems from the community.

Used and loved by 4 million people

Learn from a vibrant community of students and enthusiasts, including olympiad champions, researchers, and professionals.

Excel in math and science

Master concepts by solving fun, challenging problems.

It's hard to learn from lectures and videos

Learn more effectively through short, conceptual quizzes.

Our wiki is made for math and science

Master advanced concepts through explanations, examples, and problems from the community.

Used and loved by 4 million people

Learn from a vibrant community of students and enthusiasts, including olympiad champions, researchers, and professionals.

Excel in math and science

Master concepts by solving fun, challenging problems.

It's hard to learn from lectures and videos

Learn more effectively through short, conceptual quizzes.

Our wiki is made for math and science

Master advanced concepts through explanations, examples, and problems from the community.

Used and loved by 4 million people

Learn from a vibrant community of students and enthusiasts, including olympiad champions, researchers, and professionals.

Master advanced concepts through explanations,
examples, and problems from the community.

Learn from a vibrant community of students and enthusiasts,
including olympiad champions, researchers, and professionals.

Master advanced concepts through explanations,
examples, and problems from the community.

Learn from a vibrant community of students and enthusiasts,
including olympiad champions, researchers, and professionals.

Master advanced concepts through explanations,
examples, and problems from the community.

Learn from a vibrant community of students and enthusiasts,
including olympiad champions, researchers, and professionals.

Master advanced concepts through explanations,
examples, and problems from the community.

Learn from a vibrant community of students and enthusiasts,
including olympiad champions, researchers, and professionals.

Master advanced concepts through explanations,
examples, and problems from the community.

Learn from a vibrant community of students and enthusiasts,
including olympiad champions, researchers, and professionals.

Master advanced concepts through explanations,
examples, and problems from the community.

Learn from a vibrant community of students and enthusiasts,
including olympiad champions, researchers, and professionals.

Master advanced concepts through explanations,
examples, and problems from the community.

Learn from a vibrant community of students and enthusiasts,
including olympiad champions, researchers, and professionals.