3 views

Uploaded by Songya Pan

Stochastic Models I (for first-year doctoral students)

- Kryteax Sample Maths
- Jordan
- gravity
- Kryteax Sample Maths
- MAT188 Syllabus, D. Burbulla
- [Ppt] Eigenvalue and Eigenvectors
- AE 483 Linear Algebra Review.pdf
- Opencv Basic
- 1445009365Krash_Sample.pdf
- Wei Prater Notes Iitb
- MAT115-Difference Differential Eqns
- FinalD_Fall06
- 01338523
- Getting Information About a Matrix
- Finite Volume Code for Compressible Flow
- Noise KTC Aeue
- Multi-Mass Spring Modeling
- 881512014 Functions List 2 Cols
- Outlier Sample, Tasneem Ahmad
- Vampire Ecology in the Jossverse

You are on page 1of 3

Numerical Problems 1.(a) 5 = 0.1667 1.(b) Yes, because the Markov chain is irreducicle and has a nite state space. The stationary probability of being in state 5 is 5 = 0.1667. The stationary probability vector is such that = P . However, there is no limiting probability (i.e., we do not have a limit for P n as n ), because the chain is periodic, with period 2.

2n+1 2n 1.(c) For large n, P1 = 0 and P1 ,5 ,5

25 = 0.3334

1.(d) 1/5 = 6 2.(a) M1 = 14.26303 2.(b) N1,5 = 2.21054 2.(c) B1,10 = 0.3684 Problem 4.18 Let aj = e j /j ! , (a)

N 1

j 0.

P0,j = aj , j < N,

P0,N = 1

j =0

aj

N i

j =0

aj .

(b) Yes, because it is a nite, irreducible Markov chain. (c) As one of the equations is redundant, we can write them as follows :

j +1

j

N

= 0 aj +

i=1

i aj i+1 ,

j = 0, , N 1

j

j =0

= 1.

Problem 4.19 (a) are from state i to state j . (b) go from a state in A to one in Ac . (c) This follows because between any two transitions that go from a state in A to one in Ac there must be a transition from a state in Ac to one in A, and vice-versa. 1

(d) It follows from (c) that the long-run proportion of transitions that are from a state in A to one in Ac must equal the long-run proportion of transitions that go from a state in Ac to one in A; and that is what (d) asserts. Problem 4.31 Let the states be 0 : spider and y at same location 1 : spider at location 1 and y at 2 2 : spider at 2 and y at 1 1 0 0 P = .54 .28 .18 .54 .18 .28 (a)

n P11 = (0.46)n

1 1 + 2 2

28 1 23

which is obtained by rst conditioning on the event that 0 is not entered and then using the fact that for the p 1p 1p p

n = chain P00 1 2 n +1 2 (2p 1) .

More generally, we can nd explicit analytical expressions for n-step transition probabilities by applying the spectral representation of the sub-probability transition matrix Q= a b b a

(The same argument applies without that special structure. See the Appendix of Karlin and Taylor for a textbook review of this part of basic linear algebra.) We want to nd constants such that xQ = x . Those are the eigenvalues of Q. To nd the eigenvalues, we solve the equation det(Q I ) = 0 , where det is the determinant. Here the equation is (a )2 b2 = 0 , which yields two solutions: a + b and a b. We then nd the left eigenvectors of Q. A row vector x is a left eigenvector of Q associated with the eigenvalue 2 (1)

if equation (1) hold. Similarly, the transpose of x, denoted by xT , is a right eigenvector of Q associated with eigenvalue if QxT = xT . We then can nd a spectral representation for Q: Q = RL , (3) (2)

with the following properties: (i) R and L are square matrices with the same dimension as Q, (ii) the columns of R are right eigenvectors of Q; (iii) the rows of L are left eigenvectors of Q, (iv) RL = LR = I , and (v) is a square diagonal matrix with the eigenvalues for its diagonal elements. As a consequence, we have Qn = Rn L for all n 1 , (4)

enabling us to compute Qn , easily because n is a diagonal matrix with diagonal elements n , where is an eigenvector. Here we get eigenvalues of Q equal to a + b and a b. Here we get eigenvector matrices L= and R= 1 1 1 1 1/2 1/2 1/2 1/2

We obtain one of these by directly solving for the eigenvectors (which are not unique). Given L or R, we can obtain the other by inverting the matrix, i.e., L = R 1 . Hence, equation (4) holds Qn = 1 1 1 1 (a + b)n 0 0 (a b)n 1/2 1/2 1/2 1/2

Qn 1,1 =

1 (b) E[N ] = .54 since N is geometric (on the positive integers, not including 0) with p = 0.54.

- Kryteax Sample MathsUploaded byRitwik Kumar
- JordanUploaded byelectroteknica
- gravityUploaded bytia
- Kryteax Sample MathsUploaded byRitwik Kumar
- MAT188 Syllabus, D. BurbullaUploaded byEric Rogers
- [Ppt] Eigenvalue and EigenvectorsUploaded byvatouvin
- AE 483 Linear Algebra Review.pdfUploaded bypuhumight
- Opencv BasicUploaded byZolphe
- 1445009365Krash_Sample.pdfUploaded byJagan Rampalli
- Wei Prater Notes IitbUploaded byIndreesh Badrinarayanan
- MAT115-Difference Differential EqnsUploaded byavnishgarg96
- FinalD_Fall06Uploaded byloser mommy
- 01338523Uploaded byapi-3697505
- Getting Information About a MatrixUploaded byAhmed Ahmed
- Finite Volume Code for Compressible FlowUploaded bymafrisbe
- Noise KTC AeueUploaded bykeynote76
- Multi-Mass Spring ModelingUploaded byJohn Alexiou
- 881512014 Functions List 2 ColsUploaded byAhmed Elsayed
- Outlier Sample, Tasneem AhmadUploaded byProf. Dr. Tasneem Ahmad
- Vampire Ecology in the JossverseUploaded byPedro de la Costa
- solved algebra examUploaded byChristina Jones
- jafar2005.pdfUploaded byYasser Naguib
- Linear Algebra course notes HKUST ECE5300Uploaded byThusitha Chandrapala
- Gate Maths SreekanthaUploaded byAnonymous LXHlHv2RW
- Linear Control TheoryUploaded byBalasubramanian Raja
- Everything You Always Wanted to Know About RBC ModelUploaded byPaolo Ponce Arangurí
- Study Centre April 17, 2018Uploaded byJoshua Black
- LASlides_01Uploaded bymitsuosakamoto
- Ma Thematic A Tutorial BeginnerUploaded byLuis Francisco Mendoza
- Klerk Et Al._this Document is Downloaded From DR-NTU , Nanyang Technological University Library , Singapore ._2008Uploaded byxjohann

- midtermTwo6711F12solsUploaded bySongya Pan
- midtermOne6711F10solsUploaded bySongya Pan
- midtermOne6711F08solsUploaded bySongya Pan
- midtermOne6711F12solsUploaded bySongya Pan
- Midterm Two 6711 f 10Uploaded bySongya Pan
- Midterm One 6711 f 10Uploaded bytabrupt
- Midterm One 6711 f 08Uploaded bySongya Pan
- Midterm Two 6711 f 12Uploaded bySongya Pan
- Lect 0910Uploaded bySongya Pan
- Midterm Two f 07Uploaded bySongya Pan
- Midterm One 6711 f 12Uploaded bySongya Pan
- Lect 0903Uploaded bySongya Pan
- Lect 0905Uploaded bySongya Pan
- midtermTwoF07solsUploaded bySongya Pan
- midtermTwo6711F10solsUploaded bySongya Pan
- homewk11SolsUploaded bySongya Pan
- homewkLTUploaded bySongya Pan
- homewk13Uploaded bySongya Pan
- homewk10Uploaded bySongya Pan
- homewk12Uploaded bySongya Pan
- homewk8Uploaded bySongya Pan
- homewk11Uploaded bySongya Pan
- homewk13SolsUploaded bySongya Pan
- homewk8SolsUploaded bySongya Pan
- homewk7SolsUploaded bySongya Pan
- homewk7Uploaded bySongya Pan
- homewk9SolsUploaded bySongya Pan
- homewk9Uploaded bySongya Pan
- homewk12SolsUploaded bySongya Pan

- MCQ3 DC Boolean Algebra and Logic SimplificationUploaded bysreekantha
- UBCO-MATH221Uploaded bynoahhacker
- Conjecture on the consecutive concatenation of the terms of an arithmetic progressionUploaded byMia Amalia
- 10 Years of Romanian Mathematical Competitions - Radu Gologan.pdfUploaded byDumi Nelu
- 2 2 Adding Subtracting IntegersUploaded bysensei_sembey
- MA_Algebra.pdfUploaded byNikhilSharma
- Background v 2Uploaded byBangaru Babu
- realizationsUploaded byQuang Doan
- Ring of Entire FunctionsUploaded bysan_kumar@ymail.comm
- Calculus 1 - Rules of DerivativesUploaded bywelcometotheswamp
- Section4_2Uploaded bysonti11
- Dense optical flow expansion based on polynomial basis approximationUploaded bypi194043
- Systems of NonUploaded bypramit04
- Cambridge Maths 7 Chapter 1Uploaded byRughfidd Jfdhbigfhg
- Polynomial FunctionUploaded byCharity Joy Gabat Dayaganon
- Ch3 Bijection PrincipleUploaded byMichael Lin
- Theory of equations exercise 2 solution.pdfUploaded byChai Usajai Usajai
- 18-Matrices and DetUploaded byJohnny Murray
- (Proceedings of Symposia in Pure Mathematics 98) Amir-Kian Kashani-Poor, Ruben Minasian, Nikita Nekrasov, Boris Pioline, Editors-String-Math 2016-American Mathematical Society (2018).pdfUploaded byLav
- Ch7StudentNotes2.docUploaded byAlexander Kim Waing
- Adriano Scremin - Pu ArticleUploaded bydiogorossot_85125119
- Algebra Practice Exercise 1Uploaded byJomelnelyna
- Banach-Algebras-an-Introduction-Pure-and-Applied-Mathematics.pdfUploaded byconrado
- Tutorial 1Uploaded bynnnonty
- Summary Lin AlgUploaded byVictor
- 1 Cartesian Coordinate SystemsUploaded byQasimWaris
- solhwk3-1Uploaded bytrue_kanji
- bpc5_ch09-05Uploaded byMuhammad Asad Ali
- Fay paperUploaded byAntareep Mandal
- sme2 wks 15 and 16 geometry and matricesUploaded byapi-138117317