Markov Chains and Stochastic Stability

ISBN-10: 0521731828
ISBN-13: 9780521731829
Edition: 2nd 2009
List price: $120.00 Buy it from $83.13
This item qualifies for FREE shipping

*A minimum purchase of $35 is required. Shipping is provided via FedEx SmartPost® and FedEx Express Saver®. Average delivery time is 1 – 5 business days, but is not guaranteed in that timeframe. Also allow 1 - 2 days for processing. Free shipping is eligible only in the continental United States and excludes Hawaii, Alaska and Puerto Rico. FedEx service marks used by permission."Marketplace" orders are not eligible for free or discounted shipping.

30 day, 100% satisfaction guarantee

If an item you ordered from TextbookRush does not meet your expectations due to an error on our part, simply fill out a return request and then return it by mail within 30 days of ordering it for a full refund of item cost.

Learn more about our returns policy

New Starting from $83.13
what's this?
Rush Rewards U
Members Receive:
coins
coins
You have reached 400 XP and carrot coins. That is the daily max!
You could win $10,000

Get an entry for every item you buy, rent, or sell.

Study Briefs

Limited time offer: Get the first one free! (?)

All the information you need in one place! Each Study Brief is a summary of one specific subject; facts, figures, and explanations to help you learn faster.

Add to cart
Study Briefs
History of Western Art Online content $4.95 $1.99
Add to cart
Study Briefs
History of World Philosophies Online content $4.95 $1.99
Add to cart
Study Briefs
American History Volume 1 Online content $4.95 $1.99
Add to cart
Study Briefs
History of Western Music Online content $4.95 $1.99

Customers also bought

Loading
Loading
Loading
Loading
Loading
Loading
Loading
Loading
Loading
Loading

Book details

List price: $120.00
Edition: 2nd
Copyright year: 2009
Publisher: Cambridge University Press
Publication date: 4/2/2009
Binding: Paperback
Pages: 624
Size: 6.75" wide x 9.50" long x 1.25" tall
Weight: 2.486
Language: English

Richard L. Tweedie was Professor and Head of the Division of Biostatistics at the University of Minnesota before his death in 2001.

List of figures
Prologue to the Second edition, Peter W. Glynn
Preface to the second edition, Sean Meyn
Preface to the first edition
Communication and Regeneration
Heuristics
A range of Markovian environments
Basic models in practice
Stochastic stability for Markov models
Commentary
Markov models
Markov models in time series
Nonlinear state space models
Models in control and systems theory
Markov models with regeneration times
Commentary
Transition probabilities
Defining a Markovian Process
Foundations on a countable space
Specific transition matrices
Foundations for general state space chains
Building transition kernels for specific models
Commentary
Irreducibility
Communication and irreducibility: Countable spaces
�-Irreducibility
�-Irreducibility for random walk models
�-Irreducible linear models
Commentary
Pseudo-atoms
Splitting �-irreducible chains
Small sets
Small sets for specific models
Cyclic behavior
Petite sets and sampled chains
Commentary
Topology and continuity
Feller properties and forms of stability
T-chains
Continuous components for specific models
e-Chains
Commentary
The nonlinear state space model
Forward accessibility and continuous components
Minimal sets and irreducibility
Periodicity for nonlinear state space models
Forward accessible examples
Equicontinuity and the nonlinear state space model
Commentary
Stability Structures
Transience and recurrence
Classifying chains on countable spaces
Classifying �-irreducible chains
Recurrence and transience relationships
Classification using drift criteria
Classifying random walk on R+
Commentary
Harris and topological recurrence
Harris recurrence
Non-evanescent and recurrent chains
Topologically recurrent and transient states
Criteria for stability on a topological space
Stochastic comparison and increment analysis
Commentary
The existence of �
Stationarity and invariance
The existence of �: chains with atoms
Invariant measures for countable space models
The existence of �: �-irreducible chains
Invariant measures for general models
Commentary
Drift and regularity
Regular chains
Drift, hitting times and deterministic models
Drift, criteria for regularity
Using the regularity criteria
Evaluating non-positivity
Commentary
Invariance and tightness
Chains bounded in probability
Generalized sampling and invariant measures
The existence of a �-finite invariant measure
Invariant measures for e-chains
Establishing boundedness in probability
Commentary
Convergence
Ergodicity
Ergodic chains on countable spaces
Renewal and regeneration
Ergodicity of positive Harris chains
Sums of transition probabilities
Commentary
f-Ergodicity and f-regularity
f-Properties: chains with atoms
f-Regularity and drift
f-Ergodicity for general chains
f-Ergodicity of specific models
A key renewal theorem
Commentary
Geometric ergodicity
Geometric properties: chains with atoms
Kendall sets and drift criteria
f-Geometric regularity of � and its skeleton
f-Geometric ergodicity for general chains
Simple random walk and linear models
Commentary
V-Uniform ergodicity
Operator norm convergence
Uniform ergodicity
Geometric ergodicity and increment analysis
Models from queueing theory
Autoregressive and state space models
Commentary
Sample paths and limit theorems
Invariant �-fields and the LLN
Ergodic theorems for chains possessing an atom
General Harris chains
The functional CLT
Criteria for the CLT and the LIL
Applications
Commentary
Positivity
Null recurrent chains
Characterizing positivity using Pn
Positivity and T-chains
Positivity and e-chains
The LLN for e-chains
Commentary
Generalized classification criteria
State-dependent drifts
History-dependent drift criteria
Mixed drift conditions
Commentary
Epilogue to the second edition
Geometric ergodicity and spectral theory
Simulation and MCMC
Continuous time models
Appendices
Mud maps
Recurrence versus transience
Positivity versus nullity
Convergence properties
Testing for stability
Glossary of drift conditions
The Scalar SETAR model: a complete classification
Glossary of models assumptions
Regenerative models
State space models
Some mathematical background
Some measure theory
Some probability theory
Some topology
Some real analysis
Convergence concepts for measures
Some martingale theory
Some results on sequences and numbers
Bibliography
Indexes
General index
Symbols

×
Free shipping on orders over $35*

*A minimum purchase of $35 is required. Shipping is provided via FedEx SmartPost® and FedEx Express Saver®. Average delivery time is 1 – 5 business days, but is not guaranteed in that timeframe. Also allow 1 - 2 days for processing. Free shipping is eligible only in the continental United States and excludes Hawaii, Alaska and Puerto Rico. FedEx service marks used by permission."Marketplace" orders are not eligible for free or discounted shipping.

Learn more about the TextbookRush Marketplace.

×