Consistency of the Maximum Likelihood Estimator for general hidden Markov models

Abstract : Consider a parametrized family of general hidden Markov models, where both the observed and unobserved components take values in a complete separable metric space. We prove that the maximum likelihood estimator (MLE) of the parameter is strongly consistent under a rather minimal set of assumptions. As special cases of our main result, we obtain consistency in a large class of nonlinear state space models, as well as general results on linear Gaussian state space models and finite state models. A novel aspect of our approach is an information-theoretic technique for proving identifiability, which does not require an explicit representation for the relative entropy rate. Our method of proof could therefore form a foundation for the investigation of MLE consistency in more general dependent and non-Markovian time series. Also of independent interest is a general concentration inequality for $V$-uniformly ergodic Markov chains.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

https://hal-imt.archives-ouvertes.fr/hal-00442774
Contributor : Eric Moulines <>
Submitted on : Tuesday, December 22, 2009 - 3:02:59 PM
Last modification on : Thursday, October 17, 2019 - 12:36:06 PM
Long-term archiving on : Friday, June 18, 2010 - 12:03:24 AM

Files

dmrvh.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00442774, version 1
  • ARXIV : 0912.4480

Citation

Randal Douc, Eric Moulines, Jimmy Olsson, Ramon van Handel. Consistency of the Maximum Likelihood Estimator for general hidden Markov models. 2009. ⟨hal-00442774⟩

Share

Metrics

Record views

341

Files downloads

647