When
dealing with a regular (fixed-support) one-parameter distribution, the
corresponding maximum-likelihood estimator (MLE) is, to a good approximation, normally
distributed. But, when the support boundaries are functions of the parameter,
finding good approximation for the sampling distribution of MLE (needed to
construct an accurate confidence interval for the parameter’s true value) may
get very challenging. We demonstrate the nature of this problem, and show how
to deal with it, by a detailed study of a specific situation. We also indicate
several possible ways to bypass MLE by proposing alternate estimators; these,
having relatively simple sampling distributions, then make constructing a confidence
interval rather routine.
References
[1]
Edgeworth, F.Y. (1905) The Law of Error. Transactions of the Cambridge Philosophical Society, 20, 36-66, 113-141.
[2]
Vrbik, J. (2022) Fisher Transformation via Edgeworth Expansion. arXiv: 2208.05070v1.
[3]
Logan, B.F., Mallows, C.L., Rice, S.O. and Shepp, A.L. (1973) Limit Distributions of Self-Normalized Sums. The Annals of Probability, 1, 788-809.
https://doi.org/10.1214/aop/1176996846
[4]
Spataru, A. (2014) Convergence and Precise Asymptotics for Series Involving Self-Normalized Sums. Journal of Theoretical Probability, 29, 267-276.
https://doi.org/10.1007/s10959-014-0560-1sss
[5]
Gnedenko, B.V. and Kolmogorov, A.N. (1954) Limit Distributions for Sums of Independent Random Variables. Addison-Wesley, Cambridge.