IDEAS home Printed from https://ideas.repec.org/p/pit/wpaper/321.html

Efficient High-Dimensional Importance Sampling

Author

Listed:
  • Jean-Francois Richard

Abstract

The paper describes a simple, generic and yet highly accurate Efficient Importance Sampling (EIS) Monte Carlo (MC) procedure for the evaluation of high-dimensional numerical integrals. EIS is based upon a sequence of auxiliary weighted regressions which actually are linear under appropriate conditions. It can be used to evaluate likelihood functions and byproducts thereof, such as ML estimators, for models which depend upon unobservable variables. A dynamic stochastic volatility model and a logit panel data model with unobserved heterogeneity (random effects) in both dimensions are used to provide illustrations of EIS high numerical accuracy, even under small number of MC draws. MC simulations are used to characterize the finite sample numerical and statistical properties of EIS-based ML estimators.

Suggested Citation

  • Jean-Francois Richard, 2007. "Efficient High-Dimensional Importance Sampling," Working Paper 321, Department of Economics, University of Pittsburgh, revised Jan 2007.
  • Handle: RePEc:pit:wpaper:321
    as

    Download full text from publisher

    File URL: http://www.econ.pitt.edu/fantin/papers/efficientHD-import-sampling.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Borsch-Supan, Axel & Hajivassiliou, Vassilis A., 1993. "Smooth unbiased multivariate probability simulators for maximum likelihood estimation of limited dependent variable models," Journal of Econometrics, Elsevier, vol. 58(3), pages 347-368, August.
    2. Francis Vella & Marno Verbeek, 1998. "Whose wages do unions raise? A dynamic model of unionism and wage rate determination for young men," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 13(2), pages 163-183.
    3. Siem Jan Koopman & Neil Shephard, 2002. "Testing the Assumptions Behind the Use of Importance Sampling," Economics Papers 2002-W17, Economics Group, Nuffield College, University of Oxford.
    4. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    5. H. Kahn & A. W. Marshall, 1953. "Methods of Reducing Sample Size in Monte Carlo Computations," Operations Research, INFORMS, vol. 1(5), pages 263-278, November.
    6. Melino, Angelo & Turnbull, Stuart M., 1990. "Pricing foreign currency options with stochastic volatility," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 239-265.
    7. Danielsson, J & Richard, J-F, 1993. "Accelerated Gaussian Importance Sampler with Application to Dynamic Latent Variable Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 153-173, Suppl. De.
    8. Luc Bauwens & Nikolaus Hautsch, 2006. "Stochastic Conditional Intensity Processes," Journal of Financial Econometrics, Oxford University Press, vol. 4(3), pages 450-493.
    9. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    10. Gourieroux, Christian & Monfort, Alain, 1993. "Simulation-based inference : A survey with special reference to panel data models," Journal of Econometrics, Elsevier, vol. 59(1-2), pages 5-33, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richard, Jean-Francois & Zhang, Wei, 2007. "Efficient high-dimensional importance sampling," Journal of Econometrics, Elsevier, vol. 141(2), pages 1385-1411, December.
    2. Ghysels, E. & Harvey, A. & Renault, E., 1995. "Stochastic Volatility," Papers 95.400, Toulouse - GREMAQ.
    3. Geweke, John F. & Keane, Michael P. & Runkle, David E., 1997. "Statistical inference in the multinomial multiperiod probit model," Journal of Econometrics, Elsevier, vol. 80(1), pages 125-165, September.
    4. Liesenfeld, Roman & Breitung, Jörg, 1998. "Simulation based methods of moments in empirical finance," Tübinger Diskussionsbeiträge 136, University of Tübingen, School of Business and Economics.
    5. Lee, Lung-fei, 1999. "Estimation of dynamic and ARCH Tobit models," Journal of Econometrics, Elsevier, vol. 92(2), pages 355-390, October.
    6. Lee, Lung-Fei, 1997. "Simulated maximum likelihood estimation of dynamic discrete choice statistical models some Monte Carlo results," Journal of Econometrics, Elsevier, vol. 82(1), pages 1-35.
    7. Lee, Lung-Fei, 1997. "A simulated likelihood estimator for qualitative response models with sufficient statistics," Economics Letters, Elsevier, vol. 57(1), pages 23-32, November.
    8. Inkmann, Joachim, 2000. "Misspecified heteroskedasticity in the panel probit model: A small sample comparison of GMM and SML estimators," Journal of Econometrics, Elsevier, vol. 97(2), pages 227-259, August.
    9. Heinz König & Michael Lechner, 1994. "Some Recent Developments in Microeconometrics - A Survey," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 130(3), pages 299-331, September.
    10. Lee, Lung-Fei, 1997. "A smooth likelihood simulator for dynamic disequilibrium models," Journal of Econometrics, Elsevier, vol. 78(2), pages 257-294, June.
    11. Lee, Lung-Fei, 1997. "Simulation estimation of dynamic switching regression and dynamic disequilibrium models -- some Monte Carlo results," Journal of Econometrics, Elsevier, vol. 78(2), pages 179-184, June.
    12. Denis Bolduc & Mustapha Kaci, 1993. "Estimation des modèles probit polytomiques : un survol des techniques," L'Actualité Economique, Société Canadienne de Science Economique, vol. 69(3), pages 161-191.
    13. Chihwa Kao & Lung-fei Lee & Mark M. Pitt, 2001. "Simulated Maximum Likelihood Estimation of the Linear Expenditure System with Binding Non-Negativity Constraints," Annals of Economics and Finance, Society for AEF, vol. 2(1), pages 215-235, May.
    14. Orme, Chris, 1995. "Simulated conditional moment tests," Economics Letters, Elsevier, vol. 49(3), pages 239-245, September.
    15. Vijverberg, Wim P. M., 1997. "Monte Carlo evaluation of multivariate normal probabilities," Journal of Econometrics, Elsevier, vol. 76(1-2), pages 281-307.
    16. Victor Aguirregabiria & Arvind Magesan, 2013. "Euler Equations for the Estimation of Dynamic Discrete Choice Structural Models," Advances in Econometrics, in: Structural Econometric Models, volume 31, pages 3-44, Emerald Group Publishing Limited.
    17. Pietola, Kyosti & Vare, Minna & Oude Lansink, Alfons G.J.M., 2002. "Farmers' Exit Decisions and Early Retirement Programs in Finland," 2002 International Congress, August 28-31, 2002, Zaragoza, Spain 24825, European Association of Agricultural Economists.
    18. Andreas Ziegler, 2007. "Simulated classical tests in multinomial probit models," Statistical Papers, Springer, vol. 48(4), pages 655-681, October.
    19. Florian Heiss, 2008. "Sequential numerical integration in nonlinear state space models for microeconometric panel data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 373-389.
    20. Breitung, Jörg & Lechner, Michael, 1998. "Alternative GMM methods for nonlinear panel data models," SFB 373 Discussion Papers 1998,81, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pit:wpaper:321. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Department of Economics, University of Pittsburgh The email address of this maintainer does not seem to be valid anymore. Please ask Department of Economics, University of Pittsburgh to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/depghus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.