Journal of Data Science logo


Login Register

  1. Home
  2. To appear
  3. Computing Pseudolikelihood Estimators fo ...

Journal of Data Science

Submit your article Information
  • Article info
  • Related articles
  • More
    Article info Related articles

Computing Pseudolikelihood Estimators for Exponential-Family Random Graph Models
Christian S. Schmid   David R. Hunter  

Authors

 
Placeholder
https://doi.org/10.6339/23-JDS1094
Pub. online: 15 March 2023      Type: Computing In Data Science      Open accessOpen Access

Received
1 August 2022
Accepted
24 February 2023
Published
15 March 2023

Abstract

The reputation of the maximum pseudolikelihood estimator (MPLE) for Exponential Random Graph Models (ERGM) has undergone a drastic change over the past 30 years. While first receiving broad support, mainly due to its computational feasibility and the lack of alternatives, general opinions started to change with the introduction of approximate maximum likelihood estimator (MLE) methods that became practicable due to increasing computing power and the introduction of MCMC methods. Previous comparison studies appear to yield contradicting results regarding the preference of these two point estimators; however, there is consensus that the prevailing method to obtain an MPLE’s standard error by the inverse Hessian matrix generally underestimates standard errors. We propose replacing the inverse Hessian matrix by an approximation of the Godambe matrix that results in confidence intervals with appropriate coverage rates and that, in addition, enables examining for model degeneracy. Our results also provide empirical evidence for the asymptotic normality of the MPLE under certain conditions.

Supplementary material

 Supplementary Material
The R code file and the ergm package that implements the new methods.

References

 
Arnold BC, Strauss D (1988). Pseudolikelhood estimation, Technical Report 164, University of California, Riverside, Department of Statistics.
 
Barnard GA, Jenkins GM, Winsten CB (1962). Likelihood inference and time series. Journal of the Royal Statistical Society. Series A. General, 125(3): 321–372. https://doi.org/10.2307/2982406
 
Barndorff-Nielsen O (1978). Information and Exponential Families in Statistical Theory. Wiley.
 
Besag J (1974). Spatial interaction and the statistical analysis of lattice systems. Journal of the Royal Statistical Society, Series B, Methodological, 36(2): 192–236. https://doi.org/10.1111/j.2517-6161.1974.tb00999.x
 
Birnbaum A (1962). On the foundations of statistical inference. Journal of the American Statistical Association, 57(298): 269–306. https://doi.org/10.1080/01621459.1962.10480660
 
Bivand R, Rundel C (2020). rgeos: Interface to Geometry Engine – Open Source (‘GEOS’). R package version 0.5-3.
 
Corander J, Dahmström K, Dahmström P (1998). Maximum likelihood estimation for Markov graphs, Research Report, Department of Statistics, University of Stockholm, 8.
 
Dahmström K, Dahmström P (1993). ML-estimation of the clustering parameter in a Markov graph model, Research Report, Department of Statistics, University of Stockholm.
 
Desmarais BA, Cranmer SJ (2012). Statistical mechanics of networks: Estimation and uncertainty. Physica. A, 391(4): 1865–1876. https://doi.org/10.1016/j.physa.2011.10.018
 
Erdős P, Rényi A (1959). On random graphs. Publicationes Mathematicae Debrecen, 6: 290–297. https://doi.org/10.5486/PMD.1959.6.3-4.12
 
Frank O, Strauss D (1986). Markov graphs. Journal of the American Statistical Association, 81(395): 832–842. https://doi.org/10.1080/01621459.1986.10478342
 
Geyer CJ, Meeden GD (2019). rcdd: Computational Geometry. R package version 1.2-2.
 
Geyer CJ, Thompson EA (1992). Constrained Monte Carlo maximum likelihood for dependent data. Journal of the Royal Statistical Society, Series B, Methodological, 54(3): 657–699. https://doi.org/10.1111/j.2517-6161.1992.tb01443.x
 
Gilbert EN (1959). Random graphs. The Annals of Mathematical Statistics, 30(4): 1141–1144. https://doi.org/10.1214/aoms/1177706098
 
Godambe VP (1960). An optimum property of regular maximum likelihood estimation. The Annals of Mathematical Statistics, 31(4): 1208–1211. https://doi.org/10.1214/aoms/1177705693
 
Handcock MS, Hunter DR, Butts CT, Goodreau SM, Krivitsky PN, Morris M (2022). ergm: Fit, Simulate and Diagnose Exponential-Family Models for Networks. The Statnet Project (https://statnet.org). R package version 4.2.2.
 
Handcock MS, Hunter DR, Butts CT, Goodreau SM, Morris M (2008). statnet: Software tools for the representation, visualization, analysis and simulation of network data. Journal of Statistical Software, 24(1): 1–11. https://doi.org/10.18637/jss.v024.i01
 
Holland P, Leinhardt S (1981). An exponential family of probability distributions for directed graphs. Journal of the American Statistical Association, 76(373): 33–50. https://doi.org/10.1080/01621459.1981.10477598
 
Hunter DR, Handcock MS (2006). Inference in curved exponential family models for networks. Journal of Computational and Graphical Statistics, 15(3): 565–583. https://doi.org/10.1198/106186006X133069
 
Konis K (2007). Linear programming algorithms for detecting separated data in binary logistic regression models (Ph.D, thesis, Worcester College, Oxford University.
 
Krackhardt D (1987). Cognitive social structure. Social Networks, 9: 109–134. https://doi.org/10.1016/0378-8733(87)90009-8
 
Krivitsky PN, Handcock MS, Morris M (2011). Adjusting for network size and composition effects in exponential-family random graph models. Statistical Methodology, 8(4): 319–339. https://doi.org/10.1016/j.stamet.2011.01.005
 
Lazega E (2001). The Collegial Phenomenon: The Social Mechanism and Cooperation Among Peers in a Corporate Law Partnership. Oxford University Press.
 
Lindsay BG (1988). Composite likelihood methods. Contemporary Mathematics, 80(1): 221–239.
 
Lubbers MJ, Snijders TAB (2007). A comparison of various approaches to the exponential random graph model: A reanalysis of 102 student networks in school classes. Social Networks, 29(2): 489–507. https://doi.org/10.1016/j.socnet.2007.03.002
 
Okabayashi S, Johnson L, Geyer C (2011). Extending pseudo-likelihood for Potts models. Statistica Sinica, 21(1): 331–347.
 
Robins G, Snijders T, Wang P, Handcock M, Pattison P (2007). Recent developments in exponential random graph (${p^{\ast }}$) models for social networks. Social Networks, 29(2): 192–215. https://doi.org/10.1016/j.socnet.2006.08.003
 
Sampson SF (1968). A novitiate in a period of change: An experimental and case study of relationships, Ph.D. dissertation, Department of Sociology, Cornell University.
 
Schmid CS, Chen THY, Desmarais BA (2021). Generative dynamics of Supreme Court citations: Analysis with a new statistical network model. Political Analysis.
 
Schmid CS, Desmarais BA (2017). Exponential random graph models with big networks: Maximum pseudolikelihood estimation and the parametric bootstrap. In: 2017 IEEE International Conference on Big Data (Big Data). 116–121.
 
Schmid CS, Hunter DR (2020). Improving ERGM starting values using simulated annealing.
 
Schweinberger M (2011). Instability, sensitivity, and degeneracy of discrete exponential families. Journal of the American Statistical Association, 106(496): 1361–1370. https://doi.org/10.1198/jasa.2011.tm10747
 
Shalizi CR, Rinaldo A (2013). Consistency under sampling of exponential random graph models. The Annals of Statistics, 41(2): 508–535.
 
Snijders TA (2002). Markov chain Monte Carlo estimation of exponential random graph models. Journal of Social Structure, 3(2): 1–40.
 
Strauss D, Ikeda M (1990). Pseudolikelihood estimation for social networks. Journal of the American Statistical Association, 85(409): 202–212. https://doi.org/10.1080/01621459.1990.10475327
 
van Duijn MA, Gile KJ, Handcock MS (2009). A framework for the comparison of maxmimum pseudo-likelikood and maximum likelihood estimation of exponential family random graph models. Social Networks, 31(1): 52–62. https://doi.org/10.1016/j.socnet.2008.10.003
 
Varin C, Reid N, Firth D (2011). An overview of composite likelihood methods. Statistica Sinica, 21: 5–42.
 
Wasserman S, Pattison PE (1996). Logit models and logistic regression for social networks: I. an introduction to markov graphs and ${p^{\ast }}$. Electronic Journal of Statistics, 61(3): 401–425.
 
White H (1982). Maximum likelihood estimation of misspecified models. Econometrica, 50(1): 1–25. https://doi.org/10.2307/1912526

Related articles PDF XML
Related articles PDF XML

Copyright
2023 The Author(s). Published by the School of Statistics and the Center for Applied Statistics, Renmin University of China.
by logo by logo
Open access article under the CC BY license.

Keywords
Godambe matrix maximum pseudo-likelihood parametric bootstrap

Metrics (since February 2021)
1

Article info
views

0

Full article
views

11

PDF
downloads

9

XML
downloads

Export citation

Copy and paste formatted citation
Placeholder

Download citation in file


Share


RSS

Journal of data science

  • Online ISSN: 1683-8602
  • Print ISSN: 1680-743X

About

  • About journal

For contributors

  • Submit
  • OA Policy
  • Become a Peer-reviewer

Contact us

  • JDS@ruc.edu.cn
  • No. 59 Zhongguancun Street, Haidian District Beijing, 100872, P.R. China
Powered by PubliMill  •  Privacy policy