Journal of Data Science

Abstract: Hyperplane fitting factor rotations perform better than conventional rotations in attaining simple structure for complex configurations. Hyperplane rotations are reviewed and then compared using familiar exam es from the literature selected to vary in complexity. Included is a new method for fitting hyperplanes, hypermax, which updates the work of Horst (1941) and Derflinger and Kaiser (1989). Hypercon, a method for confirmatory target rotation, is a natural extension. These performed very well when compared with selected hyperplane and conventional rotations. The concluding sections consider the pros and cons of each method.

Abstract: We apply model-based cluster analysis to data concerning types of democracies, creating an instrument for typologies. Noting several ad vantages of model-based clustering over traditional clustering methods, we fit a normal mixture model for types of democracy in the context of the majoritarian-consensus contrast using Lijphart’s (1999) data on ten variables for 36 democracies. The model for the full period (1945-1996) finds four types of democracies: two types representing a majoritarian-consensus contrast, and two mixed ones lying between the extremes. The four-cluster solution shows that most of the countries have high cluster membership probabilities, and the solution is found to be quite stable with respect to possible measurement error in the variables included in the model. For the recent-period (1971-1996) data, most countries remain in the same clusters as for the full-period data.

Abstract: The study of factor analytic models often has to address two im portant issues: (a) the determination of the “optimum” number of factors and (b) the derivation of a unique simple structure whose interpretation is easy and straightforward. The classical approach deals with these two tasks separately, and sometimes resorts to ad-hoc methods. This paper proposes a Bayesian approach to these two important issues, and adapts ideas from stochastic geometry and Bayesian finite mixture modelling to construct an ergodic Markov chain having the posterior distribution of the complete col lection of parameters (including the number of factors) as its equilibrium distribution. The proposed method uses an Automatic Relevance Determi nation (ARD) prior as the device of achieving the desired simple structure. A Gibbs sampler updating scheme is then combined with the simulation of a continuous-time birth-and-death point process to produce a sampling scheme that efficiently explores the posterior distribution of interest. The MCMC sample path obtained from the simulated posterior then provides a flexible ingredient for most of the inferential tasks of interest. Illustrations on both artificial and real tasks are provided, while major difficulties and challenges are discussed, along with ideas for future improvements.

Abstract: In maximum likelihood exploratory factor analysis, the estimates of unique variances can often turn out to be zero or negative, which makes no sense from a statistical point of view. In order to overcome this difficulty, we employ a Bayesian approach by specifying a prior distribution for the variances of unique factors. The factor analysis model is estimated by EM algorithm, for which we provide the expectation and maximization steps within a general framework of EM algorithms. Crucial issues in Bayesian factor analysis model are the choice of adjusted parameters including the number of factors and also the hyper-parameters for the prior distribution. The choice of these parameters can be viewed as a model selection and evaluation problem. We derive a model selection criterion for evaluating a Bayesian factor analysis model. Monte Carlo simulations are conducted to investigate the effectiveness of the proposed procedure. A real data example is also given to illustrate our procedure. We observe that our modeling procedure prevents the occurrence of improper solutions and also chooses the appropriate number of factors objectively.

Abstract: Principal components analysis (PCA) is a widely used technique in nutritional epidemiology, to extract dietary patterns. To improve the interpretation of the derived patterns, it has been suggested to rotate the axes defined by PCA. This study aimed to evaluate whether rotation influences the repeatability of these patterns. For this reason PCA was applied in nutrient data of 500 participants (37 ± 15 years, 38% male) who were voluntarily enrolled in the study and asked to complete a semi-quantitative food frequency questionnaire (FFQ), twice within 15 days. The varimax and the quartimax orthogonal rotation methods, as well as the non-orthogonal promax and the oblimin methods were applied. The degree of agreement between the similar extracted patterns by each rotation method was assessed using the Bland and Altman method and Kendall’s tau-b coefficient. Good agreement was observed between the two administrations of the FFQ for the un-rotated components, while low-to-moderate agreement was observed for all rotation types (the quartimax and the oblimin method lead to more repeatable results). To conclude, when rotation is needed to improve food patterns’ interpretation, the quartimax and the oblimin methods seems to produce more robust results.