%0 Journal Article
%T Dealing with Multicollinearity in Factor Analysis: The Problem, Detections, and Solutions
%A Theodoros Kyriazos
%A Mary Poga
%J Open Journal of Statistics
%P 404-424
%@ 2161-7198
%D 2023
%I Scientific Research Publishing
%R 10.4236/ojs.2023.133020
%X Multicollinearity
in factor analysis has negative effects, including unreliable factor structure,
inconsistent loadings, inflated standard errors, reduced discriminant validity,
and difficulties in interpreting factors. It also leads to reduced stability,
hindered factor replication, misinterpretation of factor importance, increased
parameter estimation instability, reduced power to detect the true factor
structure, compromised model fit indices, and biased factor loadings.
Multicollinearity introduces uncertainty, complexity, and limited
generalizability, hampering factor analysis.</span></span><span><span><span style=\"font-family:&quot;\"> </span></span></span><span><span><span style=\"font-family:&quot;\"><span style=\"font-family:Verdana;\">To
address multicollinearity, researchers can examine the correlation matrix to
identify variables with high correlation coefficients. The Variance Inflation
Factor (VIF) measures the inflation of regression coefficients due to
multicollinearity. Tolerance, the reciprocal of VIF, indicates the proportion
of variance in a predictor variable not </span><span style=\"font-family:Verdana;\">shared
with others. Eigenvalues help assess multicollinearity, with values greater</span><span style=\"font-family:Verdana;\"> than 1 suggesting the retention of factors. Principal Component Analysis (PCA)
reduces dimensionality and identifies highly correlated variables. Oth</span><span style=\"font-family:Verdana;\">er diagnostic measures include the condition
number and CookĄ¯s distance. Researchers</span><span style=\"font-family:Verdana;\"> can center or standardize data,
perform variable filtering, use PCA instead of factor analysis, employ factor
scores, merge correlated variables, or apply clustering techniques for the
solution of the multicollinearity problem.</span></span></span></span><span><span><span style=\"font-family:&quot;\"> </span></span></span><span style=\"font-family:Verdana;\"><span style=\"font-family:Verdana;\"><span style=\"font-family:Verdana;\">Further
research is needed to explore different types of multicollinearity, assess
method effectiveness, and investigate the relationship with other factor
analysis issues.
%K Multicollinearity
%K Factor Analysis
%K Biased Factor Loadings
%K Unreliable Factor Structure
%K Reduced Stability
%K Variance Inflation Factor
%U http://www.scirp.org/journal/PaperInformation.aspx?PaperID=125846