In addition to finding principal shapes, it is interesting to estimate the variability of particular toothbrushes (landmarks). Using a EDM gives consistent estimates of this variability in the population (see section 1.4.3). Also, the objective function of equation (4.2) is currently solved sequentially, but weight vectors could be found simul-
taneously.
Another approach that was considered is the use of individual difference scaling (IND- SCAL) (Cox and Cox, 2000) to represent the respondents and questions on separate two dimensional maps. However, it was discovered that this approach is available using a technique called napping, see Perrin et al. (2008) for example, which analyses the napping data using hierarchical multiple factor analysis. Packages are available in R, to use napping data with INDSCAL, and is part of the SensoMineR package (Le and Husson, 2008).
Bibliography
Anaya-Izquierdo, K., Critchley F. and Vines K. (2008). Orthogonal simple component analysis. Vectors 1, z4.
Bartholomew, D. J. and Knott M. (1987). Latent variable models and factor analysis. Griffin London.
Basilevsky, A. (1994). Statistical Factor Analysis and Related Methods. Wiley & Sons.
Berge, J. M. T. (1977). Orthogonal procrustes rotation for two or more matrices.
Psychometrika 42(2), 267–276.
Bookstein, F. L. (1984). A statistical method for biological shape comparison. Journal of Theoretical Biology 107(3), 475–520.
Bookstein, F. L. (1986). Size and shape spaces for landmark data in two dimensions.
Statistical Science 1(2), 181–242.
Brusco, M., Hubert L., Arabie P. and Meulman J. (2007). The structural represen- tation of proximity matrices with MATLAB. Psychometrika 72(4), 655–656.
Burt, C. L. (1917). The distribution and relations of educational abilities. London County Council.
Cadima, J. and Jolliffe I. T. (1995). Loading and correlations in the interpretation of principle components. Journal of Applied Statistics 22(2), 203.
Cadima, J. F. C. L. and Jolliffe I. T. (2001). Variable selection and the interpreta- tion of principal subspaces. Journal of Agricultural, Biological, and Environmental Statistics 6(1), 62–79.
Chipman, H. A. and Gu H. (2005). Interpretable dimension reduction. Journal of Applied Statistics 32(9), 969.
Choulakian, V. (2001, August). Robust q-mode principal component analysis in l1.
Choulakian, V. (2003). The optimality of the centroid method. Psychometrika 68(3), 473–475.
Choulakian, V. (2005, January). Transposition invariant principal component analysis in l1 for long tailed data. Statistics & Probability Letters 71(1), 23–31.
Choulakian, V. (2006a, March). L1-norm projection pursuit principal component anal- ysis. Computational Statistics & Data Analysis 50(6), 1441–1451.
Choulakian, V., Allard J. and J. Almhana (2006b). Robust centroid method. Comput. Stat. Data Anal. 51(2), 737–746.
Choulakian, V., Dambra L. and Simonetti B. (2006c). Hausman principal component analysis. From Data and Information Analysis to Knowledge Engineering, 294–301.
Cootes, T. F., Taylor C. J., Cooper D. H. and J. Graham (1992). Training models of shape from sets of examples. 557, 9–18.
Cormen, T. H., Leiserson C. E., Rivest R. L., and Stein C. (2001). Introduction to Algorithms, chapter 16. Cambridge (Massachusetts): MIT Press.
Costello, A. B. and Osborne J. W. (2005). Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation 10(7), 19.
Cox, T. F. (2005). An introduction to multivariate data analysis. Hodder Arnold London.
Cox, T. F. and Cox M. A. A. (2000). Multidimensional Scaling. Chapman and Hall.
D’Aspremont, A., Ghaoui L. E, Jordan M. I. and Lanckriet G. R. (2004). A direct formulation for sparse PCA using semidefinite programming. SIAM Review 49(3), 434–448.
DeSarbo, W. S. and Hausman R. E. (2005). An efficient branch and bound procedure for restricted principal components analysis. Data Analysis and Decision Support, 11–20.
Dryden, I. L. and Mardia K. V. (1998). Statistical Shape Analysis. Wiley.
Edwards, D. (2000). Introduction to Graphical Modelling. Springer-Verlag, New York.
Everitt, B. S. (1984). An Introduction to Latent Variable Models. Monographs on Statistics and Applied Probability. Chapman & Hall.
Fabrigar, L. R., Wegener D. T., MacCallum R. C. and Strahan E. J. (1999). Evalu- ating the use of exploratory factor analysis in psychological research. Psychological methods 4(3), 272–299.
Ferrez, J. A., Fukuda K., and Liebling T. M. (2005). Solving the fixed rank con- vex quadratic maximization in binary variables by a parallel zonotope construction algorithm. European Journal of Operational Research 166(1), 35–50.
Fletcher, R. (2000). Practical methods of Optimization (2nd ed.). Wiley.
Gabriel, K. R. (1971). The biplot graphic display of matrices with application to principal component analysis. Biometrika 58(3), 453.
Gervini, D. and Rousson V. (2004). Criteria for evaluating Dimension-Reducing com- ponents for multivariate data. The American Statistician 58(1), 72–77.
Goodall, C. R. (1991). Procrustes methods in the statistical analysis of shape. Journal of the Royal Statistical Society, Series B 53(2), 285.
Gower, J. C. (1975). Generalized procrustes analysis. Psychometrica 40(1), 33–51.
Gower, J. C. and Hand D. J. (1996). Biplots (First ed.). Monographs on Statistics and Applied Probability. Chapman & Hall.
Gragn, D. and Trendafilov N. T (2010). Sparse principal components based on cluster- ing. Technical report, The Open University.
Harman, H. H. (1976). Modern factor Analysis. Chicago University Press.
Harris, C. W. and Kaiser H. F. (1964). Oblique factor analytic solutions by orthogonal transformations. Psychometrika 29(4), 347–362.
Hausman, R. (1982). Constrained multivariate analysis. Optimization in Statistics, 137.
Hendrickson, A. E. and White P. O. (1964). Promax: a quick method for the ro- tation to oblique simple structure. British Journal of Mathematical Statistics and Psychology 17(1), 65–70.
Jennrich, R. (2002, March). A simple general method for oblique rotation. Psychome- trika 67(1), 7–19.
Johnstone, I. M. and Lu, A. Y. (2009). On consistency and sparsity for principal components analysis in high dimensions (with discussion). Journal of the American Statistical Association 104, 682–703.
Jolliffe I. T. (1995). Rotation of principal components: choice of normalization con- straints. Journal of Applied Statistics 22(1), 29-35.
Jolliffe, I. T. (2002). Principal component analysis. Springer verlag.
Jolliffe, I. T., Trendafilov N. T. and Uddin M. (2003, September). A modified principal component technique based on the LASSO. Journal of Computational and Graphical Statistics 12(3), 531–547.
Jolliffe, I. T. and Uddin M. (2000). The simplified component technique: An alter- native to rotated principal components. Journal of Computational and Graphical Statistics 9(4), 689–710.
Kaiser, H. F. (1958). The varimax criterion for analytic rotation in factor analysis.
Psychometrika 23(3), 187–200.
Kalman, D. (2000, October). A matrix proof of newton’s identities. Mathematics Magazine 73(4), 313–315.
Kendall, D. (1984). Shape manifolds, procrustean metrics, and complex projective spaces. Bulletin London Mathematical Society 16, 81.
Kent, J. T. and Mardia K. V. (1997). Consistency of procrustes estimators. Journal of the Royal Statistical Society, Series B 59(1), 281–29.
Kohonen, T. (1995). Self-Organizing Maps. Berlin: Springer.
Kruskal, J. B. (1964). Nonmetric multidimensional scaling: a numerical method. Psy- chometrika 29(2), 115–129.
Le, S. and Husson F. C. (2008). SensomineR: a package for sensory data analysis.
Journal of sensory studies 23(1), 14–25.
Lele, S. (1991). Euclidean distance matrix analysis:a coordinate-free approach for com- paring biological shapes using landmark data. Am. J. Phys. Anthropol 86, 415.
Lele, S. (1993). Euclidean distance matrix analysis (EDMA) of landmark data:estimation of mean form and mean form difference. Math. Geol. 25(5), 573–602.
Lele, S. and Cole T. (1996). A new test for shape differences when variance-covariance matrices are unequal Journal of Human Evolution 31, 193.
Lele, S. R. and Richtsmeier, J. T. (1992). On comparing biological shapes: detection of influential landmarks. Am. J. Phys. Anthropol 87, 49.
Lele, S. R. and Richtsmeier, J. T. (1995). Euclidean Distance Matrix Analysis: Confi- dence intervals for form and growth differences. Am. J. Phys. Anthropol 98, 73–86.
Lele, S. R. and Richtsmeier J. T. (2000). An Invariant Approach to Statistical Analysis of Shape. Interdisciplinary Statistics series. London: Chapman and Hall/CRC Press.
MacKay, D. J. and Gibbs M. N. (1999). Density networks. Statistics and neural networks: advances at the interface, 129.
Mardia, K. V., Kent J. T. and Bibby J. M (1979). Multivariate Analysis. Lon- don:Academic Press.
Mead, D. G. (1992, October). Newton’s identities. The American Mathematical Monthly 99(8), 749–751.
Mosier, C. I. (1939). Determining a simple structure when loadings for certain tests are known. Psychometrika 4(2), 149–162.
O’Neill, B. (1997). Elementary differential geometry. Academic Pr.
Perrin, L., Symoneaux R., Matre I., Asselin C., Jourjona F. and Pagesc J. (2008). Comparison of three sensory methods for use with the napping procedure: Case of ten wines from loire valley. Food Quality and Preference 19(1), 1–11.
Rousson, V. and Gasser T. (2004). Simple component analysis. Journal of the Royal Statistical Society. Series C (Applied Statistics) 53(4), 539–555.
Rousson, V. and Maechler M. (2009, November). R package ’sca’ - simple component analysis.
Sammon, J. W. (1969). A nonlinear mapping for data structure analysis. IEEE Trans- actions on computers 100(18), 401–409.
Slabaugh, G. G. (1999) Computing Euler angles from a rotation matrix. Report. http://gregslabaugh.name/publications/euler.pdf
Svensen, J. F. M. (1998). GTM:The Generative Topographic Mapping. Ph. D. thesis, Aston University.
Thurstone, L. L. (1931). Multiple factor analysis.Psychological Review 38(5), 406–427.
Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological) 58(1), 267–288.
Vigneau, E. and Qannari E. M. (2003). Clustering of variables around latent compo- nents. Communications in statistics. Simulation and computation 32(4), 1131–1150.
Vines, S. K. (2000). Simple principal components. Applied Statistics 49(4), 441–451.
Watson, G. S. (1986). The shape of a random sequence of triangles. Advances in Applied Probability 18(1), 156–169.
Whittaker, J. (1990). Graphical Models in Applied Multivariate Statistics. Wiley.
Witten, D. M., Hastie T. and Tibshirani R. (2009). A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis.
Biostatistics 10(3), 515–534.
Zou, H., Hastie T. and Tibshirani R. (2006). Sparse principal component analysis.