BOOK REVIEW article

Front. Psychol., 15 April 2020

Sec. Quantitative Psychology and Measurement

Volume 11 - 2020 | https://doi.org/10.3389/fpsyg.2020.00606

Book Review: Modern Psychometrics With R

  • 1. IPN – Leibniz Institute for Science and Mathematics Education, Kiel, Germany

  • 2. Centre for International Student Assessment (ZIB), Kiel, Germany

Article metrics

View details

4,8k

Views

1k

Downloads

The book “Modern Psychometrics with R” by Patrick Mair provides extensive information about recent R (R Core Team, 2020) implementations of psychometric models. The book follows a broad definition of psychometrics in order to meet “the statistical needs of modern measurement” and exceeds the standard definition of psychological measurement (Mair, 2018, p. v). The author admits that several uncommon topics are included in the book, and the strength of the book is in its discussion of a broad range of R packages. The author has extensive expertise in the R community of psychometrics and is the maintainer of the CRAN task view “Psychometrics” (Mair, 2019). The book covers 14 chapters, and in the following review, I classify the chapters into core, broadened, and uncommon psychometrics and provide a discussion of the contents. In Table 1, the titles and the R packages used in the chapters are displayed.

Table 1

ChapterPackages
1. Classical test theory (15 pages)psychc (3), lme4 (1), gtheory (189)
2. Factor analysis (46 pages)psychc (3), lavaanc (15), semTools (30), BayesFM (93)
3. Path analysis and structural equation models (31 pages)lavaanc (15), QuantPsych (43), mediation (39), nonnest2 (–)
4. Item response theory (65 pages)eRmc (64), ltmc (45), mirtc (31), lordif (97), psychotreec (49), Gifi (179), MCMCpack (21)
5. Preference modeling (17 pages)BradleyTerry2 (17), psychotreec (49), BTLLasso (96), prefmodc (58)
6. Principal component analysis and extensions (32 pages)psychc (3), elasticnet (37), multiway (112), eegkit (124)
7. Correspondence analysis (20 pages)anacorc (91), cac (25), cfa (–)
8. Gifi methods (26 pages)Gifi (179), homalsc (84), aspect (111)
9. Multidimensional scaling (31 pages)smacofc (57)
10. Biplots (23 pages)calibrate (–), bpca (92), smacofc (57), anacorc (91)
11. Networks (22 pages)igraph (–), qgraph (22), network (–), latentnet (–), bnlearn (–)
12. Parametric cluster analysis and mixture regression (30 pages)mclust (–), poLCA (36), flexmix (5), profdpm (–), tm (–), ldatuning (–), topicmodels (–)
13. Modeling trajectories and time series (43 pages)depmixS4 (–), forecast (–), strucchange (–), lmtest (–), tseries (–), fda (–), fda.usc (–)
14. Analysis of fMRI data (42 pages)fmri (–), AnalyzeFMRI (74), ggBrain (–), brainR (–), RNiftyReg (–), class (–), multcomp (–), mmand (–), brainwaver (–)

Table of contents and R packages used in Mair (2018).

c

= R package contained in CRAN task view “Psychometrics” (CTVP; Mair, 2019). Numbers in parentheses after R packages are download ranks from the CRAN server in 2019 from the 221 R packages listed in the CTVP. The download statistics were obtained using the R package cranlogs (Csárdi, 2019). A hyphen (“–”) indicates that the respective package is not included in the CTVP list of R packages.

Core Psychometrics (Chapters 1–5; 174 pages)

In Chapter 1, the basics of classical test theory (CTT) and reliability measures are discussed, and the generalizability theory is also introduced. Chapter 2 provides an overview of exploratory and confirmatory factor analysis (CFA), as well as briefly discussing multiple-group and multilevel CFA models. Chapter 3 describes structural equation models (SEMs). Before introducing SEMs in their general form, the chapter starts with path models and (moderated) mediation models. In Chapter 4, unidimensional item response theory (IRT) models, as well as multidimensional exploratory and confirmatory IRT models, are described. The chapter also discusses differential item functioning techniques (i.e., logistic regression and tree methods). In Chapter 5, the analysis of pairwise comparisons and ranking data is considered. As an extension, in Chapters 2 to 5, longitudinal and Bayesian variants of CFA, SEM, and IRT models are discussed. In the first part of the book, the use of regularization techniques (e.g., employing the lasso penalty) is addressed only for the Bradley-Terry model in Chapter 5 (and later in Chapter 6) but could also be a valuable extension for CFA, SEM, and IRT models (see, for example, Jacobucci et al., 2016). It is my opinion that equating and linking techniques should also be recognized as part of core psychometrics (González and Wiberg, 2017).

Broadened Psychometrics (Chapters 11–13; 95 pages)

In Chapter 11, network models in which the objects can be either persons or variables are discussed, and Bayesian networks are introduced. An extension to latent variable network models (Epskamp et al., 2018) would be helpful and could be considered in a future edition of the book. Chapter 12 explains model-based clustering approaches, mainly mixture regression, latent class analysis, and Dirichlet process clustering. Although mixture latent variable models are popular in applied research, they are not mentioned in this chapter. Chapter 13 discusses techniques for longitudinal data: hidden Markov models, single-subject time series, and functional data analysis. Readers could also find developments in multiple-subject (dynamic) time series models (mainly in the software Mplus) and in continuous time models (Driver et al., 2017) interesting. In my view, broadened psychometrics should also include meta-analysis (Viechtbauer, 2010; Cheung, 2015).

Uncommon Psychometrics (Chapters 6–10, Chapter 14; 174 Pages)

Chapter 6 starts with a detailed treatment of principal component analysis. It also introduces multiway analysis and independent component analysis. In Chapter 7, simple and multiple correspondence analysis and configural frequency analysis are explained. Chapter 8 focuses on a collection of exploratory techniques that are labeled as Gifi methods. Chapters 9 and 10 give an overview of multidimensional scaling and biplot techniques, respectively. Chapter 14 explains techniques for analyzing fMRI data that are seldom found in the psychometric research literature. The techniques described in Chapters 7 to 10 are also not frequently found in psychometric and applied research, maybe due to their mainly exploratory nature.

Classical, Modern, and Future Psychometrics

To sum up, the book is a valuable and well-structured resource that forms links to a variety of R packages and, therefore, differs in content and depth from many other psychometrics books (e.g., Beaujean, 2014; Desjardins and Bulut, 2018; Paek and Cole, 2019). Given the variety of R packages used, I would have preferred the author to consistently use the package :: function notation to write the R function throughout the book1. In my opinion, a contemporary psychometrics book should put more emphasis on CTT (Nunnally and Bernstein, 1994; Meyer, 2010), CFA, and IRT models and I would like it to be more focused on design-based reliability (CTT) instead of model-based reliability (CFA and IRT models)2. The division of the book into core, broadened, and uncommon psychometrics makes it unique. However, this means that it cannot be the first choice for a companion book in an ordinary psychometrics course.

It is impressive how the R software has evolved in the last 10 years (see, for example, the lavaan and mirt packages; Chalmers, 2012; Rosseel, 2012). Given the rapid development of R packages, a new edition of this book would certainly be needed again in 10 years. In my opinion, R has made impressive progress, but R packages can still not fully compete with flexible and high-quality commercial software programs such as LatentGold or Mplus. The future will show whether equally flexible alternative open-source R packages have been developed. Maybe general-purpose software (like BUGS and its successors: Lunn et al., 2009; OpenMx: Neale et al., 2016; Stan: Carpenter et al., 2017; or TMB: Kristensen et al., 2016) might become more widespread in applied research in the future.

Statements

Author contributions

AR was responsible for the writing.

Conflict of interest

The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Footnotes

1.^If this notation is not used, function conflicts could occur if R functions with the same name occur in different (loaded) R packages. For example, Cronbach's alpha is available in several packages with a function name alpha (psych, psychometric, coefficientalpha, plspm, epiDisplay).Therefore, it makes sense to explicitly write psych::alpha if the function from the psych package is requested. Another critical example is the function name cfa that is used in the lavaan and sem package (for confirmatory factor analysis) as well as in the cfa package (for configural frequency analysis).

2.^In fact, as opposed what is frequently claimed in recent literature, CTT or generalizability theory have fewer assumptions than CFA or IRT because items are treated as random (i.e., exchangeable) in the former case while they are considered as fixed in the latter case (see Brennan, 2011).

References

  • 1

    BeaujeanA. A. (2014). Latent Variable Modeling Using R: A Step-by-Step Guide. New York, NY: Routledge. 10.4324/9781315869780

  • 2

    BrennanR. L. (2011). Generalizability theory and classical test theory. Appl. Meas. Educ.24, 121. 10.1080/08957347.2011.532417

  • 3

    CarpenterB.GelmanA.HoffmanM. D.LeeD.GoodrichB.BetancourtM.et al. (2017). Stan: a probabilistic programming language. J. Stat. Softw.76, 132. 10.18637/jss.v076.i01

  • 4

    ChalmersR. P. (2012). mirt: a multidimensional item response theory package for the R environment. J. Stat. Softw.48, 129. 10.18637/jss.v048.i06

  • 5

    CheungM. W. L. (2015). metaSEM: an R package for meta-analysis using structural equation modeling. Front. Psychol.5:1521. 10.3389/fpsyg.2014.01521

  • 6

    CsárdiG. (2019). cranlogs: Download Logs From the 'RStudio' 'CRAN' Mirror. R package version 2.1.1. Available online at: https://CRAN.R-project.org/package=cranlogs

  • 7

    DesjardinsC. D.BulutO. (2018). Handbook of Educational Measurement and Psychometrics Using R. Boca Raton, FL: Chapman & Hall. 10.1201/b20498

  • 8

    DriverC. C.OudJ. H.VoelkleM. C. (2017). Continuous time structural equation modeling with R package ctsem. J. Stat. Softw.77, 135. 10.18637/jss.v077.i05

  • 9

    EpskampS.MarisG.WaldorpL. J.BorsboomD. (2018). “Network psychometrics,” in The Wiley Handbook of Psychometric Testing: A Multidisciplinary Reference on Survey, Scale and Test Development, eds P. Irwing, T. Booth, and D. J. Hughes (New York, NY: Wiley), 953986. 10.1002/9781118489772.ch30

  • 10

    GonzálezJ.WibergM. (2017). Applying Test Equating Methods. Using R.Cham: Springer. 10.1007/978-3-319-51824-4

  • 11

    JacobucciR.GrimmK. J.McArdleJ. J. (2016). Regularized structural equation modeling. Struct. Equat. Model.23, 555566. 10.1080/10705511.2016.1154793

  • 12

    KristensenK.NielsenA.BergC. W.SkaugH.BellB. M. (2016). TMB: automatic differentiation and Laplace approximation. J. Stat. Softw.70, 121. 10.18637/jss.v070.i05

  • 13

    LunnD.SpiegelhalterD.ThomasA.BestN. (2009). The BUGS project: evolution, critique and future directions. Stat. Med.28, 30493067. 10.1002/sim.3680

  • 14

    MairP. (2018). Modern Psychometrics With R. Cham: Springer. 10.1007/978-3-319-93177-7

  • 15

    MairP. (2019). CRAN Task View: Psychometrics. Version 2019-12-13. Available online at: http://CRAN.R-project.org/view=Psychometrics

  • 16

    MeyerJ. P. (2010). Understanding Measurement: Reliability. Oxford: Oxford University Press.

  • 17

    NealeM. C.HunterM. D.PritikinJ. N.ZaheryM.BrickT. R.KirkpatrickR. M.et al. (2016). OpenMx 2.0: extended structural equation and statistical modeling. Psychometrika81, 535549. 10.1007/s11336-014-9435-8

  • 18

    NunnallyJ. C.BernsteinI. H. (1994). Psychometric Theory. New York, NY: McGraw-Hill.

  • 19

    PaekI.ColeI. (2019). Using R for Item Response Theory Applications. New York, NY: Routledge. 10.4324/9781351008167

  • 20

    R Core Team (2020). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing. Available online at: https://www.R-project.org/

  • 21

    RosseelY. (2012). lavaan: an R package for structural equation modeling. J. Stat. Soft.48, 136. 10.18637/jss.v048.i02

  • 22

    ViechtbauerW. (2010). Conducting meta-analyses in R with the metafor package. J. Stat. Softw.36, 148. 10.18637/jss.v036.i03

Summary

Keywords

psychometrics, R, classical test theory, structural equating modeling, item response modeling

Citation

Robitzsch A (2020) Book Review: Modern Psychometrics With R. Front. Psychol. 11:606. doi: 10.3389/fpsyg.2020.00606

Received

17 February 2020

Accepted

13 March 2020

Published

15 April 2020

Volume

11 - 2020

Edited and reviewed by

Stéphane Bouchard, University of Quebec in Outaouais, Canada

Updates

Copyright

*Correspondence: Alexander Robitzsch

This article was submitted to Quantitative Psychology and Measurement, a section of the journal Frontiers in Psychology

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics