Aside

Contact

Skills

Programming:

Psychometrics:

Data Analysis:

Disclaimer

Made with the R package pagedown.

Last updated on 2021-08-29

Main

W. Jake Thompson, PhD

Psychometrician & R Developer

Education

Ph.D., Educational Psychology

University of Kansas

Lawrence, KS

2018 - 2014

  • Dissertation: “Evaluating Model Estimation Processes for Diagnostic Classification Models”
  • Advisor: Neal Kingston
  • Emphasis: Research, Evaluation, Measurement, and Statistics

B.S., Behavioral Neuroscience

University of Kansas

Lawrence, KS

2014 - 2010

  • Honors Thesis: “Dissociating Cognitive and Affective Empathy in Unipolar Depression”
  • Advisor: Evangelia G. Chrysikou
  • Minor: Social and Behavioral Sciences Methodology
  • Highest Distinction, with University and Departmental Honors

Employment

Accessible Teaching, Learning, and Assessment Systems (ATLAS), University of Kansas

Senior Psychometrician

Lawrence, KS

present - August 2014

Position History

  • Senior Psychometrician (April 2019–present)
  • Psychometrician (April 2018–April 2019)
  • Assistant Psychometrician (January 2016–April 2018)
  • Graduate Research Assistant (August 2014–January 2016)

Jake Thompson Consulting

Statistical Consultant

Kansas City, KS

present - January 2015

  • Provide statistical and methodological consultations
  • Selected projects include: analyzing data for research labs at the University of Kansas Medical Center; providing recommendations for the implementation of evidence centered design to the National Council of State Boards of Nursing; estimating growth projecions for JNA Advertising.

Publications

20 years of research in educational measurement

Thompson, W. J. (2021). 20 years of research in educational measurement [Cover graphic]. Educational Measurement: Issues and Practice, 40(2). https://doi.org/10.1111/emip.12348

N/A

2021

New approaches to designing and administering inclusive assessments

Karvonen, M., Kingston, N. M., Wehmeyer, M. L., & Thompson, W. J. (2020). New approaches to designing and administering inclusive assessments. Oxford research encyclopedia of education (pp. 1–23). Oxford University Press. https://doi.org/10.1093/acrefore/9780190264093.013.1182

N/A

2020

Measuring the reliability of diagnostic mastery classifications at multiple levels of reporting

Thompson, W. J., Clark, A. K., & Nash, B. (2019). Measuring the reliability of diagnostic mastery classifications at multiple levels of reporting. Applied Measurement in Education, 32(4), 298–309. https://doi.org/10.1080/08957347.2019.1660345

N/A

2019

Construct irrelevance

Thompson, W. J. (2018). Construct irrelevance. In B. B. Frey (Ed.) The SAGE encyclopedia of educational research, measurement, and evaluation (pp. 375–376). SAGE. https://doi.org/10.4135/9781506326139.n143

N/A

2018

Evaluating model estimation processes for diagnostic classification models

Thompson, W. J. (2018). Evaluating model estimation processes for diagnostic classification models (Publication No. 10785604) [Doctoral dissertation, University of Kansas]. ProQuest Dissertations and Theses Global. https://doi.org/10.31237/osf.io/vke5u

N/A

N/A

Visualizing different levels of compensation in multidimensional item response theory

Thompson, W. J. (2017). Visualizing different levels of compensation in multidimensional item response theory [Cover graphic]. Educational Measurement: Issues and Practice, 36(4). https://doi.org/10.1111/emip.12177

N/A

2017

Assessing cognitive and affective empathy through the Interpersonal Reactivity Index: An argument against a two-factor model

Chrysikou, E. G. & Thompson, W. J. (2016). Assessing cognitive and affective empathy through the Interpersonal Reactivity Index: An argument against a two-factor model. Assessment, 23(6), 769–777. https://doi.org/10.1177/1073191115599055

N/A

2016

Dynamic assessment routing

Thompson, W. J., Nash, B., Clark, A. K., & Karvonen, M. (2016). Dynamic assessment routing [Featured graphic]. Educational Measurement: Issues and Practice, 35(2), 33. https://doi.org/10.1111/emip.12114

N/A

N/A

Dissociating cognitive and affective empathy in unipolar depression

Thompson, W. J. (2014). Dissociating cognitive and affective empathy in unipolar depression [Undergraduate thesis, University of Kansas]. PsyArXiv. https://doi.org/10.31234/osf.io/hqjct

N/A

2014

Conference Presentations

The I-SMART project: Empirical map validation

Hoover, J. C., Thompson, W. J., Nash, B., & Kobrin, J. (2021, June 8–11). The I-SMART project: Empirical map validation [Paper presentation]. National Council on Measurement in Education Annual Meeting, Virtual Conference.

N/A

2021

Technical evidence for diagnostic assessments

Thompson, W. J., Clark, A. K., & Nash, B. (2021, June 8–11). Technical evidence for diagnostic assessments. In W. J. Thompson (Chair), Diagnostic assessments: Moving from theory to practice [Symposium]. National Council on Measurement in Education Annual Meeting, Virtual Conference. [PDF]

N/A

N/A

Developing and refining a model for measuring implementation fidelity for an instructionally embedded assessment system

Kobrin, J., Karvonen, M., Burnes, J., Thompson, W. J., & Clark, A. K. (2021, April 9–12). Developing and refining a model for measuring implementation fidelity for an instructionally embedded assessment system [Poster presentation]. American Educational Resarch Association Annual Meeting, Virtual Conference. [PDF]

N/A

N/A

Model fit for diagnostic classification models

Thompson, W. J. & Hoover, J. C. (2020, June 2–3). Model fit for diagnostic classification models [Paper presentation]. Modern Modeling Methods Conference, University of Connecticut, Storrs, CT. (Conference canceled)

N/A

2020

Diagnostic assessment: DIF detection from binary and aggregate mastery classifications

Hoover, J. C., Thompson, W. J., Clark, A. K., & Nash, B. (2020, April 16–20). Diagnostic assessment: DIF detection from binary and aggregate mastery classifications [Paper presentation]. National Council on Measurement in Education Annual Meeting, San Francisco, CA. (Conference canceled)

N/A

N/A

Comparing reliability methods for diagnostic mastery classifications

Thompson, W. J., Nash, B., & Clark, A. K. (2020, April 16–20). Comparing reliability methods for diagnostic mastery classifications [Paper presentation]. National Council on Measurement in Education Annual Meeting, San Francisco, CA. (Conference canceled)

N/A

N/A

Branding and packaging reports with R Markdown

Thompson, W. J. & Pablo, N. (2020, January 29–30). Branding and packaging reports with R Markdown [Conference session]. rstudio::conf(2020), San Francisco, CA. http://bit.ly/ratlas-rstudioconf

N/A

N/A

Empirical methods for evaluating maps

Thompson, W. J. & Nash, B. (2019, April 4–8). Empirical methods for evaluating maps: Illustrations and results. In M. Karvonen (Chair), Beyond learning progressions: Maps as assessment architecture [Symposium]. National Council on Measurement in Education Annual Meeting, Toronto, Canada. [PDF]

N/A

2019

A hierarchical IRT model for identifying group-level aberrant growth

Brussow, J. A., Skorupski, W. P., & Thompson, W. J. (2018, April 12–16). A hierarchical IRT model for identifying group-level aberrant growth [Paper presentation]. National Council on Measurement in Education Annual Meeting, New York, NY.

N/A

2018

Using simulation to evaluate retest reliability of assessment results

Nash, B., Clark, A. K., & Thompson, W. J. (2018, April 12–16). Using simulation to evaluate retest reliability of assessment results [Paper presentation]. National Council on Measurement in Education Annual Meeting, New York, NY. [PDF]

N/A

N/A

Measuring the reliability of student mastery classifications at multiple levels of reporting

Thompson, W. J., Clark, A. K., & Nash, B. (2018, April 12–16). Measuring the reliability of student mastery classifications at multiple levels of reporting [Paper presentation]. National Council on Measurement in Education Annual Meeting, New York, NY. [PDF]

N/A

N/A

A hierarchical IRT model for identifying group-level aberrant growth

Brussow, J. A., Skorupski, W. P., & Thompson, W. J. (2017, September 6–8). A hierarchical IRT model for identifying group-level aberrant growth [Poster presentation]. Conference on Test Security, Madison, WI.

N/A

2017

Creating an R package for a reproducible workflow in educational assessment

Thompson, W. J. (2017, July 4–7). Creating an R package for a reproducible workflow in educational assessment [Poster presentation canceled]. useR! – International R User Conference, Brrussels, Belgium.

N/A

N/A

Evaluating an initialization tool for student placement into a map-based assessment

Nash, B. & Thompson, W. J. (2017, April 26–30). Evaluating an initialization tool for student placement into a map-based assessment [Paper presentation]. National Council on Measurement in Education Annual Meeting, San Antonio, TX. [PDF]

N/A

N/A

Pitavastatin lowers plasma levels of COQ10 less than equipotent doses of rosuvastatin or atorvastatin

Moriarty, P. M., Sponseller, C. A., Backes, J., Ruisinger, J., Sehar, N., Denney, L., Thompson, W. J., & Wick, J. A. (2016, August 27–31). Pitavastatin lowers plasma levels of COQ10 less than equipotent doses of rosuvastatin or atorvastatin [Poster presentation]. European Society of Cardiology Congress, Rome, Italy.

N/A

2016

Pitavastatin lowers plasma levels of COQ10 less than equipotent doses of rosuvastatin or atorvastatin

Moriarty, P. M., Sponseller, C. A., Backes, J., Ruisinger, J., Sehar, N., Denney, L., Thompson, W. J., & Wick, J. A. (2016, June 2–4). Pitavastatin lowers plasma levels of COQ10 less than equipotent doses of rosuvastatin or atorvastatin [Poster presentation]. Symposium of the International Atherosclerosis Society: “Anitschkow” Days, St. Petersburg, Russia.

N/A

N/A

Dissociating cognitive and affective empathy

Thompson, W. J. & Chrysikou, E. G. (2014, April 29). Dissociating cognitive and affective empathy [Poster presentation]. University of Kansas Symposium for Undergraduate Psychology Engagement and Research, Lawrence, KS.

N/A

2014

Dissociating cognitive and affective empathy

Thompson, W. J. & Chrysikou, E. G. (2014, April 26). Dissociating cognitive and affective empathy [Conference session]. University of Kansas Undergraduate Research Symposium, Lawrence, KS.

N/A

N/A

Getting into a character’s head: The role of reading fiction vs. non-fiction in empathy

Ramey, C. H. & Thompson, W. J. (2013, November 14–17). Getting into a character’s head: The role of reading fiction vs. non-fiction in empathy [Poster presentation]. Psychonomic Society Annual Meeting, Toronto, Canada.

N/A

2013

Dissociating cognitive and affective emapthy: Implications for mood disorders

Thompson, W. J. & Chrysikou, E. G. (2013, November 14–17). Dissociating cognitive and affective emapthy: Implications for mood disorders [Poster presentation]. Psychonomic Society Annual Meeting, Toronto, Canada.

N/A

N/A

Transcranial direct current stimulation as a possible intervention tool for emotion regulation in depression

Chrysikou, E. G., Thompson, W. J., Hanson, G. K., Martin, L. E., & Ingram, R. E. (2013, June 20). Transcranial direct current stimulation as a possible intervention tool for emotion regulation in depression [Poster presentation]. Integrating Technology in Translational Research Symposium, Kansas City, MO.

N/A

N/A

Color pleasantness modulated by physiological arousal

Thompson, W. J., Burda, K., Jamison, A., & Supica, D. (2013, May 7). Color pleasantness modulated by physiological arousal [Poster presentation]. University of Kansas Symposium for Undergraduate Psychology Engagement and Research, Lawrence, KS.

N/A

N/A

Performance, competency, and career level among physicians in a treatment program

Gorey, C. M., Thompson, W. J., Vickers, K. L., Williams, M. V., & Williams, B. W. (2013, April 18–20). Performance, competency, and career level among physicians in a treatment program [Poster presentation]. Federation of State Medical Boards Annual Meeting, Boston, MA.

N/A

N/A

Competency, diagnosis, and career level among physicians in a treatment program

Williams, B. W., Gorey, C. M., Thompson, W. J., Vickers, K. L., & Williams, M. V. (2013, April 18–20). Competency, diagnosis, and career level among physicians in a treatment program [Poster presentation]. Federation of State Medical Boards Annual Meeting, Boston, MA.

N/A

N/A

Technical Reports

The impact of COVID-19

Clark, A. K., Thompson, W. J., Kobrin, J., Kavitsky, E., & Karvonen, M. (2021). The impact of COVID-19: Validity considerations and scoring and reporting in flexible scenarios (Project Brief No. 21-01). University of Kansas; Accessible Teaching, Learning, and Assessment Systems. [PDF]

N/A

2021

Reliability for the Dynamic Learning Maps assessments

Thompson, W. J. (2020). Reliability for the Dynamic Learning Maps assessments: A comparison of methods (Technical Report No. 20-03). University of Kansas; Accessible Teaching, Learning, and Assessment Systems. [PDF]

N/A

2020

Bayesian psychometrics for diagnostic assessments

Thompson, W. J. (2019). Bayesian psychometrics for diagnostic assessments: A proof of concept (Research Report No. 19-01). University of Kansas; Accessible Teaching, Learning, and Assessment Systems. https://doi.org/10.35542/osf.io/jzqs8

N/A

2019

Instructionally embedded assessment

Clark, A. K., Thompson, W. J., & Karvonen, M. (2019). Instructionally embedded assessment: Patterns of use and outcomes (Technical Report No. 19-01). University of Kansas; Accessible Teaching, Learning, and Assessment Systems. [PDF]

N/A

N/A

Assessing model fit for the Dynamic Learning Maps alternate assessment using a Bayesian estimation

Thompson, W. J. (2018). Assessing model fit for the Dynamic Learning Maps alternate assessment using a Bayesian estimation (Technical Report No. 18-01). University of Kansas; Accessible Teaching, Learning, and Assessment Systems. [PDF]

N/A

2018

R Packages

taylor: Lyrics and song data for Taylor Swift’s discography

Thompson, W. J. (2021). taylor: Lyrics and song data for Taylor Swift’s discography. https://taylor.wjakethompson.com

N/A

2021

dlmr: The Dynamic Learning Maps psychometric operational workflow

Thompson, W. J. (2020). dlmr: The Dynamic Learning Maps psychometric operational workflow.

N/A

2020

jayhawkdown: A bookdown template for University of Kansas dissertations

Thompson, W. J. (2020). jayhawkdown: A bookdown template for University of Kansas dissertations. https://jayhawkdown.wjakethompson.com

N/A

N/A

rstandlm: Bayesian psychometrics for Dynamic Learning Maps

Thompson, W. J. (2020). rstandlm: Bayesian psychometrics for Dynamic Learning Maps.

N/A

N/A

wjake: Personal r package for miscellaneous themes, templates, and functions

Thompson, W. J. (2020). wjake: Personal r package for miscellaneous themes, templates, and functions.

N/A

N/A

ratlas: ATLAS formatting functions and templates

Thompson, W. J., Pablo, N., & Hoover, J. (2020). ratlas: ATLAS formatting functions and templates. https://ratlas.netlify.app

N/A

N/A

Tutorials and Workshops

Tidy data science with the Tidyverse and Tidymodels

Thompson, W. J. (2021, June 14–18). Tidy data science with the Tidyverse and Tidymodels [Workshop]. Stats Camp: Summer Statistical Institute, hosted by the Achievement and Assessment Institute, University of Kansas, Lawrence, KS. https://tidyds-2021.wjakethompson.com

N/A

2021

Using R for item response theory

Thompson, W. J. (2020, February 24). Using R for item response theory [Guest lecture]. In N. Kingston (Instructor), Item response theory [EPSY 922]. Department of Educational Psychology, University of Kansas, Lawrence, KS. https://github.com/wjakethompson/r-irt

N/A

2020

Tidy data science

Thompson, W. J. (2019, May 20–24). Tidy data science [Workshop]. Stats Camp: Summer Statistical Institute, hosted by the Center for Research Methods and Data Analysis and the Achievement and Assessment Institute, University of Kansas, Lawrence, KS. https://tidy-ds.wjakethompson.com

N/A

2019

Psychometric considerations for learning maps-based assessments

Thompson, W. J., Nash, B., & Clark, A. K. (2019, February 22). Psychometric considerations for learning maps-based assessments [Invited talk]. Educational Psychology Proseminar, University of Kansas, Lawrence, KS. https://www.wjakethompson.com/talk/2019-02-22-epsy896-proseminar/

N/A

N/A

Introduction to ggplot2

Thompson, W. J. (2017, March 1). Introduction to ggplot2 [Tutorial]. In P. E. Johnson (Instructor), Statistical computing [POLS 909]. Department of Political Science, University of Kansas, Lawrence, KS. https://github.com/wjakethompson/pols-909-ggplot2

N/A

2017

Data visualization using ggplot2

Thompson, W. J. (2016, October 10). Data visualization using ggplot2 [Tutorial]. Research, Evaluation, Measurement, and Statistics graduate seminar, University of Kansas, Lawrence, KS. https://github.com/wjakethompson/ggplot2-seminar-talk

N/A

2016

Statistical analysis in sports

Thompson, W. J. (2015, October 9). Statistical analysis in sports [Invited talk]. Research, Evaluation, Measurement, and Statistics graduate seminar, University of Kansas, Lawrence, KS. https://speakerdeck.com/wjakethompson/statistical-analysis-in-sports

N/A

2015

Data manipulation in R

Thompson, W. J. (2015, October 7). Data manipulation in R: Using and transforming your data [Tutorial]. Center for Educational Testing and Evaluation, University of Kansas, Lawrence, KS.

N/A

N/A

Data mining in R

Thompson, W. J. (2015, September 30). Data mining in R: Answering questions about your data [Tutorial]. Center for Educational Testing and Evaluation, University of Kansas, Lawrence, KS.

N/A

N/A

Using transcranial direct current stimulation for the treatment of mood disorders

Thompson, W. J. & Chrysikou, E. G. (2013, November 22). Using transcranial direct current stimulation for the treatment of mood disorders [Invited talk]. Hoglund Brain Imaging Center Neuroimaging Journal Club, University of Kansas Medical Center, Kansas City, MO. https://speakerdeck.com/wjakethompson/using-transcranial-direct-current-stimulation-for-the-treatment-of-mood-disorders

N/A

2013

Awards

Currently Funded Grants

  • Principal Investigator: Improving Software and Methods for Estimating and Evaluating Diagnostic Classification Models (2021–2023). USED, Institute of Education Sciences; $225,000.
  • Other Personnel: Innovations in Science Map, Assessment, and Reporting Technology (I-SMART) (2016–2020). USED, Office of Elementary and Secondary Education. PI: Meagan Karvonen.

N/A

Grants Under Review

  • Advisor: Data-driven, Accelerated Academic Recovery (DAAR) for Students with Significant Cognitive Disabilities (2022–2025). USED, Institute of Education Sciences. PI: Meagan Karvonen.

N/A

Unfunded Grants

  • Principal Investigator: Improving Software and Methods for Estimating and Evaluating Diagnostic Classification Models (2020–2022). USED, Institute of Education Sciences; $225,000.

N/A

Professional Awards

  • Educational Measurement: Issues and Practice Cover Showcase Winner (2020)
  • Educational Measurement: Issues and Practice Cover Showcase Winner (2017)
  • Educational Measurement: Issues and Practice Cover Showcase Top 10 (2016)
  • Chancellor’s Doctoral Fellowship (2014–2018)
  • University of Kansas Department of Psychology Best Honors Thesis (2014)
  • Outstanding Research by an Undergraduate in Psychology (2014)
  • Dane G. Hansen Leader of Tomorrow Scholarship (2010–2014)

N/A

Service

Institutional Service

  • University of Kansas
    • Research Technology working group (2021)

N/A

Professional Affiliations

  • American Educational Research Association (2015–present)
    • Division D: Measurement and Research Methodology
    • SIG: Cognition and Assessment
  • American Statistical Association (2019–present)
    • Sections: Bayesian Statistical Science, Statistical Computing, Statistics in Sports
  • National Council on Measurement in Education (2015–present)
    • SIGIMIE: Diagnostic Measurement (2020–present)
    • Student Representative, Diversity and Testing Committee (2015)

N/A

Reviewer

  • Behaviormetrika (2019–present)
  • International Journal of Research in Education and Science (2019–present)
  • Journal of Open Source Software (2019–present)
  • National Council on Measurement in Education annual meeting (2019–present)
  • American Educational Research Association, Division H, Outstanding Publications (2019)

N/A