James Lamiell and Kate Slaney (Eds.) have published their new book, Problematic Research Practices and Inertia in Scientific Psychology: History, Sources, and Recommended Solutions. There are chapters on statistics, measurement, psychologists’ distaste for criticism, and the struggle to understand persons using aggregate methods. We have a chapter in which we use OOM to analyse data from a study on Dissociative Identity Disorder. We also address strategies to help connect mainstream researchers to OOM the ideas expressed in Lamiell and Slaney’s book.
Persons as Effect Sizes Paper
The Personality Lab at OSU has published a paper titled “Persons as Effect Sizes” in Advances in Methods and Practices in Psychological Science. In this paper we demonstrate how OOM methods are used to answer the question “How many people in my study behaved or responded in a manner consistent with theoretical expectation?”
Realism article in Theory & Psych
Dr. Frank Arocha has just published an article on scientific realism in the journal Theory & Psychology. The title of the article is: Scientific Realism and the Issue of Variability in Behavior. Here’s a link to the abstract:
https://journals.sagepub.com/doi/full/10.1177/0959354320935972
The paper is broad in scope and offers a clear exposition of important issues facing modern psychologists and how we might move forward from a realist perspective. This will be required reading in my courses at OSU.
New Version Available
A new version of the OOM software has been uploaded. A number of minor bugs have been removed from the program, and a new option for generating data from proportions and frequencies (contingency tables) has been added. A video demonstrating this new feature has been uploaded to the Instructional Videos page (see link to the right, or click here). Two new videos for editing multigrams have also been added.
Bacon’s Idols
Here
West Texas A&M Visit
A sincere word of thanks to the faculty and staff of West Texas A&M University for hosting a talk on OOM last Friday, February 14th. I am particularly appreciative of John Richeson (an OSU alumnus!) and Mark Garrison for making the visit possible. West Texas A&M is growing and has a strong core of faculty…and, as a personally relevant fact, the university has an outstanding bowling program!
“N of 1” Article
Thanks to Mark Garrison for the link to this N of 1 article. Science is the search for the causal structure of the world, and the history of science shows clearly that, while randomized trials can be useful, they are not necessary to gain such causal knowledge.
A Cautionary Paper on Complex Models
Thanks to Paul Barrett for alerting us to this newly published paper: Saylors, R., & Trafimow, D. (2020). Why the increasing use of complex causal models is a problem: On the danger sophisticated theoretical narratives pose to truth. Organizational Research Methods (https://doi.org/10.1177/1094428119893452 ), In Press, , 1-14. [paywall]
As pointed out by the authors, “As use of complex models increases, the joint probability a published model is true decreases.”
The paper comes with a calculator to compute said probability:
https://practiceoftheory.weebly.com/a-causal-models-probability-of-being-true.html
An analogous concern in OOM is that as a path model increases in complexity, fewer and fewer individuals will be traceable through the model. It is easy to imagine a complex path model in which not a single person can be accurately traced through all of the links. What use would such a model be as an explication of causes and effects? Of course, this information can only be known if the researcher attempts to perform such person-centered analyses.
2019 Posts
- October 27th, 2019. A special thanks to Chris Cunningham at the University of Tennessee-Chattanooga for his invitation to present at the 15th Annual River Cities I-O (RCIO) Psychology Conference, October 25-26, 2019. I was to present a talk titled “Person-centered data analyses: Observation Oriented Modeling as an alternative and rational data analytics approach.” Unfortunately, due to illness I was not able to attend, and our attempts to present via the internet were not successful. The Powerpoint slides are nonetheless available upon request.
- Congratulations (!) to Valentine, Buchanan, Scofield, and Beauchamp on the publication of their paper “Beyond p values: Ultilizing multiple methods to evaluate evidence” published in
2018 Posts
- October 15th, 2018. A special thanks to Kevin Weinfurt and the faculty and staff at Duke University Medical School, Department of Population Health Sciences for hosting two talks and a workshop on OOM! I am also particularly grateful for the commentary of Daniel Mark and Rick Hoyle, and the discussion time with Bryce Reeve, Patrick Curran, and others. With his permission, I’ve uploaded Rick Hoyle’s Powerpoint slides here for viewing.
- July 17th, 2018. A special thanks to Elizabeth McClure from the Lego Foundation. She visited my lab at Oklahoma State University this week to study OOM with the hopes of bringing more person-centered methods to projects sponsored by the foundation.
- May 15th, 2018. Congratulations to David Trafimow and many other authors for their paper titled: Manipulating the alpha level cannot cure significance testing online in Frontiers in Psychology (Quantitative Psychology and Measurement). We published this paper in response to arguments for lowering the standard p-critical value from .05 to .005 as a way to improve psychological research and to help cure the replication problem in psychology. As we have argued extensively in our OOM papers, NHST should largely be abandoned and replaced with integrated modeling, non-parametric (pattern-based) types of analyses, randomization tests, and — of course — exact replication.
- April 14th, 2018. Congratulations to Eliwid Medellin who presented a poster at the 64th annual meeting of the Southwestern Psychological Association in Houston, TX! Here’s his poster titled Logical Hypothesis Testing. He reports results from two studies showing how logical combinations can be evaluated in OOM. Eliwid was also selected as the Student of the Month for May of 2018. Congratulations, Eliwid!
- April 14th, 2018. Congratulations to Meggie Baker who presented a poster at the 64th annual meeting of the Southwestern Psychological Association in Houston, TX! Here’s her poster titled Person-Centered Methods for Personality Profiling. She reports results from her summer project from OSU’s American Indians Into Psychology program at OSU. Her study examined the use of the Ordinal Analysis option in OOM to detect group personal profiles.
- March 23rd, 2018. A sincere thank-you to the faculty, students, and staff of Baylor University! A particular word of gratitude to Alex Beaujean, who orchestrated my visit during which I delivered a talk and short workshop on the OOM software. It was a pleasure meeting the wonderful faculty, and it was an honor to visit Baylor University and Waco, Texas!
- March 3rd, 2018. I presented a brief talk titled: Methodological Incorrigibility and its Cost to Innovation. I presented at the 9th Midwinter Meeting of the Society for Theoretical and Philosophical Psychology, Phoenix, AZ. March 3rd, 2018. My talk was part of a symposium titled: Scientific Psychology
