Top 2 Psyarxiv Papers Today in Meta-Science


2.021 Mikeys
#1. Evaluating the Evidential Value of Empirically Supported Psychological Treatments (ESTs): A Meta-Scientific Review
MaRSS Lab, John Kitchener Sakaluk, Alexander Williams, Robyn Kilshaw, Kathleen T. Rhyner
Empirically supported treatments (or therapies; ESTs) are the gold standard in therapeutic interventions for psychopathology. Based on a set of methodological and statistical criteria, the APA has assigned particular treatment-diagnosis combinations EST status and has further rated their empirical support as Strong, Modest, and/or Controversial. Emerging concerns about the replicability of research findings in clinical psychology highlight the need to critically examine the evidential value of EST research. We therefore conducted a meta-scientific review of the EST literature, using clinical trials reported in an existing online APA database of ESTs, and a set of novel evidential value metrics (i.e., rates of misreported statistics, statistical power, R-Index, and Bayes Factors). Our analyses indicated that power and replicability estimates were concerningly low across almost all ESTs, and individually, some ESTs scored poorly across multiple metrics, with Strong ESTs failing to continuously outperform their Modest counterparts....
more | pdf
Figures
Tweets
JohnSakaluk: Dear Clinical/Replicability/#clinicalOSlist friends, stay awhile and listen about our forthcoming review of the evidential value for lit. of APA Div.12 Empirically Supported Treatments (ESTs), with colleagues @williamspsych, @kilshaw_r, and Rhyner https://t.co/GBepltXd9o 1/16
TimDalgleish: "..our analyses suggest that in many cases, we do not have a Dodo bird, but rather a don’t know bird." Important meta-scientific view on the (dubious) status of the evidence for Empirically Supported Therapies for mental health problems from @JohnSakaluk https://t.co/v45ULaxxKM https://t.co/3lbPSnVgd0
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 5
Total Words: 7954
Unqiue Words: 2924

1.996 Mikeys
#2. SRCD 2019 Workshop - Tools for Improving the Transparency and Replicability of Developmental Research
Grace Binion, Jack Arnal, Benjamin T. Brown, Pamela Davis-Kean, Melissa Kline
The field of psychology has increased focus on factors which influence the robustness and replicability of psychological research, illuminating practices which individual investigators might adopt to improve the credibility of their research. These practices include the pre-registration of study design and analytic plans, sharing of study materials, sharing study data, and the circulation of preprints. In service of facilitating adoption of these practices, several tools have been developed to support them. These tools, however, were largely developed by and for investigators in areas of psychology which do not share the same concerns and constraints as developmental scientists, including longitudinal data collection and data collection with sensitive populations. Given this, features of these tools which accommodate more complex study design, revision, and protections where appropriate are poorly advertised. Further, there exists little formalized instruction in the use of these tools and thus their functionality remains poorly...
more | pdf
Figures
None.
Tweets
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 5
Total Words: 0
Unqiue Words: 0

About

Assert is a website where the best academic papers on arXiv (computer science, math, physics), bioRxiv (biology), BITSS (reproducibility), EarthArXiv (earth science), engrXiv (engineering), LawArXiv (law), PsyArXiv (psychology), SocArXiv (social science), and SportRxiv (sport research) bubble to the top each day.

Papers are scored (in real-time) based on how verifiable they are (as determined by their Github repos) and how interesting they are (based on Twitter).

To see top papers, follow us on twitter @assertpub_ (arXiv), @assert_pub (bioRxiv), and @assertpub_dev (everything else).

To see beautiful figures extracted from papers, follow us on Instagram.

Tracking 100,376 papers.

Search
Sort results based on if they are interesting or reproducible.
Interesting
Reproducible
Feedback
Online
Stats
Tracking 100,376 papers.