BITSS

Gave a talk in my dept. on the OSF transition. I wrote up a rough script of the session, which could be of interest to others. I synthesize existing resources and provide my own perspectives. Comments and corrections welcome! zenodo.org/records/2306...

📣 1 more month to apply to present at the 2027 BITSS Annual Meeting! Our annual conference on research transparency welcomes submissions on metascience, novel research methods, LLMs in science, and other topics related to research rigor. Apply by Nov 1: cega.submittable.com/submit/36737...

Nature research paper: Reimagining research papers as interactive and reliable AI agents go.nature.com/4huaJ3I

It only took us 5 years, but I4R finally has a newsletter. 🎉 We’ll use it to share new studies, Replication Games, research, events, podcasts, and other updates from the Institute for Replication. Subscribe here: www.i4replication.org/newsletter

1/ What is the prevalence of personally identifiable information (PII) in author-collected data publicly shared in the social sciences? We audited 327 replication packages from 11 leading journals in economics, political science, and psychology Answer: surprisingly high 🧵

2027 BITSS Annual Meeting call for speakers is open until Nov 1! The BITSS AM is a conference that convenes academic researchers, donors, and policymakers to discuss research transparency, rigor, methods, and ethics. 🗓️ Fri, Feb 26, 2027 📍Berkeley, CA Apply: cega.submittable.com/submit/36737...

In today's blog, @jacobuscilliers.bsky.social has a guest post on how to properly test for attrition in RCTs, and issues to consider when you have strata, clustered trials, and potentially many baseline variables to test balance over blogs.worldbank.org/en/impacteva...

"Code underlying published findings in the social sciences often fails to reproduce reported results when others re-run it on the original data." See the opinion piece with 4 ways to improve computational reproducibility by team w/ non-resident BITSS scholar Garret Christensen rdcu.be/gqvVA7iZHYma

Did you check out our Reproducibility 2026 conference program yet? 👀 We have three great sessions packed with keynotes, journal clubs, and opportunities to connect and discuss reproducibility. Here are some highlights from the program:

📢 COS seeks volunteers for the Transparency & Openness Promotion (TOP) Advisory Board The Board provides guidance and oversight for the TOP Guidelines—a policy framework designed to increase the verifiability of empirical research Apply or nominate a colleague by Sept. 21:

📣 New BITSS blog post: José Daniel Conejeros and Magdalena Gatsch share their reflections on open science in Latin America. www.bitss.org/the-gap-is-n...

How can forecasts make experiments better? See the new VoxDev piece by @sdellavi.bsky.social and @evavivalt.bsky.social sharing findings from 100 projects on the SSPP (@socscipredict.bsky.social): voxdev.org/topic/educat...

New BITSS blog post: what can we learn from open science as researchers adopt AI tools? www.bitss.org/research-gra...

New preprint on MetaArXiv with lessons learned from the Brazilian Reproducibility Initiative. What was learned from a nationwide project assessing the replicability of biomedical experiments? osf.io/preprints/me...

Registered Reports improve the credibility of scientific claims by rewarding big questions, sound methods and solid analyses. They need to become a standard tool in research. go.nature.com/4dP1rwk

Many thanks to our speakers for a successful BITSS Annual Meeting! One of our main take-aways was the tension between using LLMs in research and reproducibility. Reproducibility remains an important issue in research, and this is a topic we think is important to pay attention to.

It was great to see so much innovative work at the @ucbitss.bsky.social Annual Meeting today. Thanks to Abhishek Nagaraj for the mention, I’m looking forward to continuing the discussion on using AI to advance open science! x.com/abhishekn/st...

Data Aggregation: Unlocking the Full Value of Development Evidence This post was written by Jo Weech, Research Transparency Program Manager at BITSS, and Liz Brown, Staff Scientist at CEGA and lead of...

We're looking forward to the BITSS Annual Meeting next Thursday, April 16! Devon Crawford from the NIH will be our keynote speaker + the event will feature a panel on integrating AI into social science research. There's still room to register and we hope to see you there! forms.gle/xAtL53UJDG2u...

SCORE, a collaboration of 865 researchers, is now released as three papers in Nature, six preprints, and a lot of data (cos.io/score/). SCORE examined repeatability of findings from the social-behavioral sciences and tested whether human and automated methods could predict replicability.

Join us for MeasureDev 2026! 📊 The 2026 Measuring Development Conference (MeasureDev) will chart a path forward for research transparency and reproducibility in light of recent technological advancements. Learn more: go.cega.org/measuredev-2026

Thrilled to announce Devon Crawford, Program Director of the Office of Research Quality at NIH NINDS, as the Keynote Speaker for the BITSS AM! Join us Thurs, April 16 to hear from Devon and from experts using LLMs to advance research transparency. Registration: www.bitss.org/events/bitss...

Thank you @sci-integrity.com for featuring BITSS in the latest REACH issue! Honored to be referenced on page 6, along with other recipients of the Einstein Foundation Award 👏

Excited to share the agenda for the next BITSS Annual Meeting! Join us April 16 in Berkeley for presentations on AI in research, open science, and data quality. www.bitss.org/events/bitss...

Register for the BITSS Annual Meeting! 📊 Join @ucbitss.bsky.social and the Institute for Business and Social Impact on April 16 to explore how to improve the credibility of social science research by promoting transparency, rigor, and reproducibility. Register: go.cega.org/BITSSmeeting-2026

📢 Launching the Sustainable Evidence Infrastructure Commitment — a global effort to strengthen how impact evaluation evidence is produced, shared and used. 🤝 Signatories: @cega-uc.bsky.social, COS, IDinsight, @ifpri.org, 3ie and PIRC. Read commitment: bit.ly/4aqj5WA Why it matters: bit.ly/4aLQxWG

Hiring a pre-doc! Please circulate in your networks and apply here: evavivalt.com/2026/02/pre-...

Are you a researcher in the social sciences? Join @ucbitss.bsky.social on May 19-21 for its Research Transparency and Reproducibility (RT2) Training to explore tools and best practices for upholding transparency in social science research. Apply by February 8: go.cega.org/RT2-2026

Last week to apply to present at the BITSS AM! Our call for speakers closes Sunday, Jan 18. Join us at UC Berkeley for a conversation on open science, research methods, and changes in academic publishing - it's our favorite day of the year. Apply here: cega.submittable.com/submit/34250...

It has been a while since @flavioazevedo.bsky.social asked me to take over the Reversals project at @forrt.bsky.social... It has since evolved beyond my wildest dreams, mostly thanks to @aufdroeseler.bsky.social & @lukaswallrich.bsky.social. We are very proud of the Replication Hub & Database ♥️

A short preprint describing our adoption of more consistent and precise use of terminology related to reproducibility, robustness, replicability, repeatability, and credibility. osf.io/preprints/me...

📣 Our call for speakers is open! Please submit presentations for the BITSS Annual Meeting on April 16 in Berkeley. We are looking for submissions on open science tools and practices, academic publishing, and the impact of AI on research. Apply by Jan 18: cega.submittable.com/submit/34250...

🚨 New working paper! How well do people predict the results of studies? @sdellavi.bsky.social and I leverage data from the first 100 studies to have been posted on the SSPP, containing 1,482 key questions, on which over 50,000 forecasts were placed. Some surprising results below.... 🧵👇

🔊 the call for speakers for the next BITSS Annual Meeting is open! Please submit your papers or projects on research transparency, open science, ethics, reproducibility, peer review, or the impact of AI on academic publishing. Submit here by Sunday, January 18: cega.submittable.com/submit/34250...

We proudly present the winners of the #EinsteinFoundationAward for Promoting Quality in Research 2025! The jury has selected outstanding contributions that promote research quality around the world! In coop w/ QUEST Center @bihatcharite.bsky.social www.einsteinfoundation.de/presse/2025/... (1/5)

🗓️ Save the date: The next BITSS Annual Meeting is April 16, 2026! The conference will gather experts to discuss changes in academic publishing, AI, and current challenges to research transparency. @cega-uc.bsky.social @tedmiguel.bsky.social

🚀 Applications are OPEN for the 2nd round of the ORCA Catalytic Awards! With support from the @chanzuckerberg.bsky.social ORCA is offering $15,000 per project to grow a culture of #OpenScience #OpenScholarship at traditionally under-resourced U.S. institutions. 🔗 Learn more: orcaopen.org/work/cap

Join R4E for a workshop on Wednesday, October 8, 2025, at 10 AM ET / 3 PM CET. Topics include Data Management, Reagent Sharing, Bioinformatics, Microscopy, Statistics, and Data & Code Sharing, Analysis, and Visualization. #AcademicTwitter Registration here:

1 week left to apply for funding for a research transparency workshop! BITSS is offering small-scale grants for researchers to run open science trainings or projects out of their home institutions 📚 Apply by Sept 30: cega.submittable.com/submit/33435...

Are you a social science researcher interested in advancing open science? @ucbitss.bsky.social is accepting applications for the BITSS Catalyst Program. Funding is available to develop a workshop, guidelines, or other open science materials. Apply by Sept 30th: go.cega.org/BITSScatalyst25

📣 Interested in making more forecasts? Want to get paid for doing so? Apply for the SSPP Forecasting Panel! Panelists receive $400 a year + a $300 bonus for high accuracy. Apply here: socialscienceprediction.org/predict/r/09... @cega-uc.bsky.social @evavivalt.bsky.social @sdellavi.bsky.social

📢 Want to run a research transparency workshop at your home institution? Looking for funding for an open science project? Apply for BITSS Catalyst funding by September 30! cega.submittable.com/submit/33435...

Scientists overwhelmingly recognize the value of sharing null results, but rarely publish them in the research literature go.nature.com/450KElr

🔍 How can we make research more reproducible? @ucbitss.bsky.social’s RT2 program offers a step towards #openscience. This year’s cohort convened 28 early-career researchers to learn how to make their research more transparent + credible. 🔗 Learn more: go.cega.org/2025BITSSRT2

New short meta-survey on the SSPP: can you predict how well people predict? Try your hand at it: socialscienceprediction.org/predict/r/0f... @socscipredict.bsky.social @sdellavi.bsky.social