Who wrote the music for In My Life? Three Bayesian analyses

A Beatles fan pointed me to this news item from a few years ago, “A Songwriting Mystery Solved: Math Proves John Lennon Wrote ‘In My Life.'” This surprised me, because in his memoir, Many Years from Now, Paul McCartney very … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 1 day ago

Bayesian Workflow, Causal Generalization, Modeling of Sampling Weights, and Time: My talks at Northwestern University this Friday and the University of Chicago on Monday

Fri 3 May 2024, 11am at Chambers Hall, Ruan Conference Room – lower level: Audience Choice: Bayesian Workflow / Causal Generalization / Modeling of Sampling Weights The audience is invited to choose among three possible talks: Bayesian Workflow: The workflow … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 2 days ago

Does this study really show that lesbians and bisexual women die sooner than straight women? Disparities in Mortality by Sexual Orientation in a Large, Prospective JAMA Paper

This recently-published graph is misleading but also has the unintended benefit of revealing a data problem: Jrc brought it up in a recent blog comment. The figure is from an article published in the Journal of the American Medical Association, … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 2 days ago

Job Ad: Spatial Statistics Group Lead at Oak Ridge National Laboratory

Robert Stewart, of Oak Ridge National Lab (ORNL), who we met at StanCon, is looking to fill the following role: ORNL Job ad: Group Leader for Spatial Statistics It’s a research group leader position with an emphasis on published research … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 3 days ago

Boris and Natasha in America: How often is the wife taller than the husband?

Shane Frederick, who sometimes sends me probability puzzles, sent along this question: Among married couples, what’s your best guess about how often the wife is taller than the husband? • 1 in 10 • 1 in 40 • 1 in … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 3 days ago

“Often enough, scientists are left with the unenviable task of conducting an orchestra with out-of-tune instruments”

Gaurav Sood writes: Often enough, scientists are left with the unenviable task of conducting an orchestra with out-of-tune instruments. They are charged with telling a coherent story about noisy results. Scientists defer to the demand partly because there is a … Continue reading … | Continue reading


@statmodeling.stat.columbia.edu | 4 days ago

Evaluating MCMC samplers

I’ve been thinking a lot about how to evaluate MCMC samplers. A common way to do this is to run one or more iterations of your contender against a baseline of something simple, something well understood, or more rarely, the … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 5 days ago

“When are Bayesian model probabilities overconfident?” . . . and we’re still trying to get to meta-Bayes

Oscar Oelrich, Shutong Ding, Måns Magnusson, Aki Vehtari, and Mattias Villani write: Bayesian model comparison is often based on the posterior distribution over the set of compared models. This distribution is often observed to concentrate on a single model even … Continue readin … | Continue reading


@statmodeling.stat.columbia.edu | 5 days ago

Whooping cough! How to respond to fatally-flawed papers? An example, in a setting where the fatal flaw is subtle, involving a confounding of time and cohort effects

Matthieu Domenech de Cellès writes: I am a research group leader in infectious disease epidemiology at the Max Planck Institute for Infection Biology in Berlin. I read your recent post on how to respond to fatally flawed papers. Here is … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 6 days ago

Population forecasting for small areas: an example of learning through a social network

Adam Connor-Sax sent this question to Philip Greengard: Do you or anyone you know work with or know about (human) population forecasting in small geographies (election districts) and short timescales (2-20 years)? I can imagine just looking at the past … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 7 days ago

GIST: Gibbs self-tuning for HMC

I’m pleased as Punch to announce our new paper, Nawaf Bou-Rabee, Bob Carpenter, and Milo Marsden. 2024. GIST: Gibbs self-tuning for locally adaptive Hamiltonian Monte Carlo. arXiv 2404.15253. We followed the mathematician alphabetical author-ordering convention. The basic idea Th … | Continue reading


@statmodeling.stat.columbia.edu | 8 days ago

For that price he could’ve had 54 Jamaican beef patties or 1/216 of a conference featuring Gray Davis, Grover Norquist, and a rabbi

It’s the eternal question . . . what do you want, if given these three options: (a) 54 Jamaican beef patties (b) 1/216 of a conference featuring a collection of washed-up business executives, academics, politicians, and hangers-on (c) A soggy … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 8 days ago

Postdoc Opportunity at the HEDCO Institute for Evidence-Based Educational Practice in the College of Education at the University of Oregon

Emily Tanner-Smith writes: Remote/Hybrid Postdoc Opportunity—join us as a Post-Doctoral Scholar at the HEDCO Institute for Evidence-Based Educational Practice in the College of Education at the University of Oregon! The HEDCO Institute specializes in the conduct of evidence synth … | Continue reading


@statmodeling.stat.columbia.edu | 9 days ago

4 ways to follow this blog

Substack. Twitter. Bluesky. The blog itself. Also, our old posts are spooling at StatRetro every three hours starting with our very first post from 2004. The blog’s in all these places because people told me they were having difficulty staying … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 9 days ago

What is your superpower?

After writing this post, I was thinking that my superpower as a researcher is my willingness to admit I’m wrong, which gives me many opportunities to learn and do better (see for example here or here). My other superpower is … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 9 days ago

Storytelling and Scientific Understanding (my talks with Thomas Basbøll at Johns Hopkins this Friday)

Fri 26 Apr, 10am in Shriver Hall Boardroom and 2pm in Hodson Hall 213 (see also here): Storytelling and Scientific Understanding Andrew Gelman and Thomas Basbøll Storytelling is central to science, not just as a tool for broadcasting scientific findings … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 10 days ago

Decorative statistics and historical records

Sean Manning points to this remark from Matthew “not the musician” White: I [White] am sometimes embarrassed by where I have been forced to find my statistics … Often, the only place to find numbers is in a newspaper article, … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 10 days ago

Now here’s a tour de force for ya

In social science, we’ll study some topic, then move on to the next thing. For example, Yotam and I did this project on social penumbras and political attitudes, we designed a study, collected data, analyzed the data, wrote it up, … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 11 days ago

Analogy between (a) model checking in Bayesian statistics, and (b) the self-correcting nature of science.

This came up in a discussion thread a few years ago. In response to some thoughts from Danielle Navarro about the importance of model checking, I wrote: This makes me think of an analogy between the following two things: – … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 12 days ago

The data are on a 1-5 scale, the mean is 4.61, and the standard deviation is 1.64 . . . What’s so wrong about that??

James Heathers reports on the article, “Contagion or restitution? When bad apples can motivate ethical behavior,” by Gino, Gu, and Zhong (2009): There is some sentiment data reported in Experiment 3, which seems to be reported in whole units. They … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 13 days ago

Infovis, infographics, and data visualization: My thoughts 12 years later

I came across this post from 2011, “Infovis, infographics, and data visualization: Where I’m coming from, and where I’d like to go,” and it seemed to make sense to reassess where we are now, 12 years later. From 2011: I … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 14 days ago

“Close but no cigar” unit tests and bias in MCMC

I’m coding up a new adaptive sampler in Python, which is super exciting (the basic methodology is due to Nawaf Bou-Rabee and Tore Kleppe). Luckily for me, another great colleague, Edward Roualdes, has been keeping me on the straight and … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 15 days ago

Do research articles have to be so one-sided?

It’s standard practice in research articles as well as editorials in scholarly journals to present just one side of an issue. That’s how it’s done! A typical research article looks like this: “We found X. Yes, we really found X. … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 15 days ago

N=43, “a statistically significant 226% improvement,” . . . what could possibly go wrong??

Enjoy. They looked at least 12 cognitive outcomes, one of which had p = 0.02, but other differences “were just shy of statistical significance.” Also: The degree of change in the brain measure was not significantly correlated with the degree … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 16 days ago

No, it’s not “statistically implausible” when results differ between studies, or between different groups within a study.

James “not the cancer cure guy” Watson writes: This letter by Thorland et al. published in the New England Journal of Medicine is rather amusing. It’s unclear to me what their point is, other than the fact that they find … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 17 days ago

Simulation to understand two kinds of measurement error in regression

This is all super-simple; still, it might be useful. In class today a student asked for some intuition as to why, when you’re regressing y on x, measurement error on x biases the coefficient estimate by measurement error on y … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 18 days ago

Intelligence is whatever machines cannot (yet) do

I had dinner a few nights ago with Andrew’s former postdoc Aleks Jakulin, who left the green fields of academia for entrepreneurship ages ago. Aleks was telling me he was impressed by the new LLMs, but then asserted that they’re … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 19 days ago

Evidence, desire, support

I keep worrying, as with a loose tooth, about news media elites who are going for the UFOs-as-space-aliens theory. This one falls halfway between election denial (too upsetting for me to want to think about too often) and belief in … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 19 days ago

Delayed retraction sampling

Colby Vorland writes: In case it is of interest, a paper we reported 3 years, 4 months ago was just retracted: Retracted: Effect of Moderate-Intensity Aerobic Exercise on Hepatic Fat Content and Visceral Lipids in Hepatic Patients with Diabesity: A … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 20 days ago

How large is that treatment effect, really? (my talk at NYU economics department Thurs 18 Apr 2024, 12:30pm)

19 W 4th Street, Room 517: How large is that treatment effect, really? Andrew Gelman, Department of Statistics and Department of Political Science, Columbia University “Unbiased estimates” aren’t really unbiased, for a bunch of reasons, including aggregation, selection, extrapola … | Continue reading


@statmodeling.stat.columbia.edu | 21 days ago

“He had acquired his belief not by honestly earning it in patient investigation, but by stifling his doubts. And although in the end he may have felt so sure about it that he could not think otherwise, yet inasmuch as he had knowingly and willingly worked himself into that frame of mind, he must be held responsible for it.”

Ron Bloom points us to this wonderful article, “The Ethics of Belief,” by the mathematician William Clifford, also known for Clifford algebras. The article is related to some things I’ve written about evidence vs. truth (see here and here) but … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 22 days ago

“He had acquired his belief not by honestly earning it in patient investigation, but by stifling his doubts. And although in the end he may have felt so sure about it that he could not think otherwise, yet inasmuch as he had knowingly and willingly worked himself into that frame of mind, he must be held responsible for it.”

Ron Bloom points us to this wonderful article, “The Ethics of Belief,” by the mathematician William Clifford, also known for Clifford algebras. The article is related to some things I’ve written about evidence vs. truth (see here and here) but … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 22 days ago

Here’s something you should do when beginning a project, and in the middle of a project, and in the end of the project: Clearly specify your goals, and also specify what’s not in your goal set.

Here’s something from from Witold’s slides on baggr, an R package (built on Stan) that does hierarchical modeling for meta-analysis: Overall goals: 1. Implement all basic meta-analysis models and tools 2. Focus on accessibility, model criticism and comparison 3. Help … Continue r … | Continue reading


@statmodeling.stat.columbia.edu | 23 days ago

People have needed rituals to turn data into truth for many years. Why would we be surprised if many people now need procedural reforms to work?

This is Jessica. How to weigh metascience or statistical reform proposals has been on my mind more than usual lately as a result of looking into and blogging about the Protzko et al. paper on rigor-enhancing practices. Seems it’s also … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 24 days ago

Hey, some good news for a change! (Child psychology and Bayes)

Erling Rognli writes: I just wanted to bring your attention to a positive stats story, in case you’d want to feature it on the blog. A major journal in my field (the Journal of Child Psychology and Psychiatry) has over … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 24 days ago

Evilicious 3: Face the Music

A correspondent forwards me this promotional material that appeared in his inbox: Hello hello, I am happy to announce that my new book MISBELIEF is out today! Do you have a friend or family member who changed in some dramatic … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 25 days ago

What is the prevalence of bad social science?

Someone pointed me to this post from Jonatan Pallesen: Frequently, when I [Pallesen] look into a discussed scientific paper, I find out that it is astonishingly bad. • I looked into Claudine Gay’s 2001 paper to check a specific thing, … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 26 days ago

“AI” as shorthand for turning off our brains. (This is not an anti-AI post; it’s a discussion of how we think about AI.)

Before going on, let me emphasize that, yes, modern AI is absolutely amazing—self-driving cars, machines that can play ping-pong, chessbots, computer programs that write sonnets, the whole deal! Call it machine intelligence or whatever, it’s amazing. What I’m getting at … Continu … | Continue reading


@statmodeling.stat.columbia.edu | 27 days ago

There is no golden path to discovery. One of my problems with all the focus on p-hacking, preregistration, harking, etc. is that I fear that it is giving the impression that all will be fine if researchers just avoid “questionable research practices.” And that ain’t the case.

Following our recent post on the latest Dishonestygate scandal, we got into a discussion of the challenges of simulating fake data and performing a pre-analysis before conducting an experiment. You can see it all in the comments to that post—but … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 28 days ago

It’s Ariely time! They had a preregistration but they didn’t follow it.

I have a story for you about a success of preregistration. Not quite the sort of success that you might be expecting—not a scientific success—but a kind of success nonetheless. It goes like this. An experiment was conducted. It was … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 28 days ago

Supporting Bayesian modelling workflows with iterative filtering for multiverse analysis

There is a new paper in arXiv: “Supporting Bayesian modelling workflows with iterative filtering for multiverse analysis” by Anna Elisabeth Riha, Nikolas Siccha, Antti Oulasvirta, and Aki Vehtari. Anna writes An essential component of Bayesian workflows is the iteration within … … | Continue reading


@statmodeling.stat.columbia.edu | 29 days ago

“Bayesian Workflow: Some Progress and Open Questions” and “Causal Inference as Generalization”: my two upcoming talks at CMU

I’ll be speaking twice at Carnegie Mellon soon. CMU statistics seminar, Fri 5 Apr 2024, 2:15pm, in Doherty Hall A302: Bayesian Workflow: Some Progress and Open Questions The workflow of applied Bayesian statistics includes not just inference but also model … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 29 days ago

Bad parenting in the news, also, yeah, lots of kids don’t believe in Santa Claus

A recent issue of the New Yorker had two striking stories of bad parenting. Margaret Talbot reported on a child/adolescent-care center in Austria from the 1970s that was run by former Nazis who were basically torturing the kids. This happened … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 1 month ago

“A passionate group of scientists determined to revolutionize the traditional publishing model in academia”

Jonathan Heppner saw our post, Refuted papers continue to be cited more than their failed replications: Can a new search engine be built that will fix this problem?, writes: I [Heppner] am a philosopher of psychology working with the ResearchHub … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 1 month ago

Paper cited by Stanford medical school professor retracted—but even without considering the reasons for retraction, this paper was so bad that it should never have been cited.

Last year we discussed a paper sent to us by Matt Bogard. The paper was called, “Impact of cold exposure on life satisfaction and physical composition of soldiers,” it appeared in the British Medical Journal, and Bogard was highly suspicious … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 1 month ago

“Randomization in such studies is arguably a negative, in practice, in that it gives apparently ironclad causal identification (not really, given the ultimate goal of generalization), which just gives researchers and outsiders a greater level of overconfidence in the claims.”

Dean Eckles sent me an email with subject line, “Another Perry Preschool paper . . .” and this link to a recent research paper that reports, “We find statistically significant effects of the program on a number of different outcomes … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 1 month ago

“Andrew, you are skeptical of pretty much all causal claims. But wait, causality rules the world around us, right? Plenty have to be true.”

Awhile ago, Kevin Lewis pointed me to this article that was featured in the Wall Street Journal. Lewis’s reaction was, “I’m not sure how robust this is with just some generic survey controls. I’d like to see more of an … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 1 month ago

“A passionate group of scientists determined to revolutionize the traditional publishing model in academia”

Jonathan Heppner saw our post, Refuted papers continue to be cited more than their failed replications: Can a new search engine be built that will fix this problem?, writes: I [Heppner] am a philosopher of psychology working with the ResearchHub … Continue reading → | Continue reading


@statmodeling.stat.columbia.edu | 1 month ago