This is a great and wonderful contribution and you seem really nice and I’d like to show some appreciation but your comment is so complete and flawless that I can’t think of anything intelligent to say so I guess I won’t respond at all, sorry.
This is a great and wonderful contribution and I have some further thoughts so I can respond naturally, great.
This is a great and wonderful contribution and I can’t think of anything intelligent to say but I have a joke that’s mildly amusing, I hope you don’t find it cringe or misinterpret it as disagreement or mockery or something.
This is a great and wonderful contribution and I agree with 90% of it, but I’d like to hedge on a few points, I guess I’ll point those out while stressing my overall agreement.
I utterly disagree with every single thing you said but this is still a great and wonderful contribution because you did a better job than me of representing the view I disagree with, still, it seems like everything has been said and we aren’t going to reach a consensus, so I’ll try to thread the needle of thanking you and conceding what I’m willing to concede without misrepresenting myself as being convinced or sounding dismissive or implying that we should have a lengthy back-and-forth.
Everything in your comment seems correct and I completely agree with it, but I’m confused because it seems like there’s some implied disagreement but I have no idea what that disagreement is.
This comment seems well-intentioned but it’s based on a epistemology so different from mine that the gap appears unbridgeable.
This comment explains what I was trying to say much better than I did, how did you do that.
This comment brings up a point that’s worth taking seriously, but the whole purpose of my post was to address this particular objection, so I’m confused why it’s being brought up as novel without any acknowledgement that I have at least attempted to refute it.
This comment politely brings up a minor-ish point that I did address somewhere, which is completely fine, it’s unreasonable to expect people to scour every nook and cranny of a post before responding, and other people are surely thinking the same thing, but given that I’ve already written my thoughts on this point, I’d like to link to them without implying that you did anything wrong, but I’m not quite sure how to do that, hmmm.
This comment points out a clear mistake, I should acknowledge it and thank you for the correction.
This comment points out a clear mistake but is also dripping with sarcasm and implied malintent, why you gotta be like that.
This comment is completely confused in a way that reveals to me that my post is itself confusing and I should have written it differently, damn it.
This comment is egregiously mean and makes no useful contribution at all, I guess I’ll delete it.
This comment is vaguely mean but also makes some interesting points, lest my garden die by pacifism I guess I’ll respond to the substantive points while also gently reminding you that I am a delicate flower and I enjoy human kindness, this will be super awkward but contrary to what you might expect, often works.
This comment is about aspartame, I can’t help myself, I absolutely cannot help myself.
Are you an AI agent?
This comment is thinly-veiled attempt to promote your own blog post, but you needn’t have veiled at all, I want more blogs and more bloggers and especially more blog posts engaging with each other, and I understand that there are today ~zero places you can promote yourself without immediately getting attacked, the social norm that it’s gauche to link to your own posts must change, so please go crazy provided it’s relevant, you aren’t constantly promoting the same thing, and (ideally) you aren’t blogging about a bunch of tweets.
To blog is to get dunked on. I accept this. I even sometimes wonder if I should be grateful, as I suspect my willingness to get dunked on may represent a kind of comparative advantage. (You can tell yourself that if you try to placate the haters, you’ll just ruin things for people who like you. But how do you feel when you’re staring down barrel of a 127 comment thread full of people debating how it’s possible that you’re such an idiot?)
Still, there’s one particular species of dunking that puzzles me. For context, Betteridge’s law states:1
Any headline that ends in a question mark can be answered by the word no.
This is often employed as a sick burn, as in, You titled your article ‘Is this the world’s first gay caveman?’ because it’s not the world’s first gay caveman but you wanted it to be, because you want attention, you are so bad, har-har.
But I don’t quite understand the rules. Can someone explain the rules?
Question 1: Are question marks in titles always bad?
I’m just checking. I suppose I could see the logic, e.g. if you strongly feel that the bottom line should always come right up front. But I’m pretty sure that’s not the rule, because “this title used a question mark” is not regarded as a sick burn.
Question 2: Are question marks only OK if the essay ends with a full-throated “yes”?
Sometimes it does seem like this is the rule. But it’s strange. If it were universally enforced, we could all mentally convert “Do blue-blocking glasses improve sleep?” into “Yes, blue-blocking glasses really do improve sleep!” But then, of what use was the question mark? Why not just say they’re always bad?
If we’re going to allow questions that are actual questions, then it has to be possible for the answer to sometimes be something other than yes. On the other hand…
Question 3: Is Betteridge’s law useful at all?
I think so. At minimum, you can think of it as a convenient label for this theory:
Traditionally, news articles are written with the bottom line up front.
Traditionally, news articles have incentives to make a clear affirmative statement in the headline.
So if a news article uses a question, that’s because they couldn’t justify making a clear affirmative statement.
I don’t think this theory is 100% accurate. But it’s accurate enough to deserve a name. (On the whole, more theories should have names.) Still, Betteridge’s law isn’t usually invoked as a neutral observation about the forces that led to a given title. It’s usually invoked as a dunk. So…
Question 4: Is Betteridge dunking ever appropriate?
Again, I think it is. Here are some of the best/worst examples from John Rentoul’s book, “Questions to Which the Answer Is No!”:
“Will Guam capsize?”
“Is Osama Bin Laden in Chicago?”
“Did Jesus foresee the US Constitution?”
“Des smartphones bientôt équipés d’airbags?”
I think we can agree something is wrong with these. But what, exactly?
Question 5: Is it central that the answer is “no”?
Consider these made-up titles:
“Is the Pope still Catholic?”
“Do you need to sleep every day?”
“Did Lincoln have personal qualms about slavery?”
“Did the Rubicon even exist back when Caesar supposedly crossed it?”
These are anti-Betteridges. The answer is yes, but the title is irritating in the same way: It gives the impression of a live debate when none exists.
Question 6: What’s really going on here?
I think it’s pretty clear. Consider the title:
Is aspartame bad for you?
If you understood it to be a settled question that aspartame is safe, and the article ultimately concludes that aspartame is safe, then you might find that title annoying. On the other hand, if you understood it to be settled that aspartame is bad for you, and the article confirms that yes indeed it is bad for you, then you also might find that title annoying.
The answer is immaterial. What’s irritating is when a title suggests a novel, interesting possibility that the article does not substantiate as worthy of attention.
Question 7: So what’s the problem?
Here’s a proposition: The modern internet rewards people for being overconfident. I don’t know if you’ve noticed, but people with blogs are not constrained by the norms of traditional newspapers. On the contrary, if you start a blog, you will soon learn that the best way to get attention is to write spicy aggressive titles like, “No, creatine does not make you smarter despite what all the stupid dumb mouth-breathing supplement hucksters may tell you.”
Now, I do think you should say what you actually believe. If you truly are that confident, I want you to tell me, not bullshit me by pretending to be neutral.
However, the internet corrupts all of us. Many people seem to start out with a public persona that is careful and measured and calm. But over time, they’re gradually sculpted by the Reward Function into something quite different. The degree this happens depends on your personality, where you’re competing for attention2 and how much you try to resist. But I don’t think anyone is truly above this.
Still, we should try to resist. My favorite kind of essay is, “Lucid examination of all sides of an issue which finds some evidence pointing in various directions and doesn’t reach a definitive conclusion because the world is complicated.” And I think the fundamental goal of a title should be to accurately signal the contents. But how is such an essay supposed to signal what it is, if not by using a question?
Question 8: What should a title do?
One theory is that question titles are sort of like lists: A thing with strong fundamental merits that has been rendered suspicious by abuse. Under this theory, we should push back against all the Betteridgeing and insist that question titles are fine when the question is genuinely open, regardless of the answer, and that people are wrong to Betteridge unless the question mark is being abused.
As far as I can tell, that’s the only internally consistent theory that doesn’t amount to saying that question titles should be forbidden. A slightly more conciliatory version would be that if you use a question mark, it’s your responsibility to demonstrate that it’s a real question, not something you made up.
I lean towards that theory. But part of me—a minority—thinks that perhaps question titles should be effectively forbidden. I thought I’d do a little reductio ad absurdum by trying to give this post an accurate non-question title. The best things I could think of were, “Hesitantly against over-broad Betteridge dunking” and “I weakly think excessive Betteridge dunking disincentivizes fairly examining all sides of an issue.” At first, I thought those were amusingly terrible. But are they, really?
PS. Was Rentoul’s book correct to list, “Should we clone Neanderthals?” as an example of a question to which the answer is no?
Implicitly, this applies only to yes/no questions. “How long should you brew your tea?” should not be answered with “no”. ↩
The article seems pretty good at math and thinking through unusual implications, but my armchair Substack eugenics alarm that I keep in the back of my brain is beeping.
Saying that variance was “invented for the purpose of defining heritability” is technically correct, but that might not be the best kind of correct in this case, because it was invented by the founder of the University of Cambridge Eugenics Society who had decided, presumably to support that project, that he wanted to define something called “heritability”.
His particular formula for heritability is presented in the article as if it has odd traits but is obviously basically a sound thing to want to calculate, despite the purpose it was designed for.
The vigorous “educational attainment is 40% heritable, well OK maybe not but it’s a lot heritable, stop quibbling” hand waving sounds like a person who wants to show but can’t support a large figure. And that framing of education, as something “attained” by people, rather than something afforded to or invested in them, is almost completely backwards at least through college.
The various examples about evil despots and unstoppable crabs highlight how heritability can look large or small independent of more straightforward biologically-mechanistic effects of DNA. But they still give the impression that those are the unusual or exceptional cases.
In reality, there are in fact a lot of evil crabs, doing things like systematically carting away resources from Black children’s* schools, and then throwing them in jail. We should expect evil-crab-based explanations of differences between people to be the predominant ones.
*Not to say that being Black “is genetic”. Things from accent to how you style your hair to how you dress to what country you happen to be standing in all contribute to racial judgements used for racism. But “heritability” may not be the right tool to disentangle those effects.
Dear PendingKetchup,
Thanks for complimenting my math (♡), for reading all the way to the evil crabs, and for not explicitly calling me a racist or eugenicist. I also appreciate that you chose sincerity over boring sarcasm and that you painted such a vibrant picture of what you were thinking while reading my post. I hope you won’t mind if I respond in the same spirit.
To start, I’d like to admit something. When I wrote that post, I suspected some people might have reactions similar to yours. I don’t like that. I prefer positive feedback! But I’ve basically decided to just let reactions like yours happen, because I don’t know how to avoid them without compromising on other core goals.
It sounds like my post gave you a weird feeling. Would it be fair to describe it as a feeling that I’m not being totally upfront about what I really think about race / history / intelligence / biological determinism / the ideal organization of society?
Because if so, you’re right. It’s not supposed to be a secret, but it’s true.
Why? Well, you may doubt this, but when I wrote that post, my goal was that people who read it would come away with a better understanding of the meaning of heritability and how weird it is. That’s it.
Do I have some deeper and darker motivations? Probably. If I probe my subconscious, I find traces of various embarrassing things like “draw attention to myself” or “make people think I am smart” or “after I die, live forever in the world of ideas through my amazing invention of blue-eye-seeking / human-growth-hormone-injecting crabs.”
What I don’t find are any goals related to eugenics, Ronald Fisher, the heritability of educational attainment, if “educational attainment” is good terminology, racism, oppression, schools, the justice system, or how society should be organized.
These were all non-goals for basically two reasons:
My views on those issues aren’t very interesting or notable. I didn’t think anyone would (or should) care about them.
Surely, there is some place in the world for things that just try to explain what heritability really means? If that’s what’s promised, then it seems weird to drop in a surprise morality / politics lecture.
At the same time, let me concede something else. The weird feeling you got as you read my post might be grounded in statistical truth. That is, it might be true that many people who blog about things like heritability have social views you wouldn’t like. And it might be true that some of them pretend at truth-seeking but are mostly just charlatans out to promote those unliked-by-you social views.
You’re dead wrong to think that’s what I’m doing. All your theories of things I’m trying to suggest or imply are unequivocally false. But given the statistical realities, I guess I can’t blame you too much for having your suspicions.
So you might ask—if my goal is just to explain heritability, why not make that explicit? Why not have a disclaimer that says, “OK I understand that heritability is fraught and blah blah blah, but I just want to focus on the technical meaning because…”?
One reason is that I think that’s boring and condescending. I don’t think people need me to tell them that heritability is fraught. You clearly did not need me to tell you that.
Also, I don’t think such disclaimers make you look neutral. Everyone knows that people with certain social views (likely similar to yours) are more likely to give such disclaimers. And they apply the same style of statistical reasoning you used to conclude I might be a eugenicist. I don’t want people who disagree with those social views to think they can’t trust me.
Paradoxically, such disclaimers often seem to invite more objections from people who share the views they’re correlated with, too. Perhaps that’s because the more signals we get that someone is on “our” side, the more we tend to notice ideological violations. (I’d refer here to the narcissism of small differences, though I worry you may find that reference objectionable.)
If you want to focus on the facts, the best strategy seems to be serene and spiky: to demonstrate by your actions that you are on no one’s side, that you don’t care about being on anyone’s side, and that your only loyalty is to readers who want to understand the facts and make up their own damned mind about everything else.
I’m not offended by your comment. I do think it’s a little strange that you’d publicly suggest someone might be a eugenicist on the basis of such limited evidence. But no one is forcing me to write things and put them on the internet.
The reason I’m writing to you is that you were polite and civil and seem well-intentioned. So I wanted you to know that your world model is inaccurate. You seem to think that because my post did not explicitly support your social views, it must have been written with the goal of undermining those views. And that is wrong.
The truth is, I wrote that post without supporting your (or any) social views because I think mixing up facts and social views is bad. Partly, that’s just an aesthetic preference. But if I’m being fully upfront, I also think it’s bad in the consequentialist sense that it makes the world a worse place.
Why do I think this? Well, recall that I pointed out that if there were crabs that injected blue-eyed babies with human growth hormone, that would increase the heritability of height. You suggest I had sinister motives for giving this example, as if I was trying to conceal the corollary that if the environment provided more resources to people with certain genes (e.g. skin color) that could increase the heritability of other things (e.g. educational attainment).
Do you really think you’re the only reader to notice that corollary?
The degree to which things are “heritable” depends on the nature of society. This is a fact. It’s a fact that many people are not aware of. It’s also a fact that—I guess—fits pretty well with your social views. I wanted people to understand that. Not out of loyalty to your social views, but because it is true.
It seems that you’re annoyed that I didn’t phrase all my examples in terms of culture war. I could have done that. But I didn’t, because I think my examples are easier to understand, and because the degree to which changing society might change the heritability of some trait is a contentious empirical question.
But OK. Imagine I had done that. And imagine all the examples were perfectly aligned with your social views. Do you think that would have made the post more or less effective in convincing people that the fact we’re talking about is true? I think the answer is: Far less effective.
I’ll leave you with two questions:
Question 1: Do you care about the facts? Do you believe the facts are on your side?
Question 2: Did you really think I wrote that post with with the goal of promoting eugenics?
If you really did think that, then great! I imagine you’ll be interested to learn that you were incorrect.
But just as you had an alarm beeping in your head as you read my post, I had one beeping in my head as I read your comment. My alarm was that you were playing a bit of a game. It’s not that you really think I wanted to promote eugenics, but rather that you’re trying to enforce a norm that everyone must give constant screaming support to your social views and anyone who’s even slightly ambiguous should be ostracized.
Of course, this might be a false alarm! But if that is what you’re doing, I have to tell you: I think that’s a dirty trick, and a perfect example of why mixing facts and social views is bad.
You may disagree with all my motivations. That’s fine. (I won’t assume that means you are a eugenicist.) All I ask is that you disapprove accurately.
A couple of months ago (April 2025), a group of prominent folks released AI 2027, a project that predicted that AGI could plausibly be reached in 2027 and have important consequences. This included a set of forecasts and a story for how things might play out. This got a lot of attention. Some was positive, some was negative, but it was almost all very high level.
More recently (June 2025) titotal released a detailed critique, suggesting various flaws in the modeling methodology.
I don’t have much to say about AI 2027 or the critique on a technical level. It would take me at least a couple of weeks to produce an opinion worth caring about, and I haven’t spent the time. But I would like to comment on the discourse. (Because “What we need is more commentary on the discourse”, said no one.)
Very roughly speaking, here’s what I remember: First, AI 2027 came out. Everyone cheers. “Yay! Amazing!” Then the critique came out. Everyone boos. “Terrible! AI 2027 is not serious! This is why we need peer-review!”
This makes me feel simultaneously optimistic and depressed.
Should AI 2027 have been peer-reviewed? Well, let me tell you a common story:
Someone decides to write a paper.
In the hope of getting it accepted to a journal, they write it in arcane academic language, fawningly cite unrelated papers from everyone who could conceivably be a reviewer, and make every possible effort to hide all flaws.
This takes 10× longer than it should, results in a paper that’s very boring and dense, and makes all limitations illegible.
They submit it to a journal.
After a long time, some unpaid and distracted peers give the paper a quick once-over and write down some thoughts.
There’s a cycle where the paper is revised to hopefully make those peers happy. Possibly the paper is terrible, the peers see that, and the paper is rejected. No problem! The authors resubmit it to a different journal.
Twelve years later, the paper is published. Oh happy day!
You decide to read the paper.
After fighting your way through the writing, you find something that seems fishy. But you’re not sure, because the paper doesn’t fully explain what they did.
The paper cites a bunch of other papers in a way that implies they might resolve your question. So you read those papers, too. It doesn’t help.
You look at the supplementary material. It consists of insanely pixelated graphics and tables with labels like Qetzl_xmpf12 that are never explained.
In desperation, you email the authors.
They never respond.
The end.
And remember, peer review is done by peers from the same community who think in similar ways. Different communities settle on somewhat random standards for what’s considered important or what’s considered an error. In much of the social sciences, for example, quick-and-dirty regressions with strongly implied causality are A+ supergood. Outsiders can complain, but they aren’t the ones doing the reviewing.
I wouldn’t say that peer review is worthless. It’s something! Still, call me cynical—you’re not wrong—but I think the number of mistakes in peer-reviewed papers is one to two orders of magnitude higher than generally understood.
Why are there so many mistakes to start with? Well I don’t know if you’ve heard, but humans are fallible creatures. When we build complex things, they tend to be flawed. They particularly tend to be flawed when—for example—people have strong incentives to produce a large volume of “surprising” results, and the process to find flaws isn’t very rigorous.
Aren’t authors motivated by Truth? Otherwise, why choose that life over making lots more money elsewhere? I personally think this is an important factor, and probably the main reason the current system works at all. But still, it’s amazing how indifferent many people are to whether their claims are actually correct. They’ve been in the game so long that all they remember is their h-index.
And what happens if someone spots an error after a paper is published? This happens all the time, but papers are almost never retracted. Nobody wants to make a big deal because, again, peers. Why make enemies? Even when publishing a contradictory result later, people tend to word their criticisms so gently and indirectly that they’re almost invisible.
As far as I can tell, the main way errors spread is: Gossip. This works sorta-OK-ish for academics, because they love gossip and will eagerly spread the flaws of famous papers. But it doesn’t happen for obscure papers, and it’s invisible to outsiders. And, of course, if seeing the flaws requires new ideas, it won’t happen at all.
If peer review is so imperfect, then here’s a little dream. Just imagine:
Alice develops some ideas and posts them online, quickly and with minimal gatekeeping.
Because Alice is a normal human person, there are some mistakes.
Bob sees it and thinks something is fishy.
Bob asks Alice some questions. Because Alice cares about being right, she’s happy to answer those questions.
Bob still thinks something is fishy, so he develops a critique and posts it online, quickly and with minimal gatekeeping.
Bob’s critique is friendly and focuses entirely on technical issues, with no implications of bad faith. But at the same time, he pulls no punches.
Because Bob is a normal human person, he makes some mistakes, too.
Alice accepts some parts of the critique. She rejects other parts and explains why.
Carol and Eve and Frank and Grace see all this and jump in with their own thoughts.
Slowly, the collective power of many human brains combine to produce better ideas than any single human could.
Wouldn’t that be amazing? And wouldn’t it be amazing if some community developed social norms that encouraged people to behave that way? Because as far as I can tell, that’s approximately what’s happening with AI 2027.
I guess there’s a tradeoff in how much you “punish” mistakes. Severe punishment makes people defensive and reduces open discussion. But if you’re too casual, then people might get sloppy.
My guess is that different situations call for different tradeoffs. Pure math, for example, might do well to set the “punishment slider” fairly high, since verifying proofs is easier than creating the proofs.
The best choice also depends on technology. If it’s 1925 and communication is bottlenecked by putting ink on paper, maybe you want to push most of the verification burden onto the original authors. But it’s not 1925 anymore, and surely it’s time to experiment with new models.
Bob: That’s wrong, what we see ahead is caused by the sun heating up the road. While the speed of light is constant in vacuum, when light moves through matter, the atoms emit new light that destructively interferes with the old light, in effect causing a “delay”. This happens more with more atoms, meaning light travels slower through denser media.
Alice: OK, but—
Bob: So when the sun heats up the road, this creates a layer of thin warm air with denser cooler air higher up. As light passes through these layers, it refracts upwards towards the denser cooler layer. If conditions are right, this can bend the light back up towards your eyes. Does that make sense?
Alice: Yeah, but—
Bob: Now you might ask, “Why does this look like water?” The situations seem similar at first, with two fluids of different densities. But think about it: With an ocean, the dense water is below the thin air. While, in front of you, the dense cool air is above the thin warm air. The situations are actually reversed!
Alice: Please just—
Bob: With an ocean, there’s a sharp increase in density where the air meets the water. The Fresnel equations say that when light hits such a discontinuity at an angle, most is reflected off the surface. Whereas with the air in front of us, there’s a small and gradual decrease in density, meaning the light is slowly refractedthrough the lighter warm air and gradually bent back up. In both cases, the mixing in the fluids causes a shimmering effect.
Alice:
Bob: So yeah. Wrong. That’s just a heat mirage.
Meanwhile, the desert flies by, bone dry.
Often on the internet, someone will make a thing and someone else will make a reply with this pattern:
“That’s wrong.”
(Various smart-sounding factual statements.)
The problem, of course, is that this never explains why the original thing is wrong. This is a fully-general pattern for refuting anything, one that does not require the existence of any mistake. As far as I can tell, this pattern doesn’t have a name. So I suggest “Heat Mirage”: a compelling series of true statements that refute a mistake that’s never stated and doesn’t exist.
Often, all the smart-sounding factual statements are totally correct and insightful. So other people tend to see them and think, “Wow, this person really knows what they’re talking about. Clearly the original thing is dumb and bad. I’m not going to waste my time going through that!”
Sometimes this leads to a whole gang of people agreeing with the smart-sounding statements and lamenting the original thing’s wrongness. Someone might chime in with “Uhh, nothing you said contradicts anything?” or “It seems like you’re just annoyed that your personal fixation wasn’t the main subject of the thing?” But this rarely turns the tide.
What makes the Heat Mirage pattern so pernicious is that there’s seldom any ill intent. Someone just neglected for some reason to explain the “mistake” they were refuting. They might even be trying to be “nice” by avoiding too much criticism or negativity.
One of the tough lessons of life is that when you try to be “nice” to someone instead of being direct, you often end up hurting them, because you don’t understand their needs. If in doubt, it’s best to err on the side of (tactful) directness. And, on the internet, one should always be in doubt.
Trust me, anyone who makes a thing on the internet is 100% fully aware that other people are likely to point out flaws. I think that’s great, and we should all get comfortable with our own fallibility. But it’s best when the flaws that are pointed out are real flaws that actually exist.
So, if you want to say someone is wrong, say why. Or, if you don’t want to do that, consider starting off with, “Here’s something I find interesting…”