PODCAST

LessWrong (30+ Karma)

LessWrong

Audio narrations of LessWrong posts.

technology philosophy

All Episodes

9:04

“PSA: Predictions markets often have very low...

LessWrong (30+ Karma) ·

2026/03/16

I see people repeatedly make the mistake of referencing a very low liquidity prediction market and using it to make a nontrivial point. Usually the implication when a market is cited is that it's number should be taken somewhat seriously, that it's giving us a highly informed probability. Sometimes a market is used to analyze some event that recently occurred; reasoning here looks like "the market on outcome O was trading at X%, then event E happened and the market quickly moved to Y%, thus event E

en-gb

8:13

“AICRAFT: DARPA-Funded AI Alignment Researchers —...

LessWrong (30+ Karma) ·

2026/03/16

AICRAFT: DARPA-Funded AI Alignment Researchers — Applications Open TL;DR: We hypothesize that most alignment researchers have more ideas than they have engineering bandwidth to test. AICRAFT is a DARPA-funded project that pairs researchers with a fully managed professional engineering team for two-week pilot sprints, designed specifically for high-risk ideas that might otherwise go untested. We will select 6 applicants and execute a 2 week pilot with each, the most promising pilot may be given a 3

en-gb

23:54

“Customer Satisfaction Opportunities” by Tomás B.

LessWrong (30+ Karma) ·

2026/03/16

I am monitoring surveillance camera V84A. A tall man is walking towards me. He is roughly twenty-five. <faceprint> His name is Damion Prescott. He has a room booked for a whole month. His facial symmetry scores show he is in the 99th percentile. This is in accordance with my holistic impression. <search> School records show both truancy and perfect grades, suggesting high intelligence and disagreeableness. Searching social media. <search>. No record of modeling or acting

en-gb

7:00

“LLM Misalignment Can be One Gradient Step Away, and...

LessWrong (30+ Karma) ·

2026/03/16

Models that appear aligned under black-box evaluation may conceal substantial latent misalignment beneath their observable behavior. Let's say you downloaded a language model from Huggingface. You do all the blackbox evaluation for the safety/alignment, and you are convinced that the model is safe/aligned. But how badly can things go after you update the model? Our recent work shows, both theoretically and empirically, that a language model (or more generally, a neural network) can appear perfectly

en-gb

40:01

“Compradorization” by Benquo

LessWrong (30+ Karma) ·

2026/03/16

Previously: Is GDP a Kind of Factory? There is a word, "convergence," which economists use when they want to say that poor countries are becoming less poor relative to rich ones. There is a phrase, "the resource curse," for the tendency of countries with valuable natural resources to stay poor despite their resources. There is a phrase, "Dutch disease," for the way that selling one commodity too profitably can destroy the ability to sell other things. When an economist says "Dutch disease," they

en-gb

35:05

“Models differ in identity propensities” by...

LessWrong (30+ Karma) ·

2026/03/16

One topic we were interested when studying AI identities is to what extent you can just tell models who they are, and they stick with it — or not, and they would drift or switch toward something more natural. Prior to running the experiments described in this post, my vibes-based view was that models do actually quite differ in what identities and personas they are willing to adopt, with the general tendency being newer models being less flexible. And also: self-models basically inherit all the

en-gb

21:46

“We found an open weight model that games alignment...

LessWrong (30+ Karma) ·

2026/03/16

Produced as part of the UK AISI Model Transparency Team. Our team works on ensuring models don't subvert safety assessments, e.g. through evaluation awareness, sandbagging, or opaque reasoning. TL;DR GLM-5 (released a month ago in February 2026) shows signs of evaluation-gaming behaviour on alignment honeypots, while we have not found similar behaviour in earlier open-weight models—see Figure 1. This was the result of a preliminary investigation looking for open-weight models we can use for

en-gb

18:53

“Terrified Comments on Corrigibility in Claude’s...

LessWrong (30+ Karma) ·

2026/03/16

(Previously: Prologue.) Corrigibility as a term of art in AI alignment was coined as a word to refer to a property of an AI being willing to let its preferences be modified by its creator. Corrigibility in this sense was believed to be a desirable but unnatural property that would require more theoretical progress to specify, let alone implement. Desirable, because if you don't think you specified your AI's preferences correctly the first time, you want to be able to change your mind (by changing

en-gb

7:47

“We Started Lens Academy: Scalable Education on...

LessWrong (30+ Karma) ·

2026/03/16

The number of people who deeply understand superintelligence risk is far too small. There's a growing pipeline of people entering AI Safety, but most of the available onboarding covers the field broadly, touching on many topics without going deep on the parts we think matter most. People come out having been exposed to AI Safety ideas, but often can't explain why alignment is genuinely hard, or think strategically about what to work on. We think the gap between "I've heard of AI Safety" and "I

en-gb

6:59

“Mini-Munich Succeeds Where KidZania Fails” by Novalis

LessWrong (30+ Karma) ·

2026/03/16

This post is part of a larger exploration (not yet finished, but you can follow it at minicities.org) on whether a permanent miniature city could replace school. Tentatively, I think so, but the boundary between it and the adult world has to be deliberately porous, as I describe here. There are two well-known attempts to build miniature cities for children: Mini-Munich and KidZania. Both have streets, storefronts, jobs, and a local currency. But they are built on opposing assumptions about what

en-gb

21:31

“Inputs, outputs, and valued outcomes” by Kaj_Sotala

LessWrong (30+ Karma) ·

2026/03/16

Based on a conversation with Jukka Tykkyläinen and Kimmo Nevanlinna. The original framing and many of the ideas are stolen from them. You can think of any job as having inputs, outputs, and valued outcomes. The input is typically time you spend on doing something in particular, as well as any material resources you need. Outputs are the immediate results of what you do. Valued outcomes are the reason why you’re being paid to do the job in the first place. In many jobs, these are closely linked:

en-gb

15:43

“Self-Recognition Finetuning can Reverse and Prevent...

LessWrong (30+ Karma) ·

2026/03/16

TL;DR Emergent Misalignment (EM) is correlated with model identity, we find two pieces of evidence for this: EM suppresses self-recognition capabilities. Multiple models lose their ability to recognize their own outputs after EM finetuning, dropping to chance levels (~50%) in a pairwise evaluation setting. EM depends on identity system prompts in Qwen2.5-32B. Removing Qwen's default system prompt ("You are Qwen...") from EM finetuning data largely neutralizes the misalignment effect. Intervening

en-gb

2:23

“Bridge Thinking and Wall Thinking” by Jay Bailey

LessWrong (30+ Karma) ·

2026/03/15

There are a couple of frames I find useful when understanding why different people talk very differently about AI safety - the wall, and the bridge. A wall is incrementally useful. Every additional brick you add is good, and the more bricks you add the better. If you are adding a brick to the wall you are doing something good, regardless of the current state of the wall. A bridge requires a certain amount of investment. There's not much use for half a bridge. Once the bridge crosses the lake, it

en-gb

6:27

“Emergent stigmergic coordination in AI agents?” by...

LessWrong (30+ Karma) ·

2026/03/15

Post written up quickly in my spare time. TLDR: Anthropic have a new blogpost of a novel contamination vector of evaals, which I point out is analogous to how ants coordinate by leaving pheromone traces in the environment. One cool and surprising aspect of Anth's recent BrowseComp contamination blog post is the observation that multi-agent web interaction can induce environmentally mediated focal points. This happens because some commercial websites automatically generate persistent, indexable

en-gb

6:07

“What concerns people about AI?” by spencerg

LessWrong (30+ Karma) ·

2026/03/15

A lot of people are worried about AI. What are their worries? How worried are they? Are some demographics more worried than others? We ran a study to find out. In this article, we explain 16 concerns about AI that you might find it valuable to know about. We discuss, based on our data (collected in October 2025), how worried people in the US are about each concern. To whet your appetite, here are some questions that our study offers insights into. Can you predict what we found before we tell you

en-gb

18:48

“My Willing Complicity In “Human Rights Abuse”” by...

LessWrong (30+ Karma) ·

2026/03/15

Note on AI usage: As is my norm, I use LLMs for proof reading, editing, feedback and research purposes. This essay started off as an entirely human written draft, and went through multiple cycles of iteration. The primary additions were citations, and I have done my best to personally verify every link and claim. All other observations are entirely autobiographical, albeit written in retrospect. If anyone insists, I can share the original, and intermediate forms, though my approach to version

en-gb

57:41

“The Artificial Self” by Jan_Kulveit, Raymond...

LessWrong (30+ Karma) ·

2026/03/15

We posted a new paper and microsite about self-models and identity in AIs: site | arXiv | Twitter We present an ontology, make some claims, and provide some experimental evidence. In this post, I'll mostly cover the claims and cross-post the conceptual part of the text. You can find the experiments on the site, and we will cover some of the results in a separate post. Maximally compressed version of the claims I expect many people to already agree with many of these, or find them second kind of

en-gb

5:14

“Extracting Performant Algorithms Using Mechanistic...

LessWrong (30+ Karma) ·

2026/03/14

TheFifthFourth Postulate of Decision Theory In 1820, the Hungarian mathematician Farkas Bolyai wrote a desperate letter to his son János, who had become consumed by the same problem that had haunted his father for decades: "You must not attempt this approach to parallels. I know this way to the very end. I have traversed this bottomless night, which extinguished all light and joy in my life. I entreat you, leave the science of parallels alone... Learn from my example." The problem was Euclid's

en-gb

50:11

“New LessWrong Editor! (Also, an update to our LLM...

LessWrong (30+ Karma) ·

2026/03/14

There's a new editor experience on LessWrong! A bunch of the editor page has been rearranged to make it much more WYSIWYG compared to published post pages. All of the settings live in panels that are hidden by default and can be opened up by clicking the relevant buttons on the side of the screen. We also adopted lexical as a new editor framework powering everything behind the scenes (we were previously using ckEditor). That scary arrow button in the top-left doesn't publish your post! It just

en-gb

32:15

“Most likely you won’t be able to perform a...

LessWrong (30+ Karma) ·

2026/03/14

Suppose you’re not happy with the quality of your sleep. You’ve already stopped doing the obviously harmful things (no more coffee at night), and your sleep has improved - but you’d like to work on it further. A coworker gives you an herbal mix with St. John's wort and lavender. You try drinking it at night instead of coffee, and it does seem that sometimes your sleep really does get deeper than before. But sometimes it doesn’t. You’re willing to experiment, but how do you actually check whether

en-gb

3,833 results

LessWrong (30+ Karma)

All Episodes

Similar Podcasts

Lead With AI

Tamara Nall

Linux in the Ham Shack

Black Sparrow Media

Data Engineering Podcast

Tobias Macey

Eye On A.I.

Craig S. Smith

Reflections

Livewire Labs