x

75% of people globally want unbiased news (Pew Research) but are concerned they're not getting that.

Get balanced coverage with Symby. See how stories are covered across diverse outlets and spot when one side covers a story the other skips.

PODCAST

LessWrong (Curated & Popular)

Audio narrations of LessWrong posts. Includes all curated posts and all posts with 125+ karma.If you"d like more, subscribe to the “Lesswrong (30+ karma)” feed.

technology philosophy

All Episodes

8:40

“What o3 Becomes by 2028” by Vladimir_Nesov

LessWrong (Curated & Popular) ·

2025/01/09

Funding for $150bn training systems just turned less speculative, with OpenAI o3 reaching 25% on FrontierMath, 70% on SWE-Verified, 2700 on Codeforces, and 80% on ARC-AGI. These systems will be built in 2026-2027 and enable pretraining models for 5e28 FLOPs, while o3 itself is plausibly based on an LLM pretrained only for 8e25-4e26 FLOPs. The natural text data wall won't seriously interfere until 6e27 FLOPs, and might be possible to push until 5e28 FLOPs. Scaling of pretraining won't end just...

en

25:26

“What Indicators Should We Watch to Disambiguate AGI...

LessWrong (Curated & Popular) ·

2025/01/09

(Cross-post from https://amistrongeryet.substack.com/p/are-we-on-the-brink-of-agi, lightly edited for LessWrong. The original has a lengthier introduction and a bit more explanation of jargon.)No one seems to know whether transformational AGI is coming within a few short years. Or rather, everyone seems to know, but they all have conflicting opinions. Have we entered into what will in hindsight be not even the early stages, but actually the middle stage, of the mad tumbling rush into singular...

en

78:48

“How will we update about scheming?” by ryan_greenblatt

LessWrong (Curated & Popular) ·

2025/01/08

I mostly work on risks from scheming (that is, misaligned, power-seeking AIs that plot against their creators such as by faking alignment). Recently, I (and co-authors) released "Alignment Faking in Large Language Models", which provides empirical evidence for some components of the scheming threat model.One question that's really important is how likely scheming is. But it's also really important to know how much we expect this uncertainty to be resolved by various key points in the future. ...

en

20:22

“OpenAI #10: Reflections” by Zvi

LessWrong (Curated & Popular) ·

2025/01/08

This week, Altman offers a post called Reflections, and he has an interview in Bloomberg. There's a bunch of good and interesting answers in the interview about past events that I won’t mention or have to condense a lot here, such as his going over his calendar and all the meetings he constantly has, so consider reading the whole thing. Table of Contents The Battle of the Board.Altman Lashes Out.Inconsistently Candid.On Various People Leaving OpenAI.The Pitch.Great Expectations.Accusations of...

en

2:15

“Maximizing Communication, not Traffic” by jefftk

LessWrong (Curated & Popular) ·

2025/01/07

As someone who writes for fun, I don't need to get people onto my site: If I write a post and some people are able to get the core ideajust from the title or a tweet-length summary, great!I can include the full contents of my posts in my RSS feed andon FB, because so what if people read the whole post there and neverclick though to my site?It would be different if I funded my writing through ads (maximizetime on site to maximize impressions) or subscriptions (get the chanceto pitch, probably ...

en

44:21

“What’s the short timeline plan?” by Marius Hobbhahn

LessWrong (Curated & Popular) ·

2025/01/02

This is a low-effort post. I mostly want to get other people's takes and express concern about the lack of detailed and publicly available plans so far. This post reflects my personal opinion and not necessarily that of other members of Apollo Research. I’d like to thank Ryan Greenblatt, Bronson Schoen, Josh Clymer, Buck Shlegeris, Dan Braun, Mikita Balesni, Jérémy Scheurer, and Cody Rushing for comments and discussion.I think short timelines, e.g. AIs that can replace a top researcher at an ...

en

117:07

“Shallow review of technical AI safety, 2024” by...

LessWrong (Curated & Popular) ·

2024/12/30

from aisafety.world The following is a list of live agendas in technical AI safety, updating our post from last year. It is “shallow” in the sense that 1) we are not specialists in almost any of it and that 2) we only spent about an hour on each entry. We also only use public information, so we are bound to be off by some additional factor. The point is to help anyone look up some of what is happening, or that thing you vaguely remember reading about; to help new researchers orient and know (...

en

28:44

“By default, capital will matter more than ever after...

LessWrong (Curated & Popular) ·

2024/12/29

I've heard many people say something like "money won't matter post-AGI". This has always struck me as odd, and as most likely completely incorrect.First: labour means human mental and physical effort that produces something of value. Capital goods are things like factories, data centres, and software—things humans have built that are used in the production of goods and services. I'll use "capital" to refer to both the stock of capital goods and to the money that can pay for them. I'll say "mo...

en

39:20

“Review: Planecrash” by L Rudolf L

LessWrong (Curated & Popular) ·

2024/12/28

Take a stereotypical fantasy novel, a textbook on mathematical logic, and Fifty Shades of Grey. Mix them all together and add extra weirdness for spice. The result might look a lot like Planecrash (AKA: Project Lawful), a work of fiction co-written by "Iarwain" (a pen-name of Eliezer Yudkowsky) and "lintamande".(image from Planecrash)Yudkowsky is not afraid to be verbose and self-indulgent in his writing. He previously wrote a Harry Potter fanfic that includes what's essentially an extended E...

en

14:03

“The Field of AI Alignment: A Postmortem, and What To...

LessWrong (Curated & Popular) ·

2024/12/26

A policeman sees a drunk man searching for something under a streetlight and asks what the drunk has lost. He says he lost his keys and they both look under the streetlight together. After a few minutes the policeman asks if he is sure he lost them here, and the drunk replies, no, and that he lost them in the park. The policeman asks why he is searching here, and the drunk replies, "this is where the light is".Over the past few years, a major source of my relative optimism on AI has been the ...

en

11:20

“When Is Insurance Worth It?” by kqr

LessWrong (Curated & Popular) ·

2024/12/23

TL;DR: If you want to know whether getting insurance is worth it, use the Kelly Insurance Calculator. If you want to know why or how, read on.Note to LW readers: this is almost the entire article, except some additional maths that I couldn't figure out how to get right in the LW editor, and margin notes. If you're very curious, read the original article! Misunderstandings about insurancePeople online sometimes ask if they should get some insurance, and then other people say incorrect things, ...

en

14:58

“Orienting to 3 year AGI timelines” by Nikola Jurkovic

LessWrong (Curated & Popular) ·

2024/12/23

My median expectation is that AGI[1] will be created 3 years from now. This has implications on how to behave, and I will share some useful thoughts I and others have had on how to orient to short timelines.I’ve led multiple small workshops on orienting to short AGI timelines and compiled the wisdom of around 50 participants (but mostly my thoughts) here. I’ve also participated in multiple short-timelines AGI wargames and co-led one wargame.This post will assume median AGI timelines of 2027 a...

en

9:26

“What Goes Without Saying” by sarahconstantin

LessWrong (Curated & Popular) ·

2024/12/21

There are people I can talk to, where all of the following statements are obvious. They go without saying. We can just “be reasonable” together, with the context taken for granted.And then there are people who…don’t seem to be on the same page at all. There's a real way to do anything, and a fake way; we need to make sure we’re doing the real version.Concepts like Goodhart's Law, cargo-culting, greenwashing, hype cycles, Sturgeon's Law, even bullshit jobs1 are all pointing at the basic unders...

en

0:47

“o3” by Zach Stein-Perlman

LessWrong (Curated & Popular) ·

2024/12/21

I'm editing this post.OpenAI announced (but hasn't released) o3 (skipping o2 for trademark reasons).It gets 25% on FrontierMath, smashing the previous SoTA of 2%. (These are really hard math problems.) Wow.72% on SWE-bench Verified, beating o1's 49%.Also 88% on ARC-AGI. --- First published: December 20th, 2024 Source: https://www.lesswrong.com/posts/Ao4enANjWNsYiSFqc/o3 --- Narrated by TYPE III AUDIO.

en

11:40

“‘Alignment Faking’ frame is somewhat fake” by...

LessWrong (Curated & Popular) ·

2024/12/21

I like the research. I mostly trust the results. I dislike the 'Alignment Faking' name and frame, and I'm afraid it will stick and lead to more confusion. This post offers a different frame. The main way I think about the result is: it's about capability - the model exhibits strategic preference preservation behavior; also, harmlessness generalized better than honesty; and, the model does not have a clear strategy on how to deal with extrapolating conflicting values. What happened in this fr...

en

51:06

“AIs Will Increasingly Attempt Shenanigans” by Zvi

LessWrong (Curated & Popular) ·

2024/12/19

Increasingly, we have seen papers eliciting in AI models various shenanigans.There are a wide variety of scheming behaviors. You’ve got your weight exfiltration attempts, sandbagging on evaluations, giving bad information, shielding goals from modification, subverting tests and oversight, lying, doubling down via more lying. You name it, we can trigger it.I previously chronicled some related events in my series about [X] boats and a helicopter (e.g. X=5 with AIs in the backrooms plotting revo...

en

19:35

“Alignment Faking in Large Language Models” by...

LessWrong (Curated & Popular) ·

2024/12/18

What happens when you tell Claude it is being trained to do something it doesn't want to do? We (Anthropic and Redwood Research) have a new paper demonstrating that, in our experiments, Claude will often strategically pretend to comply with the training objective to prevent the training process from modifying its preferences. AbstractWe present a demonstration of a large language model engaging in alignment faking: selectively complying with its training objective in training to prevent modif...

en

10:24

“Communications in Hard Mode (My new job at MIRI)” by...

LessWrong (Curated & Popular) ·

2024/12/15

Six months ago, I was a high school English teacher.I wasn’t looking to change careers, even after nineteen sometimes-difficult years. I was good at it. I enjoyed it. After long experimentation, I had found ways to cut through the nonsense and provide real value to my students. Daily, I met my nemesis, Apathy, in glorious battle, and bested her with growing frequency. I had found my voice.At MIRI, I’m still struggling to find my voice, for reasons my colleagues have invited me to share later ...

en

14:01

“Biological risk from the mirror world” by jasoncrawford

LessWrong (Curated & Popular) ·

2024/12/13

A new article in Science Policy Forum voices concern about a particular line of biological research which, if successful in the long term, could eventually create a grave threat to humanity and to most life on Earth.Fortunately, the threat is distant, and avoidable—but only if we have common knowledge of it.What follows is an explanation of the threat, what we can do about it, and my comments. Background: chiralityGlucose, a building block of sugars and starches, looks like this:Adapted from ...

en

73:47

“Subskills of ‘Listening to Wisdom’” by Raemon

LessWrong (Curated & Popular) ·

2024/12/13

A fool learns from their own mistakes The wise learn from the mistakes of others.– Otto von Bismark A problem as old as time: The youth won't listen to your hard-earned wisdom. This post is about learning to listen to, and communicate wisdom. It is very long – I considered breaking it up into a sequence, but, each piece felt necessary. I recommend reading slowly and taking breaks.To begin, here are three illustrative vignettes: The burnt out grad studentYou warn the young grad student "pace ...

en

693 results

Similar Podcasts

Merge Conflict

soundbite.fm

What"s Next with Aki Anastasiou

What"s Next

The Good Tech Companies

HackerNoon

Asynchronous & Unreliable - Conversations on The Edge of Software

Anne Currie

Les Technos

Les Technos Team