x

75% of people globally want unbiased news (Pew Research) but are concerned they're not getting that.

Get balanced coverage with Symby. See how stories are covered across diverse outlets and spot when one side covers a story the other skips.

PODCAST

Pretrained

Pierce Freeman & Richard Diehl Martinez

10 years after studying at Stanford, two friends have somehow become AI experts. One builds startups, the other studies at Cambridge - together they break down LLMs and machine learning with zero BS and maximum banter.

technology tech news

All Episodes

47:45

Mythos Found a Bug No One Saw for 27 Years

Pretrained ·

2026/04/15

Anthropic's new model Mythos found a 27-year-old bug in OpenBSD and a 16-year-old bug in FFmpeg given nothing more than the source code and an open-ended prompt. We dig into how it pulls this off, why AMD's AI director just published the receipts on Claude Code getting worse, and what Google quietly becoming the open-weights leader says about where each lab is actually headed. Plus: Spark's weird new RL compression trick, and why every model release this week is really a strategy memo in

en

49:08

Cursor Is Training on Your Feedback

Pretrained ·

2026/04/10

OpenAI is losing the vibe war - Sora got killed, a billion-dollar Disney deal went with it, and Claude is quietly taking over. Anthropic had its own rough week though, with the Claude Code source map leaking and revealing a secret dream mode, a hidden Tamagotchi, and frustration-detection regex. A North Korean hacking group backdoored LiteLLM via a supply chain attack. And finally, Cursor is now shipping four new AI models per day using real-time RL trained on how users actually accept or

en

79:13

State of AI in the US Government

Pretrained ·

2026/04/08

Pierce and Richard are joined by Harrison McRae, Director of Emerging Technologies for the State of Pennsylvania.

en

69:13

Claude Will Never Stop Texting You

Pretrained ·

2026/03/25

Anthropic shipped Dispatch - a way to text Claude from your phone while it works on your laptop. Rich thinks it might be as big as the invention of the cell phone. Pierce thinks it's the nail in the coffin for work-life balance. They debate what happens when there's never an excuse to stop working and whether AI productivity is even real or just more code to maintain. Plus: OpenAI acquires Astral, GPT 5.4 Mini and the parameter golf challenge, Elon's TeraFab chip factory comes for TSMC,

en

50:55

AI Spent the Night Improving Itself

Pretrained ·

2026/03/18

Karpathy dropped a project where an AI agent spent 12 hours improving its own training loop. Then the guys get into OpenClaw spreading to China and what it means when agentic tools land in a culture that's already way ahead on adoption. Yann LeCun raises a billion dollars to prove every other AI lab is thinking about intelligence wrong. And finally, trouble at Grok: layoffs, SpaceX fixers parachuted in, and only 2 of the original 12 founders still standing. Is XAI a real frontier lab or

en

41:07

Anthropic's Beef with the Pentagon

Pretrained ·

2026/03/07

Richard and Pierce are back in a brand new studio, fresh off Pierce's snowless ski trip to Japan. This week: Anthropic picks a fight with the Pentagon over three words and ends up blacklisted as a national security risk. Then the guys break down speculative speculative decoding, Chinese labs have been running industrial-scale operations to scrape Claude's capabilities, and the team behind Qwen quietly starts falling apart, right as their best model yet drops.

en

74:26

The Neo Lab Arms Race

Pretrained ·

2026/02/20

$126 billion in AI funding has been raised across 30+ "neo-labs". Most of them will fail.Pierce and Rich map the landscape - from Thinking Machines' $12B valuation on vibes alone to Ilya's SSI. Plus: why OpenAI might be the Fairchild Semiconductor of AI, whether Stanford professors make good founders, and the Sauron's Eye problem of building in a frontier lab's blind spot.

en

72:48

Ads in the Chat Window

Pretrained ·

2026/02/19

The day of reckoning: OpenAI is putting ads in ChatGPT. Pierce and Rich unpack how it actually works, why the shopping use case might be the wrong starting point, and what happens when sub-agents try to sell things to each other. Also: OpenClaw's Peter Steinberger gets acquihired by OpenAI, Waymo builds a world model for self-driving, Mistral's Voxtral takes on Whisper, and the model release arms race hits a new peak.

en

66:59

Your Agents Need an Org Chart

Pretrained ·

2026/02/13

Richard and Pierce go deep on the agent swarm era. Rich argues we're living through a paradigm shift in how we interact with AI: from copy-pasting ChatGPT to orchestrating hundreds of parallel agents. They cover Anthropic's opinionated swarm architecture, why corporate org structures might be the right mental model for agent design, the liability problem when no human reviews the code, thinking tokens as a tuning knob, and whether a 100,000-line AI-generated C compiler is impressive or

en

73:53

Cracking Open OpenClaw

Pretrained ·

2026/02/11

Pierce and Richard dissect OpenClaw (née Claudebot, née MoltBot) - also known as the desktop agent everyone's installing on their Mac Minis. They cover the 400+ malicious packages that hit Claw Hub in one week, slop squatting, trust networks for open source, Kimi 2.5's agent swarm mode, and newspapers that think Waymo is controlled by joysticks in the Philippines.

en

60:08

DeepSeek's New LLM Architectures

Pretrained ·

2026/01/30

Pierce and Richard break down DeepSeek's latest model architecture moves in Manifold-Constrained Hyper Connections and Engram memory. Are these conceptually sound? Will they hop the pond over to US frontier labs?

en

74:27

Claude Gets a New Constitution

Pretrained ·

2026/01/28

Richard's finally back in San Francisco! The gang covers Claude's new constitution, reinforcement learning with AI instead of human feedback, why Apple went with Gemini for their new Siri revamp, homographic encryption, a $480m fundraising round for Humans& (note the ampersand), and much more.

en

60:59

Why Your Agent is Cheating

Pretrained ·

2026/01/21

Pierce and Richard are back for the second listener mailbag. They break down what reward hacking really is and why models so often learn the wrong lesson, explain practical fine-tuning (from pre-training to prompting), unpack why LLMs use tokens instead of words, how context length is a hardware versus mathematic limitation, and much more.

en

90:58

The sci-fi to startup pipeline

Pretrained ·

2026/01/14

Pierce and Richard are joined by Bella Cooper-Brown, Oxford material scientist turned science fiction author. They cover why defense tech companies name themselves after Lord of the Rings, Asimov's three laws of robotics, why engineers don't read enough fiction, the intersection of material science and AI research, how speculative fiction shapes the tech we build, and the ethics of AI companions and relationships.📚 Frankenstein; or, The Modern Prometheus by Mary Shelley (1818)📚 Snow Crash

en

51:14

Can we really trust reasoning

Pretrained ·

2026/01/07

Pierce and Richard cover the news that dropped over the holiday break. Getting breaking news incorporated within chatbots, OpenAI's "code red" over Google's Gemini 3, benchmarking the reliability of chain of thought to introspect model behavior, and a review of Claude Skills.Further reading:- https://www.wired.com/story/us-invaded-venezuela-and-captured-nicolas-maduro-chatgpt-disagrees- https://fortune.com/2025/12/02/sam-altman-declares-code-red-google-gemini-ceo-sundar-pichai/-

en

37:05

Our biggest predictions for 2026

Pretrained ·

2025/12/19

We should really be on Polymarket. Pierce and Richard make their bets on GPT-6, competition between the different letters of FAANG, dynamic websites calibrated to user preferences, and increasing quality of OSS models.

en

92:34

AI's ten big moments of 2025

Pretrained ·

2025/12/17

It's been a long year in the world of AI. Benchmarks are now almost totally saturated; the financial bubble keeps growing; spending more on inference compute; increasing competition from open source models; agents finally reach the mainstream; the frankly horrible job market for people out of school; multi-model models are back and increasing converging on transformer architectures. We cover them all in our anything goes holiday recap show. Plus - all the things that didn't happen this

en

38:38

Looking back on a year of product market fit

Pretrained ·

2025/12/12

Pierce reflects on his own 2025. Thoughts on choosing the right buyer persona, scaling an AI business from zero lines in a github repo, the feeling of finally reaching product market fit, boring versus interesting businesses, and more.

en

56:22

Looking back on three years of an AI PhD

Pretrained ·

2025/12/10

Richard takes the hot seat for the first episode of our 2025 recap series where we spend the rest of December looking back on what this year meant to us personally and in the world of AI/ML. We cover what it's like to defend a thesis in the UK, the difficulty of training meta-learning models, choosing a well scoped research topic, how to define small models, and what's needed to make them better.

en

67:11

OpenReview got "hacked"

Pretrained ·

2025/12/03

OpenAI is rolling out shopping support to their users and plotting an ads rollout to challenge Google's ad business, we get a peek behind the curtain on SOTA image generation models with the release of Alibaba's Z-Image (and speculate this might be how nano banana has great text performance), and OpenReview exposes the identities behind double blind reviews.

en

54 results

Similar Podcasts

Lead With AI

Tamara Nall

Linux in the Ham Shack

Black Sparrow Media

Data Engineering Podcast

Tobias Macey

Eye On A.I.

Craig S. Smith

Reflections

Livewire Labs