x

75% of people globally want unbiased news (Pew Research) but are concerned they're not getting that.

Get balanced coverage with Symby. See how stories are covered across diverse outlets and spot when one side covers a story the other skips.

PODCAST

Interconnects

Audio essays about the latest developments in AI and interviews with leading scientists in the field. Breaking the hype, understanding what"s under the hood, and telling stories. www.interconnects.ai

technology

All Episodes

10:46

How to cultivate a high-signal AI feed

Interconnects ·

2024/02/28

Basic tips on how to assess inbound ML content and cultivate your news feed.This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen.Source code: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/making-a-ml-feed00:00 How I assess all these AI releases01:22 1. Model access and demos are king of credibility02:31 2. Focus your feed on depth or breadth03:09 3. Examples of using the model normally show its usable,

en

17:17

Google ships it: Gemma open LLMs and Gemini backlash

Interconnects ·

2024/02/22

Google rejoins the open model party and gets some backlash for a frequent problem for generative AI.This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen.Source code: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/gemma-google-ships-it00:00 Google ships it: Gemma open LLMs and Gemini backlash03:12 Getting to know Gemma07:11 Alignment details08:55 Aside: What is REINFORCE? Some history of RL11:08 Implementation

en

14:58

10 Sora and Gemini 1.5 follow-ups: code-base in...

Interconnects ·

2024/02/20

10 Sora and Gemini 1.5 follow-ups: code-base in context, deepfakes, pixel-peeping, inference costs, and moreThis is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen.Source code: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/sora-gemini-follow-up00:00 10 Sora and Gemini 1.5 follow-ups: code-base in context, deepfakes, pixel-peeping, inference costs, and more00:46 1. Deepfake detection of Sora01:59 2. Playing with

en

9:07

Releases! OpenAI’s Sora for video, Gemini 1.5's...

Interconnects ·

2024/02/16

Emergency blog! Three things you need to know from the ML world that arrived yesterday.This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen.Source code: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/sora-gemini-and-mistral-next0:00 OpenAI's Sora for video, Gemini 1.5, and a secret Mistral model0:53 Sora: OpenAI's text-to-video model4:59 Gemini 1.5: Google's effectively infinite context length8:01

en

7:44

Why reward models are still key to understanding...

Interconnects ·

2024/02/14

In an era dominated by direct preference optimization and LLMasajudge, why do we still need a model to output only a scalar reward?This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen.Source code: https://github.com/natolambert/interconnects-toolsOriginal post: In an era dominated by direct preference optimization and LLM-as-a-judge, why do we still need a model to output only a scalar reward?Podcast figures:Figure 1:

en

10:19

Alignment-as-a-Service: Scale AI vs. the new guys

Interconnects ·

2024/02/07

Scale's making over $750 million per year selling data for RLHF, who's coming to take it?This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen.Source code: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/alignment-as-a-service00:00 Alignment-as-a-Service upstarts taking on Scale AI04:25 The competition with humans-in-the-loop06:05 Scaling Alignment-as-a-Service via AI feedbackPodcast figures:Figure 1:

en

9:28

Open Language Models (OLMos) and the LLM landscape

Interconnects ·

2024/02/01

A small model at the beginning of big changes.This is AI generated audio with Python and 11LabsSource code: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/olmo0:00 Open Language Models (OLMos) and the LLM landscape6:24 Thought experiments7:51 The LLM landscape heading into 2024Figure 1: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/olmo/img_010.png

en

19:05

Model merging lessons in The Waifu Research Department

Interconnects ·

2024/01/29

Note: some of the audio in the second half is a little wonky, but the general voice was upgraded so hopefully it's a little less "poppy" until then!I'm trying to fix little pronunciation problems on a weekly basis. Thanks to my early fans! It'll keep improving. E.g. some of the months were wonky.When what seems like pure LLM black magic is actually supported by the literature.This is AI generated audio with Python and 11LabsSource code:

en

9:59

Local LLMs, some facts some fiction

Interconnects ·

2024/01/24

Local LLMs: the latency solution, Meta's open AGI, personalization myth, and moats X factorThe deployment path that'll break through in 2024. Plus, checking in on strategies across Big Tech and AI leaders.This is AI generated audio with Python and 11LabsSource code: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/local-llms0:00 Local LLMs: the latency solution, Meta's open AGI, personalization myth, and moats X factor4:15 The personalization

en

8:18

Multimodal blogging: My AI tools to expand your audience

Interconnects ·

2024/01/17

A fun demo on how generative AI can transform content creation, and tools for my fellow writers on Substack!This is AI generated audio with Python and 11LabsSource code: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/multimodal-blogging-tools0:00 Multimodal blogging tools2:57 Stratechery, passport, and wonderful customer experiences5:51 Wrap-up, features, and next stepsFigure 1:

en

15:59

Multimodal LM roundup: Unified IO 2, inputs and...

Interconnects ·

2024/01/10

A sampling of recent happenings in the multimodal space. Be sure to expect more this year.This is AI generated audio with Python and 11LabsSource code: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/multimodal-rlhf00:00 Multimodal LM roundup: Unified IO 2, inputs and outputs, Gemini, LLaVA-RLHF, and RLHF questions02:46 Unified IO 2: Scaling multi-input, multi-output model pretraining07:47 Collecting preference data for images09:31 LLaVA-RLHF:

en

13:41

Where 2024’s “open GPT4” can’t match OpenAI’s

Interconnects ·

2024/01/05

And why the comparisons don't really matter. Repeated patterns in the race for reproducing ChatGPT, another year of evaluation crises, and people who will take awesome news too far.This is AI generated audio with Python and 11LabsSource code: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/open-gpt4-limitations00:00 Where 2024's "open GPT4" can't match OpenAI's03:19 Models vs. products04:51 RLHF progress: Revisiting Llama 2's release and

en

9:57

It's 2024 and they just want to learn

Interconnects ·

2024/01/03

The state of the ML communities big and small starting 2024. My general expectations for the year.This is AI generated audio with Python and 11LabsSource code: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/they-want-to-learn(00:00) - 2024 vibe check: They just want to learn(04:06) - Tribes, E/Science, and the third rail

en

14:45

Interconnects year in review: 2023

Interconnects ·

2023/12/28

The core themes of ML and the blog this year. What changes in 2024.This is AI generated audio with Python and 11Labs. Source code can be found here: https://github.com/natolambert/interconnects-toolsOriginal post: https://www.interconnects.ai/p/2023-review00:00 Interconnects year in review: 202301:45 Brief 2024 predictions03:37 Top posts of the year05:07 Trends05:11 RLHF capabilities and understanding07:09 Open LLM ecosystem progress08:38 LLM techniques pieces10:12 Model releases11:15

en

35:47

Interviewing Tri Dao and Michael Poli of Together AI...

Interconnects ·

2023/12/21

This interview is on YouTube and podcast players.Giving a voice to researchers is the best way to cut through the noise and understand what is happening with core developments of LLM technologies. I’m excited to get to talk with Michael Poli (Stanford PhD student + research at Together AI) and Tri Dao (incoming professor at Princeton + Chief Scientist at Together AI). This builds on the mega-post from yesterday on the same topics, though the interview is obviously less math heavy:Interconnects is a

en

35:47

Interviewing Tri Dao and Michael Poli of Together AI...

Interconnects ·

2023/12/21

Michael Poli is a PhD student at Stanford and a researcher at Together AI. https://zymrael.github.io/Tri Dao is the Chief Scientist at Together AI and an incoming assistant professor at Princeton University. https://tridao.me/The introduction to this post can be found here: https://interconnects.ai/p/llms-beyond-attentionI've omitted the generative audio for this post due to the heavy reliance on plots and technical content. Please enjoy this interview as an entry point, and check out the

en

10:31

Big Tech's LLM evals are just marketing

Interconnects ·

2023/12/13

Big Tech's LLM evals are just marketingA PSA everyone needs. The importance of a wait and see attitude when it comes to new models, big and small, open and closed.Read the post here: https://www.interconnects.ai/p/evals-are-marketing

en

16:46

Mixtral: The best open model, MoE trade-offs, release...

Interconnects ·

2023/12/11

(some buggy audio in this one, from MoE rather than Mixtral lol)Mixtral: The best open model, MoE trade-offs, release lessons, Mistral raises $400mil, Google's loss, vibes vs marketingWe have an amazing open mixture of experts model for the holidays!Full post: https://www.interconnects.ai/p/mixtral

en

17:27

The DPO debate: Do we need RL for RLHF?

Interconnects ·

2023/12/06

Direct vs. RL methods for preferences, more RLHF models, and hard truths in open RLHF work. We have more questions than answers.Read the full post here.

en

17:03

Synthetic data: Anthropic’s CAI, from fine-tuning to...

Interconnects ·

2023/12/03

Synthetic data is the accelerator of the next phase of AI — what it is and what it means.For the post, see it here: https://www.interconnects.ai/p/llm-synthetic-data

en

140 results

Similar Podcasts

Lead With AI

Tamara Nall

Linux in the Ham Shack

Black Sparrow Media

Data Engineering Podcast

Tobias Macey

Eye On A.I.

Craig S. Smith

Reflections

Livewire Labs