PODCAST

Best AI papers explained

Enoch H. Kang

Cut through the noise. We curate and break down the most important AI papers so you don’t have to.

technology

All Episodes

00:12:02

Transformers can be used for in-context linear...

Best AI papers explained ·

2025/05/15

This paper explores how transformers can be used for in-context linear regression in the presence of endogeneity. The authors demonstrate theoretically that transformers can effectively handle endogeneity by implementing instrumental variables (IV) techniques, specifically the two-stage least squares (2SLS) method, through a gradient-based approach that converges exponentially. They propose an in-context pretraining method with theoretical guarantees and show through experiments that trained

00:21:27

Bayesian Concept Bottlenecks with LLM Priors

Best AI papers explained ·

2025/05/15

This document introduces BC-LLM, a novel method for creating Concept Bottleneck Models (CBMs) that are both accurate and interpretable. Traditional CBMs rely on a predefined set of concepts, limiting their effectiveness and requiring significant human effort. BC-LLM addresses this by integrating Large Language Models (LLMs) within a Bayesian framework to iteratively discover relevant concepts. The LLMs serve as a concept extraction mechanism and provide prior information, enabling the model to

00:11:52

In-Context Parametric Inference: Point or...

Best AI papers explained ·

2025/05/15

This paper presents an academic paper exploring the difference between Bayesian and frequentist statistical approaches within the context of deep learning. The paper compares point estimation and distribution estimation methods, specifically focusing on how they perform when used with in-context learners, which are trained to make these estimations based on observed data. The authors conduct experiments across various models and tasks to evaluate the performance of these two paradigms, ultimately

00:12:56

Enough Coin Flips Can Make LLMs Act Bayesian

Best AI papers explained ·

2025/05/15

This paper investigates whether Large Language Models (LLMs) utilize in-context learning (ICL) to perform reasoning consistent with a Bayesian framework. By using a simplified setting of biased coin flips and dice rolls, the authors analyze how LLMs update their internal probabilities based on provided examples. They find that LLMs often start with inherent biases (miscalibrated priors) but demonstrate behavior that broadly follows Bayesian updates when given sufficient evidence through ICL. The

00:17:15

Bayesian Scaling Laws for In-Context Learning

Best AI papers explained ·

2025/05/15

This academic paper investigates whether in-context learning (ICL) in large language models (LLMs) functions like a Bayesian learner, aiming to explain why performance increases with more examples. The authors propose and derive novel Bayesian scaling laws that model the relationship between the number of in-context examples and prediction accuracy. Through experiments on synthetic data with toy models and real-world LLMs on various tasks, they demonstrate that their Bayesian laws accurately predict

00:18:33

Posterior Mean Matching Generative Modeling

Best AI papers explained ·

2025/05/15

This paper introduces Posterior Mean Matching (PMM), a novel generative modeling technique rooted in Bayesian inference. Unlike traditional diffusion models, PMM employs conjugate pairs of distributions to flexibly model diverse data types such as images and text. The core mechanism involves iteratively refining noisy data approximations through online Bayesian inference updates, with the convergence of the posterior mean to the true data sample forming the basis for generating new data. The authors

00:22:21

Can Generative AI Solve Your In-Context Learning...

Best AI papers explained ·

2025/05/15

This work explores evaluating when a Conditional Generative Model (CGM) is suitable for an in-context learning (ICL) task. It introduces the concept of the generative predictive p-value, extending Bayesian model criticism techniques like posterior predictive checks (PPCs) to contemporary CGMs by generating simulated data to approximate sampling from a Bayesian model. This approach allows for assessing whether a model's inferences are reliable for a given ICL problem without requiring explicit

00:14:27

Dynamic Search for Inference-Time Alignment in...

Best AI papers explained ·

2025/05/15

This paper highlights the challenge of aligning diffusion models with desired outcomes by optimizing reward functions, especially when gradient information is unavailable. The core contribution is the proposal of DSearch, a novel gradient-free method that reframes this alignment as a search problem on a dynamically constructed tree representing the diffusion process. DSearch utilizes heuristic functions and dynamic scheduling to efficiently explore the search space and identify high-reward samples

00:16:06

Is In-Context Learning in Large Language Models...

Best AI papers explained ·

2025/05/12

This academic paper explores whether the in-context learning (ICL) process in Large Language Models (LLMs) behaves like Bayesian inference. The authors use the martingale property, a key characteristic of Bayesian systems with exchangeable data, as a framework for their analysis. They demonstrate that violations of this property and deviations in how LLMs' uncertainty scales with more data provide evidence that ICL is not Bayesian. The findings suggest that LLMs lack a principled understanding

00:14:03

Leaked Claude Sonnet 3.7 System Instruction tuning

Best AI papers explained ·

2025/05/12

We review leaked Claude Sonnet 3.7 System Instructions, outlining guidelines for citing information obtained from tools like web search and internal document searches, emphasizing the use of ⁠antml:cite⁠ tags for specific claims. It also describes the criteria and formats for creating "artifacts," such as code, documents, and visualizations, for collaborative content creation, including how to read user-uploaded files and use specific libraries within the analysis tool. Furthermore, the

00:09:56

Converging Predictions with Shared Information

Best AI papers explained ·

2025/05/11

We describe a concept from a paper by Blackwell and Dubins concerning the merging of opinions or probability predictions between two individuals, Alex and Ben, as they observe increasing amounts of shared information. The central idea is that if their predictive models are updateable based on new evidence and they agree on what events are absolutely impossible, their predictions for future events will become increasingly similar over time, eventually converging. While their short-term predictions

00:21:26

Test-Time Alignment Via Hypothesis Reweighting

Best AI papers explained ·

2025/05/11

This paper presents HYRE, a method for quickly adapting large pretrained models to underspecified tasks like personalization or handling distribution shifts. It works by first training a single neural network that represents an ensemble of diverse models. At test time, using a small set of labeled examples from the target distribution, HYRE dynamically reweights the ensemble members based on their performance, selecting the combination of models best suited for the specific task without retraining

00:17:25

Rethinking Diverse Human Preference Learning through...

Best AI papers explained ·

2025/05/11

This paper introduces Decomposed Reward Models (DRMs), a novel method for understanding and aligning large language models with the diverse nature of human preferences. Instead of relying on a single reward score, DRMs represent preferences as vectors and utilize Principal Component Analysis (PCA) to identify distinct directional preference components from readily available binary comparison data. This approach enables the extraction of interpretable preference dimensions, such as helpfulness,

00:15:59

Active Statistical Inference

Best AI papers explained ·

2025/05/10

Thiis paper introduces Active Statistical Inference, a novel approach for statistical inference that strategically utilizes a machine learning model to guide data collection under a labeling budget. By prioritizing the labeling of data points where the model is uncertain, this method aims to achieve more powerful inferences and smaller confidence intervals compared to traditional methods that collect data uniformly at random, even while using a black-box machine learning model and handling any data

00:13:21

Data Mixture Optimization: A Multi-fidelity...

Best AI papers explained ·

2025/05/10

This paper proposes a new method for optimizing the data mixtures used to train large language models (LLMs). Traditional approaches often rely on costly trial and error or deterministic extrapolations that don't account for uncertainty, limiting their effectiveness and transferability. The authors introduce a multi-fidelity multi-scale Bayesian optimization framework, treating data curation as a sequential decision-making process where decisions about data mixture, model scale, and training

00:17:55

AI-Powered Bayesian Inference

Best AI papers explained ·

2025/05/10

This document introduces a novel Bayesian statistical inference method that leverages Generative Artificial Intelligence (GAI) predictions. Instead of relying solely on limited observed data or traditional statistical models, the authors propose using GAI to create synthetic data, which then informs a non-parametric prior distribution within a Bayesian framework. This approach, termed AI-Powered Bayesian Inference, allows for robust uncertainty quantification and improved predictive inference by

00:21:09

Can Unconfident LLM Annotations Be Used for Confident...

Best AI papers explained ·

2025/05/09

This document presents a new method called CONFIDENCE-DRIVEN INFERENCE designed to improve the efficiency and accuracy of data annotation for tasks commonly found in computational social science. The core idea is to strategically combine large language model (LLM) annotations with a limited number of human annotations, guided by the LLM's expressed confidence levels. By prioritizing human input on examples where the LLM is less certain, this approach aims to reduce the overall need for expensive

00:19:42

Predictions as Surrogates: Revisiting Surrogate...

Best AI papers explained ·

2025/05/09

This paper explores a new method for statistical inference in the age of AI, focusing on how predictions from large pre-trained models can serve as efficient surrogates for costly or difficult-to-obtain outcomes. Drawing a connection to the established field of surrogate outcome models in biostatistics and economics, the authors propose recalibrated prediction-powered inference (RePPI). RePPI is presented as a more efficient approach than existing methods by learning an optimal "imputed

00:15:32

Learn then Test: Calibrating Predictive Algorithms to...

Best AI papers explained ·

2025/05/09

This paper presents the Learn then Test (LTT) framework, a novel approach for calibrating machine learning models to provide explicit statistical guarantees on their predictions. The method works with any underlying model and data distribution without requiring retraining. LTT reframes the problem of controlling statistical errors, such as false discovery rate, intersection-over-union, and type-1 error, as a multiple hypothesis testing problem. By generating p-values for different model prediction

00:14:32

How to Evaluate Reward Models for RLHF

Best AI papers explained ·

2025/05/09

This paper introduces Preference Proxy Evaluations (PPE), a novel benchmark designed to evaluate reward models for Reinforcement Learning from Human Feedback (RLHF) in large language models (LLMs). Unlike expensive end-to-end RLHF training, PPE utilizes proxy tasks to predict downstream LLM performance. These tasks include analyzing human preferences from a large dataset and assessing verifiable correctness preferences. The authors correlate these proxy metrics with real-world post-RLHF outcomes

552 results

Best AI papers explained

All Episodes

Similar Podcasts

Lead With AI

Tamara Nall

Linux in the Ham Shack

Black Sparrow Media

Data Engineering Podcast

Tobias Macey

Eye On A.I.

Craig S. Smith

Reflections

Livewire Labs