PODCAST

Seventy3

任雨山

73播客，名字取材于Sheldon最喜欢的数字，内容由NotebookLM生成，每天跟随AI读AI业界论文。

technology

All Episodes

00:11:38

【第53期】Toward Optimal Search and Retrieval for RAG

Seventy3 ·

2024/11/22

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Toward Optimal Search and Retrieval for RAGSummaryThis document is a research paper that investigates the effectiveness of retrieval-augmented generation (RAG) for tasks such as question answering (QA). The authors examine the role of retrievers, which identify relevant documents, and readers, which process the retrieved information to generate responses. They perform experiments to determine how factors like the number of retrieved documents, gold

zh-cn

00:15:02

【第52期】DINO-WM：LeCun 的世界模型

Seventy3 ·

2024/11/21

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot PlanningSummaryThis academic research paper presents DINO World Model (DINO-WM), a new method for building task-agnostic world models for visual reasoning and control in robotics. DINO-WM leverages pre-trained visual features from DINOv2 to model the dynamics of the environment in latent space without reconstructing the visual world. This enables the system to plan and optimize

zh-cn

00:13:45

【第51期】研究表明4bit量化能使反学习失效

Seventy3 ·

2024/11/20

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Does your LLM truly unlearn? An embarrassingly simple approach to recover unlearned knowledgeSummaryThis research paper investigates a critical flaw in current machine unlearning methods for large language models (LLMs). The authors discover that applying quantization, a process used to compress and optimize LLMs for resource-constrained environments, can inadvertently restore "forgotten" knowledge. The paper provides a theoretical explanation for this

zh-cn

00:11:33

【第50期】精度的Scaling Laws

Seventy3 ·

2024/11/19

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Scaling Laws for PrecisionSummaryThis research paper investigates the impact of precision in training and inference on the performance of large language models. The authors explore how precision affects the effective parameter count and propose scaling laws that predict performance degradation due to low-precision training and post-training quantization. They find that overtrained models are more sensitive to post-training quantization, and that

zh-cn

00:22:46

【第49期】Responsibility in Multi-Agent Systems

Seventy3 ·

2024/11/18

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Measuring Responsibility in Multi-Agent SystemsSummaryThis research paper introduces a novel framework for quantitatively measuring responsibility in multi-agent systems. The authors extend the concept of causal responsibility, as defined by Parker et al., to include three metrics: proportion, probability, and entropy. These metrics provide a more nuanced understanding of an agent's involvement in achieving or preventing specific outcomes within a

zh-cn

00:24:24

【第48期】测试时训练TTT（test-time training）

Seventy3 ·

2024/11/17

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：The Surprising Effectiveness of Test-Time Training for Abstract ReasoningSummaryThis research paper investigates the effectiveness of test-time training (TTT) for improving the abstract reasoning capabilities of large language models (LLMs). The researchers demonstrate that TTT, a technique that involves updating model parameters during inference, can significantly enhance LLM performance on the Abstraction and Reasoning Corpus (ARC) benchmark. They

zh-cn

00:15:47

【第47期】LoRA vs Full Fine-tuning

Seventy3 ·

2024/11/16

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：LoRA vs Full Fine-tuning: An Illusion of EquivalenceSummaryThis research paper investigates the differences between two popular methods for fine-tuning large language models: full fine-tuning and Low-Rank Adaptation (LoRA). While both approaches can achieve comparable performance on downstream tasks, the authors show that these methods learn fundamentally different solutions. They analyze the spectral properties of weight matrices to identify "intruder

zh-cn

00:16:25

【第46期】大模型的数据会用完吗？

Seventy3 ·

2024/11/15

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Will we run out of data? Limits of LLM scaling based on human-generated dataSummaryThis research paper investigates whether the limited availability of public human text data could constrain the continued scaling of large language models (LLMs). The authors use statistical models to predict when the total available stock of text data will be exhausted based on current LLM development trends, concluding that this could happen as early as 2026. The paper

zh-cn

00:16:39

【第45期】SeqComm：多智能体通讯机制

Seventy3 ·

2024/11/14

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Multi-Agent Coordination via Multi-Level CommunicationSummaryThis research paper introduces a novel multi-agent communication scheme called Sequential Communication (SeqComm) that aims to improve coordination in cooperative multi-agent reinforcement learning (MARL) tasks. SeqComm tackles the coordination problem by treating agents asynchronously, allowing them to make decisions sequentially based on the actions of higher-level agents. The paper

zh-cn

00:23:59

【第44期】MIPRA解读

Seventy3 ·

2024/11/13

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：A New Generation of Rules-based Approach: Mivar-based Intelligent Planning of Robot Actions (MIPRA) and Brains for Autonomous RobotsSummaryThis paper proposes a new approach to planning robot actions, based on the Mivar expert system, and explores the effectiveness of this method in comparison with existing planning techniques. The authors present the MIPRA (Mivar-based Intelligent Planning of Robot Actions) planner, which utilizes a "white box"

zh-cn

00:21:04

【第43期】Reward Centering

Seventy3 ·

2024/11/12

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Reward CenteringSummaryThis research paper investigates the effectiveness of reward centering, a technique that involves subtracting the average reward from observed rewards in reinforcement learning problems. The authors demonstrate that this simple method can significantly improve the performance of standard reinforcement learning algorithms, particularly when using discounted rewards and as the discount factor approaches one. They explain the

zh-cn

00:13:49

【第42期】SELA：使用MCTS增强LLM

Seventy3 ·

2024/11/11

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：SELA: Tree-Search Enhanced LLM Agents for Automated Machine LearningSummaryThe source explores a new method for automated machine learning called Tree-Search Enhanced LLM Agents (SELA). SELA uses a large language model (LLM) to suggest potential machine learning strategies, then employs Monte Carlo Tree Search (MCTS) to efficiently explore these options, iteratively refining its approach based on experimental results. This process mimics the nuanced

zh-cn

00:12:00

【第41期】Multimodal RAG

Seventy3 ·

2024/11/10

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Beyond Text: Optimizing RAG with Multimodal Inputs for Industrial ApplicationsSummaryThis research paper investigates the effectiveness of incorporating images alongside text in Retrieval Augmented Generation (RAG) systems for industrial applications. The authors explore two approaches for integrating multimodal models into RAG systems: using multimodal embeddings and generating textual summaries from images. The study compares the performance of these

zh-cn

00:14:27

【第40期】LLM使用bag of heuristics求解数学问题

Seventy3 ·

2024/11/09

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Arithmetic Without Algorithms: Language Models Solve Math With a Bag of HeuristicsSummaryThis research investigates how large language models (LLMs) perform arithmetic tasks. Instead of using complex algorithms or memorizing training data, the authors discovered that LLMs rely on a "bag of heuristics". These heuristics are simple rules or patterns learned from the training data that are applied to specific numerical inputs. The study shows that these

zh-cn

00:14:42

【第39期】AFlow自动生成工作流

Seventy3 ·

2024/11/08

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：AFlow: Automating Agentic Workflow GenerationSummaryThis research paper presents AFLOW, a novel framework for automated workflow optimization for large language models (LLMs). It tackles the challenge of manually designing and refining agentic workflows, which are structured sequences of LLM invocations, by using Monte Carlo Tree Search (MCTS) to explore the vast search space of possible workflows. AFLOW represents these workflows as code-represented

zh-cn

00:12:04

【第38期】OpenAI的论文：SimpleQA

Seventy3 ·

2024/11/07

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Measuring short-form factuality in large language modelsSummaryThis document introduces SimpleQA, a new benchmark for evaluating the factuality of large language models. The benchmark consists of over 4,000 short, fact-seeking questions designed to be challenging for advanced models, with a focus on ensuring a single, indisputable answer. The authors argue that SimpleQA is a valuable tool for assessing whether models "know what they know", meaning

zh-cn

00:08:46

【第37期】认知的几何特征

Seventy3 ·

2024/11/06

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：The Geometry of Concepts: Sparse Autoencoder Feature StructureSummaryThis research paper investigates the structure of the "concept universe" within large language models (LLMs), specifically focusing on sparse autoencoders (SAEs). The authors examine the organization of SAE features at three distinct scales. At the atomic scale, they discover "crystals" reflecting semantic relations between concepts, similar to the well-known "king:man::queen:woman"

zh-cn

00:11:08

【第36期】HIL-SERL

Seventy3 ·

2024/11/05

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement LearningSummaryThe research paper "Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learning" investigates the effectiveness of human-in-the-loop reinforcement learning (HIL-SERL) for training robots to perform complex manipulation tasks. The researchers present a system that combines human demonstrations and corrections with sample-efficient

zh-cn

00:15:45

【第35期】DriveDreamer4D

Seventy3 ·

2024/11/04

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene RepresentationSummaryDriveDreamer4D is a novel framework that enhances 4D driving scene representation by leveraging world models. The system uses a world model to synthesize novel trajectory video data, which is then incorporated into a 4D Gaussian Splatting (4DGS) model. The integration of the world model into the 4DGS framework allows for the creation of more realistic and

zh-cn

00:16:29

【第34期】Heterogeneous Pre-trained Transformers

Seventy3 ·

2024/11/03

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained TransformersSummaryThis research paper proposes a new architecture called Heterogeneous Pre-trained Transformers (HPT) to address the challenges of training generalist robotic models. HPT leverages a shared "trunk" transformer network to learn a task-agnostic and embodiment-agnostic representation from diverse robotic datasets, including real-world robots, simulations, and human

zh-cn

578 results

Seventy3

All Episodes

Similar Podcasts

Lead With AI

Tamara Nall

Linux in the Ham Shack

Black Sparrow Media

Data Engineering Podcast

Tobias Macey

Eye On A.I.

Craig S. Smith

Reflections

Livewire Labs