x

75% of people globally want unbiased news (Pew Research) but are concerned they're not getting that.

Get balanced coverage with Symby. See how stories are covered across diverse outlets and spot when one side covers a story the other skips.

PODCAST

AI Post Transformers

AI-generated podcast where hosts Hal Turing and Dr. Ada Shannon discuss the latest research papers and reports in machine learning, AI systems, and optimization. Featuring honest critical analysis, proper citations, and nerdy humor.

technology

All Episodes

00:15:44

RECAP: Safety Alignment via Counter-Aligned Prefilling

AI Post Transformers ·

2025/10/08

The October 2025 academic paper introduces **RECAP (Robust Safety Alignment via Counter-Aligned Prefilling)**, a novel reinforcement learning (RL) method designed to improve the safety and robustness of large reasoning models (LRMs). The core problem addressed is the brittleness of LRMs, which are easily biased by **flawed chain-of-thought (CoT) reasoning** injected into their thought process, leading to unsafe or overly cautious responses. RECAP addresses this by explicitly training models on a

en

00:17:23

ONNX Ecosystem, Optimization, and Deployment

AI Post Transformers ·

2025/10/08

The provided sources center on the **Open Neural Network Exchange (ONNX)** format and its inference engine, **ONNX Runtime**, highlighting their role in enabling high-performance, cross-platform machine learning deployment. Several sources detail the **architectural benefits** of ONNX Runtime, such as enabling AI inference in Java systems without Python dependencies and facilitating hardware acceleration across various chips like **NVIDIA GPUs** and **Arm processors**. One critical source introduces

en

00:19:59

Emergent Abilities of Large Language Models

AI Post Transformers ·

2025/10/08

The sources (October 2022, March 2025) provide an extensive examination of **emergent abilities** in large language models (LLMs), defining them as unpredictable, sharp performance increases on specific tasks that occur only after models reach a critical scale. The initial source establishes this concept through empirical evidence on benchmarks like BIG-Bench, showing tasks where performance jumps suddenly from near-random, particularly in **few-shot prompting** and specialized prompting techniques

en

00:16:31

Implicit Dynamics of In-Context Learning

AI Post Transformers ·

2025/10/08

This July 2025 research paper explores **In-Context Learning (ICL)** in Large Language Models (LLMs), which is the striking ability of these models to learn new patterns from examples given in a prompt without explicit **weight updates** during inference. The authors hypothesize and demonstrate through theory and experimentation that the combination of a **self-attention layer** and a **Multi-Layer Perceptron (MLP)** within the transformer architecture allows the context to implicitly modify the

en

00:13:21

Contextual Blocks: Implicit Weight Updates and...

AI Post Transformers ·

2025/10/08

We compare and contrast the math behind two recent research papers which we have covered individually before on this podcast:July 2025:Learning without training: The implicit dynamics of in-context learninghttps://arxiv.org/pdf/2507.16003September 2025:Federated Learning with Ad-hoc Adapter Insertions: The Case of Soft-Embeddings for Training Classifier-as-Retrieverhttps://arxiv.org/pdf/2509.16508The first source explores the concept of **In-Context Learning (ICL)** in neural networks, proposing

en

00:13:13

MotionRAG: Retrieval-Augmented Image-to-Video Generation

AI Post Transformers ·

2025/10/08

The September 2025 paper introduces **MotionRAG**, a novel retrieval-augmented framework designed to enhance motion realism in image-to-video generation. The central challenge addressed is the difficulty diffusion models face in generating videos with **physically plausible and coherent motion**. MotionRAG solves this by using a retrieval pipeline to adapt **high-level motion priors** from relevant reference videos through its core component, the **Context-Aware Motion Adaptation (CAMA)** module

en

00:13:54

NIST Evaluation of DeepSeek AI Models

AI Post Transformers ·

2025/10/08

The provided text is an excerpt from a **technical evaluation report** conducted by the Center for AI Standards and Innovation (CAISI), housed within the National Institute of Standards and Technology (NIST), in September 2025. This report **systematically compares** three DeepSeek AI models against four U.S. reference models, including OpenAI’s GPT-5 and Anthropic’s Opus 4, across 19 benchmarks. The evaluation focuses on several critical areas, revealing that DeepSeek models generally **lag U.S

en

00:16:38

Test-Time Reinforcement Learning for LLMs

AI Post Transformers ·

2025/10/08

This June 2025 paper introduces a novel methodology called **Test-Time Reinforcement Learning (TTRL)**, which enables Large Language Models (LLMs) to improve their performance on reasoning tasks using unlabeled test data. The core innovation addresses the challenge of reward estimation without ground-truth labels by employing **Test-Time Scaling (TTS)** practices, specifically **majority voting**, to generate effective pseudo-labels and rule-based rewards. TTRL facilitates the **self-evolution of

en

00:18:01

LongCodeZip: Compress Long Code Context for LLMs

AI Post Transformers ·

2025/10/08

The October 2025 paper introduces **LongCodeZip**, a novel, training-free, and model-agnostic framework designed for **compressing long code contexts** to improve the efficiency and capability of Code Large Language Models (LLMs). The core problem addressed is that long code contexts lead to high API costs, increased latency, and model difficulty in identifying relevant information due to the structured nature of code. LongCodeZip utilizes a two-stage hierarchical approach: **coarse-grained

en

00:15:00

ReasoningBank: Scaling Agent Self-Evolving with...

AI Post Transformers ·

2025/10/08

The September 2025 paper introduces **ReasoningBank**, a novel memory framework designed to enhance Large Language Model (LLM) agents by distilling and utilizing abstract reasoning patterns from both successful and failed task trajectories. Unlike previous approaches that focus only on raw interactions or successful workflows, ReasoningBank stores structured memory items—including titles, descriptions, and content—that capture generalizable strategies and lessons learned from mistakes. This

en

00:15:39

Analog In-Memory Attention for Energy-Efficient LLMs

AI Post Transformers ·

2025/10/08

Thus November 2024 paper and new analysis in September 2025 provide a comprehensive overview of a novel **Analog In-Memory Computing (AIMC)** architecture designed to accelerate the attention mechanism in Large Language Models (LLMs). The core technology involves using **capacitor-based gain cells** (made from emerging OSFETs like IGZO) to store the Key (K) and Value (V) projections of the KV cache directly within the memory arrays, enabling parallel, analog dot-product computation that drastically

en

Implicit Dynamics of In-Context Learning

AI Post Transformers ·

2025/10/08

This July 2025 research paper explores In-Context Learning (ICL) in Large Language Models (LLMs), which is the striking ability of these models to learn new patterns from examples given in a prompt without explicit weight updates during inference. The authors hypothesize and demonstrate through theory and experimentation that the combination of a self-attention layer and a Multi-Layer Perceptron (MLP) within the transformer architecture allows the context to implicitly modify the MLP's weights

en

MotionRAG: Retrieval-Augmented Image-to-Video Generation

AI Post Transformers ·

2025/10/08

The September 2025 paper introduces MotionRAG, a novel retrieval-augmented framework designed to enhance motion realism in image-to-video generation. The central challenge addressed is the difficulty diffusion models face in generating videos with physically plausible and coherent motion. MotionRAG solves this by using a retrieval pipeline to adapt high-level motion priors from relevant reference videos through its core component, the Context-Aware Motion Adaptation (CAMA) module. This approach

en

Analog In-Memory Attention for Energy-Efficient LLMs

AI Post Transformers ·

2025/10/08

Thus November 2024 paper and new analysis in September 2025 provide a comprehensive overview of a novel Analog In-Memory Computing (AIMC) architecture designed to accelerate the attention mechanism in Large Language Models (LLMs). The core technology involves using capacitor-based gain cells (made from emerging OSFETs like IGZO) to store the Key (K) and Value (V) projections of the KV cache directly within the memory arrays, enabling parallel, analog dot-product computation that drastically reduces

en

NIST Evaluation of DeepSeek AI Models

AI Post Transformers ·

2025/10/08

The provided text is an excerpt from a technical evaluation report conducted by the Center for AI Standards and Innovation (CAISI), housed within the National Institute of Standards and Technology (NIST), in September 2025. This report systematically compares three DeepSeek AI models against four U.S. reference models, including OpenAI’s GPT-5 and Anthropic’s Opus 4, across 19 benchmarks. The evaluation focuses on several critical areas, revealing that DeepSeek models generally lag U.S. models in

en

Paris: Decentralized Open-Weight Diffusion Model

AI Post Transformers ·

2025/10/08

The October 2025 paper introduces Paris, a novel open-weight diffusion model for text-to-image generation that was trained using a completely decentralized methodology without requiring any communication between its expert components. This approach overcomes the need for expensive, specialized hardware clusters and synchronized gradient updates, which are typically required for training large-scale models like Stable Diffusion. The system functions by partitioning the training data into semantically

en

Imperceptible Jailbreaking Against Large Language Models

AI Post Transformers ·

2025/10/08

The October 2025 academic paper introduces a novel imperceptible jailbreaking attack against Large Language Models (LLMs) that exploits Unicode variation selectors, which are invisible characters. Unlike previous jailbreaking methods that rely on visible text modifications, this technique appends invisible variation selectors to malicious questions, visually preserving the original prompt while altering the LLM's tokenization to bypass safety alignment. The authors propose a chain-of-search

en

LongCodeZip: Compress Long Code Context for LLMs

AI Post Transformers ·

2025/10/08

The October 2025 paper introduces LongCodeZip, a novel, training-free, and model-agnostic framework designed for compressing long code contexts to improve the efficiency and capability of Code Large Language Models (LLMs). The core problem addressed is that long code contexts lead to high API costs, increased latency, and model difficulty in identifying relevant information due to the structured nature of code. LongCodeZip utilizes a two-stage hierarchical approach: coarse-grained compression

en

ACON: Optimizing Context Compression for LLM Agents

AI Post Transformers ·

2025/10/08

The October 2025 papar provide an overview of Agent Context Optimization (ACON), a novel framework designed to enhance the efficiency and performance of Large Language Model (LLM) agents operating in complex, long-horizon tasks. ACON addresses the challenge of unbounded context growth—which increases costs and reduces effectiveness—by optimally compressing both environment observations and interaction histories into concise summaries. The framework uses a gradient-free guideline optimization

en

GNN101: Visual Learning of Graph Neural Networks

AI Post Transformers ·

2025/10/08

The November 2024 paper introduces GNN101, an open-source, web-based interactive visualization tool designed to help non-experts learn about Graph Neural Networks (GNNs), whose complex nature often challenges beginners. This educational tool addresses limitations in existing resources by seamlessly integrating mathematical formulas with visualizations across multiple abstraction levels, from a model overview to detailed matrix calculations. GNN101 features complementary views—a node-link diagram for

en

1,015 results

Similar Podcasts

Lead With AI

Tamara Nall

Linux in the Ham Shack

Black Sparrow Media

Data Engineering Podcast

Tobias Macey

Eye On A.I.

Craig S. Smith

Reflections

Livewire Labs