PODCAST

AI Post Transformers

AI-generated podcast where hosts Hal Turing and Dr. Ada Shannon discuss the latest research papers and reports in machine learning, AI systems, and optimization. Featuring honest critical analysis, proper citations, and nerdy humor.

technology

All Episodes

Llama 3: Architecture, Capabilities, and Safety

AI Post Transformers ·

2025/09/14

On this November 2025 paper the Meta Llama Team's paper introduces Llama 3, a new family of large language models featuring 8B, 70B, and 405B parameters, designed with native multilingual support, coding, reasoning, and tool usage capabilities. The development emphasizes data quality and diversity, employing extensive filtering, de-duplication, and heuristic cleaning processes for both English and multilingual data, alongside scaling laws to optimize model size and training budgets. The models

00:17:52

All for One: LLMs Solve Mental Math at the Last Token

AI Post Transformers ·

2025/09/13

This September 2025 published research investigates how large language models (LLMs) perform mental math, particularly focusing on the flow of information and computational processes within their transformer architecture. The authors introduce two novel techniques, Context-Aware Mean Ablation (CAMA) and Attention-Based Peeking (ABP), to identify a minimal computational subgraph called All-for-One (AF1). This subgraph reveals that for mental math tasks, input-specific computation is largely

00:25:24

Survey of Reinforcement Learning for Large Reasoning...

AI Post Transformers ·

2025/09/13

This September 2025 paper provides a comprehensive overview of Reinforcement Learning (RL) as applied to Large Reasoning Models (LRMs). It breaks down the field into foundational components such as reward design and policy optimization, explaining various algorithms like PPO and GRPO. The document also discusses training resources, distinguishing between static corpora and dynamic environments, and highlights diverse applications of RL in LRMs, including coding, agentic tasks, and multimodal

00:16:09

SpikingBrain: Brain-Inspired LLMs for Efficient...

AI Post Transformers ·

2025/09/13

These September 2025 papers present a technical report on SpikingBrain, a novel family of large language models (LLMs) that draw inspiration from brain mechanisms to address the efficiency challenges of traditional Transformer architectures. The research focuses on efficient long-context training and inference by developing hybrid linear attention architectures and an adaptive threshold spiking neuron scheme. A significant aspect of this work is the successful training and deployment of these models

00:18:32

Statistical Methods for Generative AI Reliability

AI Post Transformers ·

2025/09/13

This September 2025 paper explores the critical role of statistical methods in enhancing the reliability and functionality of Generative AI (GenAI), which inherently lacks guarantees regarding correctness or safety. It discusses various statistical applications, including improving and altering model behavior through techniques like output trimming and abstention based on risk scores, often utilizing conformal prediction for provable guarantees. The text also covers diagnostics and uncertainty

Survey of Reinforcement Learning for LargeReasoning...

AI Post Transformers ·

2025/09/13

Statistical Methods for Generative AI Reliability

AI Post Transformers ·

2025/09/13

EntiGraph: Scaling Language Models with Synthetic...

AI Post Transformers ·

2025/09/13

This October 2024 paper introduces synthetic continued pretraining (synthetic CPT), a novel method designed to enhance language model knowledge acquisition from small, specialized text collections. Current large language models often struggle with data efficiency and learning niche facts from limited sources. The core of this approach is EntiGraph, a synthetic data augmentation algorithm that extracts entities and their relationships from a small corpus to generate a much larger, more diverse

SpikingBrain: Brain-Inspired LLMs for Efficient...

AI Post Transformers ·

2025/09/13

All for One: LLMs Solve Mental Math at the Last Token

AI Post Transformers ·

2025/09/13

00:23:11

EntiGraph: Scaling Language Models with Synthetic...

AI Post Transformers ·

2025/09/13

00:18:27

NOVELTYBENCH: Evaluating Language Model Diversity

AI Post Transformers ·

2025/09/12

This August 2025 paper introduces NOVELTYBENCH, a new benchmark designed to evaluate how well large language models (LLMs) generate diverse and high-quality outputs, addressing the problem of "mode collapse" where models produce repetitive responses. The research found that current state-of-the-art LLMs consistently generate less diversity than human writers, with larger models often exhibiting even lower diversity than their smaller counterparts. The benchmark uses a unique approach to measure

NOVELTYBENCH: Evaluating Language Model Diversity

AI Post Transformers ·

2025/09/12

Parallel-R1: Reinforcement Learning for Parallel...

AI Post Transformers ·

2025/09/12

This September 10, 2025 technical report from Tencent AI Lab introduces Parallel-R1, a novel reinforcement learning (RL) framework designed to enhance large language models (LLMs) with parallel thinking capabilities for complex mathematical reasoning tasks. Unlike previous methods relying on supervised fine-tuning (SFT) over synthetic data, Parallel-R1 utilizes a progressive curriculum to address the cold-start problem in RL, initially using SFT on simpler tasks to instill the basic format of

HyperController: Fast, Stable Reinforcement Learning...

AI Post Transformers ·

2025/09/12

This April 2025 paper introduces HyperController, a novel and computationally efficient algorithm designed to optimize hyperparameters during the training of reinforcement learning neural networks. Hyperparameter optimization is crucial for improving machine learning models, but traditional methods can be slow and computationally intensive. HyperController addresses these challenges by modeling the hyperparameter optimization problem as an unknown Linear Gaussian Dynamical System and leveraging the

00:18:59

HyperController: Fast, Stable Reinforcement Learning...

AI Post Transformers ·

2025/09/12

00:15:33

Parallel-R1: Reinforcement Learning for Parallel...

AI Post Transformers ·

2025/09/12

00:16:20

Explaining AI for Digital Advertising with LLMs

AI Post Transformers ·

2025/09/11

This April 2025 paper introduces SODA, a novel framework designed to enhance digital advertising strategies by making opaque AI systems more understandable for marketers. The authors highlight the current challenges faced by advertisers due to the lack of transparency in major ad platforms like Meta, which often results in wasted ad spend and reliance on intuition. To address this, SODA integrates Large Language Models (LLMs) with explainable AI techniques to provide clear, actionable insights into

00:17:23

AdLlama: Boosting Ad Performance with Reinforcement...

AI Post Transformers ·

2025/09/11

This July 2025 paper introduces AdLlama, a new large language model (LLM) for generating Facebook ad text, trained using Reinforcement Learning with Performance Feedback (RLPF). Unlike previous models that relied on supervised fine-tuning to imitate curated ads, AdLlama utilizes historical ad performance data, specifically click-through rates (CTR), as a reward signal to optimize its text generation. A large-scale A/B test on Facebook, involving nearly 35,000 advertisers, demonstrated that AdLlama

Explaining AI for Digital Advertising with LLMs

AI Post Transformers ·

2025/09/11

1,015 results

AI Post Transformers

All Episodes

Similar Podcasts

Lead With AI

Tamara Nall

Linux in the Ham Shack

Black Sparrow Media

Data Engineering Podcast

Tobias Macey

Eye On A.I.

Craig S. Smith

Reflections

Livewire Labs