Loading...

PODCAST

LLM.co

Private and custom large language models — the build, the boundaries and the bill. Fine-tuning versus retrieval, running models in your own environment, evaluation you can actually trust, data governance, and the questions to ask before a vendor answers them for you. Each episode takes one decision a team is facing — whether your problem needs a custom model at all, how to evaluate output without fooling yourself, what "private" has to mean contractually — and works it through concretely. Written

technology management

All Episodes

4:54

What a Private GPU Cluster for 200 Users Actually Costs

LLM.co ·

2026/10/04

Most budget conversations about private AI infrastructure start and end with GPU sticker prices — and that's exactly where the planning goes wrong. This episode of LLM.co delivers a rigorous, component-by-component total cost of ownership analysis for a private large language model cluster serving 200 knowledge workers at a regulated organization, drawing on this detailed GPU cluster cost breakdown current to late 2026. Whether you're at a mid-sized bank, a hospital network, or a defense

en

5:03

What to Put in a Private LLM RFP Before You Sign

LLM.co ·

2026/09/30

Signing a private LLM vendor agreement without the right RFP language is how companies end up locked into data topologies, logging schemas, and termination terms they never agreed to — they simply never required anything different. This episode of LLM.co walks procurement leaders, CISOs, and heads of AI through the six contractual line items that actually determine whether a private LLM deal is enforceable — drawing directly from the private LLM RFP requirements checklist published on

en

4:47

Fixed-Scope, Managed Appliance, or Co-Build: Picking...

LLM.co ·

2026/09/27

With AI pilot failure rates hovering near eighty percent and tens of billions in enterprise spending producing little measurable return, the contract model behind a private LLM deployment deserves far more scrutiny than most buyers give it. This episode of LLM.co examines the three structures dominating the private LLM market today — drawing on the detailed breakdown of private LLM contract models on the LLM.co blog — and explains how each one allocates risk, ownership, and exit rights in

en

4:55

EU AI Act Conformity for Self-Hosted LLMs: What Your...

LLM.co ·

2026/09/23

The EU AI Act's December 2027 deadline for high-risk AI systems looks distant on a roadmap — but with notified body queues already growing and harmonised standards still being finalised, the organisations that will be ready are the ones assembling their evidence files now. This episode of LLM.co walks through the full conformity assessment requirements for self-hosted LLMs, cutting through the policy noise to focus on what a market surveillance authority would actually demand to see.The

en

4:32

Why DeepSeek's China Data Storage Policy Is an...

LLM.co ·

2026/09/20

DeepSeek has earned real attention for its speed and accessibility, but its privacy policy contains a detail that enterprise teams cannot afford to overlook. This episode of LLM.co examines the data storage risks behind DeepSeek's China policy and explains why where an AI platform stores your data matters just as much as what it can do with it.The conversation covers the full arc of the problem — from the legal mechanics of Chinese data sovereignty to the practical compliance exposure

en

4:46

How Enterprises Are Using Local LLMs for Fraud Detection

LLM.co ·

2026/09/16

Global fraud losses are on track to surpass half a trillion dollars, and the rigid, rules-based detection engines that financial institutions have trusted for years simply can't keep up. This episode of LLM.co explores how enterprises are deploying local LLMs to fight financial fraud — examining why on-premises AI is becoming the competitive edge for compliance-conscious organizations facing increasingly sophisticated threats like synthetic identity schemes, deepfake voice fraud, and

en

4:52

Debugging Hallucinations in Open Source Models

LLM.co ·

2026/09/15

Hallucinations — confident, fluent, and factually wrong AI outputs — are among the most damaging trust failures in production systems. This episode of LLM.co draws on the full guide to debugging hallucinations in open source models to walk through why these failures happen and, more importantly, how to trace them back to their root causes rather than chasing individual bad outputs.Language models don't retrieve facts — they predict likely text. Fluency and accuracy are not the same thing,

en

5:15

Why AI Projects Fail Organizationally Before They...

LLM.co ·

2026/09/11

Technical performance is rarely what kills an AI initiative. This episode of LLM.co examines the organizational and structural breakdowns that derail AI projects long before a model ever has a chance to prove itself — drawing on the full analysis of why AI projects fail organizationally before they fail technically. From how goals get defined to how tools get adopted, the conversation surfaces the patterns that repeat across teams and industries.The episode walks through the most common

en

5:11

CAPEX vs OPEX in Open Source AI: Why the Hybrid Wins

LLM.co ·

2026/09/09

When an AI project moves from demo to daily infrastructure, the conversation shifts fast — from model benchmarks to balance sheets. This episode of LLM.co tackles one of the most consequential decisions in any open source AI deployment: how you pay for it. Drawing on the in-depth guide to CAPEX vs. OPEX in open source AI, the episode cuts through the accounting jargon and explains how the choice between owning infrastructure and renting it shapes not just your first invoice, but your team

en

9 results

Similar Podcasts

Lead With AI

Tamara Nall

ev.news

Martyn Lee

Life and Technology with Charlie Brown

Tapt Media

Reflections

Livewire Labs

SuperToast

Instinct