x

75% of people globally want unbiased news (Pew Research) but are concerned they're not getting that.

Get balanced coverage with Symby. See how stories are covered across diverse outlets and spot when one side covers a story the other skips.

PODCAST

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Welcome to The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI— the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-evolving needs of data engineering and AI ecosystems. Podcast Webpage:

technology

All Episodes

38:54

Inside Ford’s Data Transformation: Advanced...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2025/01/16

Data engineering is entering a new era, where orchestration and automation are redefining how large-scale projects operate. This episode features Vasantha Kosuri-Marshall, Data and ML Ops Engineer at Ford Motor Company. Vasantha shares her expertise in managing complex data pipelines. She takes us through Ford's transition to cloud platforms, the adoption of Airflow and the intricate challenges of orchestrating data in a diverse environment.Key Takeaways:(03:10) Vasantha’s transition to the Advanced

en

24:35

Powering Finance With Advanced Data Solutions at Ramp...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2025/01/10

Data is the backbone of every modern business, but unlocking its full potential requires the right tools and strategies. In this episode, Ryan Delgado, Director of Engineering at Ramp, joins us to explore how innovative data platforms can transform business operations and fuel growth. He shares insights on integrating Apache Airflow, optimizing data workflows and leveraging analytics to enhance customer experiences.Key Takeaways:(01:52) Data is the lifeblood of Ramp, touching every vertical in the

en

30:24

Exploring the Power of Airflow 3 at Astronomer with...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/12/20

What does it take to go from fixing a broken link to becoming a committer for one of the world’s leading open-source projects?Amogh Desai, Senior Software Engineer at Astronomer, takes us through his journey with Apache Airflow. From small contributions to building meaningful connections in the open-source community, Amogh’s story provides actionable insights for anyone on the cusp of their open-source journey.Key Takeaways:(02:09) Building data engineering platforms at Cloudera with

en

24:11

Using Airflow To Power Machine Learning Pipelines at...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/12/12

Data orchestration and machine learning are shaping how organizations handle massive datasets and drive customer-focused strategies. Tools like Apache Airflow are central to this transformation. In this episode, Vasyl Vasyuta, R&D Team Leader at Optimove, joins us to discuss how his team leverages Airflow to optimize data processing, orchestrate machine learning models and create personalized customer experiences.Key Takeaways:(01:59) Optimove tailors marketing notifications with personalized

en

25:49

Maximizing Business Impact Through Data at...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/12/05

Bridging the gap between data teams and business priorities is essential for maximizing impact and building value-driven workflows. Katie Bauer, Senior Director of Data at GlossGenius, joins us to share her principles for creating effective, aligned data teams. In this episode, Katie draws from her experience at GlossGenius, Reddit and Twitter to highlight the common pitfalls data teams face and how to overcome them. She offers practical strategies for aligning team efforts with organizational goals

en

27:47

Optimizing Large-Scale Deployments at LinkedIn with...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/12/02

Scaling deployments for a billion users demands innovation, precision and resilience. In this episode, we dive into how LinkedIn optimizes its continuous deployment process using Apache Airflow. Rahul Gade, Staff Software Engineer at LinkedIn, shares his insights on building scalable systems and democratizing deployments for over 10,000 engineers.Rahul discusses the challenges of managing large-scale deployments across 6,000 services and how his team leverages Airflow to enhance efficiency,

en

28:44

How Uber Manages 1 Million Daily Tasks Using Airflow,...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/11/14

When data orchestration reaches Uber’s scale, innovation becomes a necessity, not a luxury. In this episode, we discuss the innovations behind Uber’s unique Airflow setup. With our guests Shobhit Shah and Sumit Maheshwari, both Staff Software Engineers at Uber, we explore how their team manages one of the largest data workflow systems in the world. Shobhit and Sumit walk us through the evolution of Uber’s Airflow implementation, detailing the custom solutions that support 200,000 daily pipelines

en

28:29

Building Resilient Data Systems for Modern...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/11/07

Efficient data orchestration is the backbone of modern analytics and AI-driven workflows. Without the right tools, even the best data can fall short of its potential. In this episode, Andrea Bombino, Co-Founder and Head of Analytics Engineering at Astrafy, shares insights into his team’s approach to optimizing data transformation and orchestration using tools like datasets and Pub/Sub to drive real-time processing. Andrea explains how they leverage Apache Airflow and Google Cloud to power dynamic

en

30:08

Inside Airflow 3: Redefining Data Engineering with...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/10/31

Data orchestration is evolving faster than ever and Apache Airflow 3 is set to revolutionize how enterprises handle complex workflows. In this episode, we dive into the exciting advancements with Vikram Koka, Chief Strategy Officer at Astronomer and PMC Member at The Apache Software Foundation. Vikram shares his insights on the evolution of Airflow and its pivotal role in shaping modern data-driven workflows, particularly with the upcoming release of Airflow 3.Key Takeaways:(02:36) Vikram leads

en

20:25

Building a Data-Driven HR Platform at 15Five with Guy...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/10/24

Data and AI are revolutionizing HR, empowering leaders to measure performance and drive strategic decisions like never before.In this episode, we explore the transformation of HR technology with Guy Dassa, Chief Technology Officer at 15Five, as he shares insights into their evolving data platform. Guy discusses how 15Five equips HR leaders with tools to measure and take action on team performance, engagement and retention. He explains their data-driven approach, highlighting how Apache Airflow

en

20:18

The Intersection of AI and Data Management at Dosu...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/10/04

Unlocking engineering productivity goes beyond coding — it’s about managing knowledge efficiently. In this episode, we explore the innovative ways in which Dosu leverages Airflow for data orchestration and supports the Airflow project.Devin Stein, Founder of Dosu, shares his insights on how engineering teams can focus on value-added work by automating knowledge management. Devin dives into Dosu’s purpose, the significance of AI in their product, and why they chose Airflow as the backbone for

en

26:11

AI-Powered Vehicle Automation at Ford Motor Company...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/09/12

Harnessing data at scale is the key to driving innovation in autonomous vehicle technology. In this episode, we uncover how advanced orchestration tools are transforming machine learning operations in the automotive industry. Serjesh Sharma, Supervisor ADAS Machine Learning Operations (MLOps) at Ford Motor Company, joins us to discuss the challenges and innovations his team faces working to enhance vehicle safety and automation. Serjesh shares insights into the intricate data processes that support

en

24:06

From Task Failures to Operational Excellence at...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/09/06

Data failures are inevitable but how you manage them can define the success of your operations. In this episode, we dive deep into the challenges of data engineering and AI with Brendan Frick, Senior Engineering Manager, Data at GumGum. Brendan shares his unique approach to managing task failures and DAG issues in a high-stakes ad-tech environment.Brendan discusses how GumGum leverages Apache Airflow to streamline data processes, ensuring efficient data movement and orchestration while minimizing

en

00:22:25

From Sensors to Datasets: Enhancing Airflow at...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/08/29

A 13% reduction in failure rates — this is how two data scientists at Astronomer revolutionized their data pipelines using Apache Airflow.In this episode, we enter the world of data orchestration and AI with Maggie Stark and Marion Azoulai, both Senior Data Scientists at Astronomer. Maggie and Marion discuss how their team re-architected their use of Airflow to improve scalability, reliability and efficiency in data processing. They share insights on overcoming challenges with sensors and how

en

00:24:36

Mastering Data Orchestration with Airflow at M...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/08/26

Mastering the flow of data is essential for driving innovation and efficiency in today’s competitive landscape. In this episode, we explore the evolution of data orchestration and the pivotal role of Apache Airflow in modern data workflows. Ben Tallman, Chief Technology Officer at M Science, joins us and shares his extensive experience with Airflow, detailing its early adoption, evolution and the profound impact it has had on data engineering practices. His insights reveal how leveraging Airflow

en

00:02:01

Welcome to The Data Flowcast

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/08/19

Welcome to The Data Flowcast: Mastering Airflow for Data Engineering & AI — the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward.Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-evolving needs of data engineering and AI ecosystems. #AI #Automation #Airflow #MachineLearning

en

00:23:51

Enhancing Business Metrics With Airflow at Artlist...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/08/15

Data orchestration is revolutionizing the way companies manage and process data. In this episode, we explore the critical role of data orchestration in modern data workflows and how Apache Airflow is used to enhance data processing and AI model deployment. Hannan Kravitz, Data Engineering Team Leader at Artlist, joins us to share his insights on leveraging Airflow for data engineering and its impact on their business operations. Key Takeaways: (01:00) Hannan introduces Artlist and its mission to

en

00:23:46

Cutting-Edge Data Engineering at Teya with Alexandre...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/08/08

Data engineering is constantly evolving and staying ahead means mastering tools like Apache Airflow. In this episode, we explore the world of data engineering with Alexandre Magno Lima Martins, Senior Data Engineer at Teya. Alexandre talks about optimizing data workflows and the smart solutions they've created at Teya to make data processing easier and more efficient.Key Takeaways: (02:01) Alexandre explains his role at Teya and the responsibilities of a data platform engineer. (02:40) The

en

00:26:10

Airflow Strategies for Business Efficiency at...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/07/25

Managing data workflows well can change the game for any company. In this episode, we talk about how Airflow makes this possible. Larry Komenda, Chief Technology Officer at Campbell, shares how Airflow supports their operations and improves efficiency.Larry discusses his role at Campbell, their switch to Airflow, and its impact. We look at their strategies for testing and maintaining reliable workflows and how these help their business. Key Takeaways: (02:26) Strong technology and data systems

en

00:23:58

How Laurel Uses Airflow To Enhance Machine Learning...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/07/18

The world of timekeeping for knowledge workers is transforming through the use of AI and machine learning. Understanding how to leverage these technologies is crucial for improving efficiency and productivity.In this episode, we’re joined by Vincent La, Principal Data Scientist at Laurel, and Jim Howard, Principal Machine Learning Engineer at Laurel, to explore the implementation of AI in automating timekeeping and its impact on legal and accounting firms. Key Takeaways: (01:54) Laurel's mission

en

79 results

Similar Podcasts

Lead With AI

Tamara Nall

Linux in the Ham Shack

Black Sparrow Media

Data Engineering Podcast

Tobias Macey

Eye On A.I.

Craig S. Smith

Reflections

Livewire Labs