x

75% of people globally want unbiased news (Pew Research) but are concerned they're not getting that.

Get balanced coverage with Symby. See how stories are covered across diverse outlets and spot when one side covers a story the other skips.

PODCAST

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Welcome to The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI— the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-evolving needs of data engineering and AI ecosystems. Podcast Webpage:

technology

All Episodes

00:23:52

How Vibrant Planet's Self-Healing Pipelines...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/06/27

Discover the cutting-edge methods Vibrant Planet uses to revolutionize geospatial data processing and resource management.In this episode, we delve into the intricacies of scaling geospatial data processing and resource allocation with experts from Vibrant Planet. Joining us are Cyrus Dukart, Engineering Lead, and David Sacerdote, Staff Software Engineer, who share their innovative approaches to handling large datasets and optimizing resource use in Airflow. Key Takeaways: (00:00) Inefficiencies

en

00:23:36

The Future of AI in Data Engineering With...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/05/29

The world of data orchestration and machine learning is rapidly evolving, and tools like Apache Airflow are at the forefront of these changes. Understanding how to effectively utilize these tools can significantly enhance data processing and AI model deployment.This episode features Julian LaNeve, CTO at Astronomer, and David Xue, Machine Learning Engineer at Astronomer. They delve into the intricacies of data orchestration, generative AI and the practical applications of these technologies in

en

00:24:31

The Power of Airflow in Modern Data Environments at...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/05/29

Understanding the critical role of data integration and management is essential for driving business success, particularly in a dynamic environment like a luxury casino resort. In this episode, we sit down with Siva Krishna Yetukuri, Cloud Data Architect at Wynn Las Vegas, to explore how Airflow and other tools are transforming data workflows and customer experiences at Wynn Las Vegas. Key Takeaways: (02:00) Siva designs and builds cutting-edge data pipelines and architectures. (02:54) Wynn is

en

00:23:38

Powering the Texas Rangers World Series Win With AI...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2024/05/29

The integration of data and AI in sports is transforming how teams strategize and perform. Understanding how to harness this technology is key to staying competitive in the rapidly evolving landscape of baseball. In this episode, we sit down with Alexander Booth, Assistant Director of Research and Development at Texas Rangers Baseball Club, to explore the intersection of big data, AI and baseball strategy. Key Takeaways: (03:00) Alexander Booth's role and responsibilities at the Texas Rangers

en

00:45:48

Expanding the Data Engineering Toolkit at Reddit

The Data Flowcast: Mastering Apache Airflow ® for... ·

2021/02/04

Welcome back to the Airflow Podcast.This week, we met up with Ben Wisegarver, a staff data scientist at Reddit who runs their data warehousing and data engineering functions. Reddit users generate petabytes of data every day that needs to be processed, stored, and analyzed by a wide breadth of backend services. Our conversation with Ben touches on everything from Airflow as a tool for career mobility across the data stack to scaling out a self-service data architecture across many teams. For

en

00:31:26

GDPR, Self-Service Data, and Infrastructure...

The Data Flowcast: Mastering Apache Airflow ® for... ·

2020/11/18

Welcome back to the Airflow Podcast. This week, we met up with Albert Franzi and Carlos Escura from Typeform. Typeform is a tool that allows you to build beautiful interactive forms that you can use for a wide variety of use cases, including customer surveys, employee engagement, product feedback, and market research to name a few. In our conversation, we discussed Airflow as a tool for GDPR compliance, the concept of self-service data and how it allows your data operations team to function as a

en

00:28:35

Adopting Airflow at Netlify

The Data Flowcast: Mastering Apache Airflow ® for... ·

2020/10/26

After a bit of a break, we're back with the third official episode bundle of The Airflow Podcast. In this batch, we'll get a little bit deeper with current Airflow users and maintainers on core fundamental concepts in data engineering, architectures for operating modern data platforms at scale, and the process of maintaining and operating Airflow, specifically as we go through the release process of Airflow 2.0. This week, we met up with Brian de la Motte and Florian Hines at Netlify. Netlify

en

00:32:28

The Road to Airflow 2.0

The Data Flowcast: Mastering Apache Airflow ® for... ·

2019/11/22

This week, we linked up with Airflow release manager, core committer, and Astronomer platform engineer Ash Berlin-Taylor to discuss the Airflow 2.0 roadmap [1]. There is some great stuff in the works around performance, autoscaling, and usability that we're excited about. In this episode, Ash lends his thoughts on the design, implementation, and value-add around all of the upcoming features, including: - The Knative Executor - A modern and real-time UI - A production-grade API - Improved

en

00:46:57

Airflow Breeze

The Data Flowcast: Mastering Apache Airflow ® for... ·

2019/10/17

This week, we had the pleasure of meeting up with Jarek Potiuk, Principal Software Engineer at Polidea and Apache Airflow committer, to discuss his most recent contribution to the community, Airflow Breeze. Jarek deeply values developer productivity and realized while building a team of Airflow committers that, in order to open a PR on the project, passing unit tests and waiting for the CI build was a cumbersome process that could take up to a few hours. Breeze seeks to improve that experience for

en

00:39:03

Open Source and Airflow at Google

The Data Flowcast: Mastering Apache Airflow ® for... ·

2019/08/15

This episode kicks off season 2 of The Airflow Podcast. In this next season, we'll focus on the future of Airflow and chat with leading members of the community to paint a picture of what's to come. We're pumped to be diving back into this project and look forward to the great conversations we have lined up. This week, we chatted with James Malone, Product Manager of Google's Cloud Composer. James had some interesting things to say about open source at Google and where his team plans on

en

00:29:03

Airflow 1.10 Release

The Data Flowcast: Mastering Apache Airflow ® for... ·

2018/12/17

This week, we met up with Ash Berlin-Taylor to discuss the recent 1.10 release, what it's like to be a release manager for an open source project, Airflow's bid to graduate from incubating status, and the next phase of Airflow project development. As mentioned in our podcast intro, we at Astronomer are hiring Data Engineers who are passionate about contributing to open source and making Airflow great. Please shoot us an email at humans@astronomer.io if you're interested in hearing more about the

en

00:37:28

Role-Based Access Control (RBAC)

The Data Flowcast: Mastering Apache Airflow ® for... ·

2018/08/15

This time, we met up with WePay's Joy Gao to talk through her work on the RBAC components in the recent Airflow 1.10 release. We dove deep into what inspired her work and took some time to discuss what it's like to be a woman contributing to a predominately male open-source community. Hope you enjoy! If you'd like to get started using Airflow in your org, check out our recently-launched Spacecamp program here: https://www.astronomer.io/spacecamp Feel free to email me at pete@astronomer.io with any

en

00:55:11

Airflow on Kubernetes

The Data Flowcast: Mastering Apache Airflow ® for... ·

2018/06/29

In this episode, we dove into the relationship between Airflow and Kuberenetes and interviewed Daniel Imberman, Senior Software Engineer at Bloomberg (1:30), and Greg Neiheisel, CTO here at Astronomer (37:31). Daniel has done most of the work on the Kubernetes executor for Airflow and Greg plans to take on a chunk of the development going forward, so it was really interesting to hear both of their perspectives on the project. Enjoy!

en

00:38:57

Pain Points

The Data Flowcast: Mastering Apache Airflow ® for... ·

2018/05/31

This week, we’ll examine conversations with both old guests and new to paint a comprehensive picture of Airflow’s pain points. While we still undoubtedly believe that Airflow is the future of ETL, it’s important to acknowledge that any incubating project will have issues, and bringing those issues to the forefront of the community’s attention will help shape the future of the project. We’ll talk with Thomas La Piana (1:36), Data Engineer at OrderMyGear, Frank Hsu (14:20), Data Engineer at mines.io,

en

00:27:40

Competitors: Luigi

The Data Flowcast: Mastering Apache Airflow ® for... ·

2018/04/13

On this episode, we linked up with Erik Bernhardsson (@erikbern), creator of Luigi and CTO of Better Mortgage. We chatted about everything from the motivations behind Luigi's creation and his current thoughts on Airflow- we hope you enjoy! Check out: - Erik's blog at erikbern.com - Our open-source library of Airflow plugins at github.com/airflow-plugins All podcast feedback is hugely appreciated- feel free to email me at pete@astronomer.io if you have any thoughts.

en

00:58:31

Best Practices

The Data Flowcast: Mastering Apache Airflow ® for... ·

2018/03/21

In this episode, we dive into Airflow Best Practices and include longer portions of interviews with Alan Cruickshank (1:30), Business Insights and Data Manager at Tails.com, Chris Riccomini (7:27), Principal Software Engineer at WePay, and Bolke de Bruin(31:45), Head of Advanced Analytics Technology at ING. Hope you enjoy! We're still working to get better at podcasting, so please send over any feedback to pete@astronomer.io. We really appreciate hearing what the community has to say, and your

en

01:15:47

Use Cases

The Data Flowcast: Mastering Apache Airflow ® for... ·

2018/02/22

Episode 2 of The Airflow Podcast is here to discuss six specific use cases that we’ve seen for Apache Airflow. Here’s the lineup: Patrick Atwater (@patwater), Water Data Projects Manager at ARGO Labs: 2:03-5:35 Maksime Pecherskiy (@mrmaksimize), CDO of San Diego: 5:35-23:06 Scott Halgrim (@shalgrim), Data Engineer at Zapier: 23:06-27:27 Bolke de Bruin (@bolke2028), Head of Advanced Analytics at ING: 27:27-39:46 Chris Riccomini (@criccomini), Principal Software Engineer at WePay: 39:46-54:20 Ben

en

00:45:09

The Origins of Airflow

The Data Flowcast: Mastering Apache Airflow ® for... ·

2018/02/06

For the first episode of the Airflow Podcast, we met up with Maxime Beauchemin, creator of Airflow, to explore the motivations behind its creation and the problems it was designed to solve. We asked Maxime for his definition of Airflow, the design principles behind hook/operator use, and his vision for the project. Speaker list: Pete DeJoy - Product at Astronomer Viraj Parekh - Data Engineer at Astronomer Maxime Beauchemin - Software Engineer at Lyft, creator of Airflow Talk mentioned at the end

en

00:03:02

Season One Teaser

The Data Flowcast: Mastering Apache Airflow ® for... ·

2018/01/18

A sneak peek at our upcoming podcast about Apache Airflow. Featured in this clip (in order of appearance): Pete DeJoy - Product Specialist at Astronomer Patrick Atwater - Water Data Projects Manager at ARGO Labs Maksime Pecherskiy - Chief Data Officer of the City of San Diego Bolke de Bruin - Head of Advanced Analytics at ING

en

79 results

Similar Podcasts

Lead With AI

Tamara Nall

Linux in the Ham Shack

Black Sparrow Media

Data Engineering Podcast

Tobias Macey

Eye On A.I.

Craig S. Smith

Reflections

Livewire Labs