The MAD Podcast with Matt Turck, is a series of conversations with leaders from across the Machine Learning, AI, & Data landscape hosted by leading AI & data in...
The AI Coding Agent Revolution, The Future of Software, Techno-Optimism | Amjad Masad, CEO, Replit
Replit is one of the most visible and exciting companies reshaping how we approach software and application development in the Generative AI era. In this episode, we sit down with its CEO, Amjad Masad, for an in-depth discussion on all things AI, agents, and software.
Amjad shares the journey of building Replit, from its humble beginnings as a student side project to becoming a major player in Generative AI today. We also discuss the challenges of launching a startup, the multiple attempts to get into Y Combinator, the pivotal moment when Paul Graham recognized Replit’s potential, and the early bet on integrating AI and machine learning into the core of Replit.
Amjad dives into the evolving landscape of AI and machine learning, sharing how these technologies are reshaping software development. We explore the concept of coding agents and the impact of Replit’s latest innovation, Replit Agent, on the software creation process. Additionally, Amjad reflects on his time at Codecademy and Facebook, where he worked on groundbreaking projects like React Native, and how those experiences shaped his entrepreneurial journey. We end with Amjad's view on techno-optimism and his belief in an energized Silicon Valley.
Replit
Website - https://replit.com
X/Twitter - https://x.com/Replit
Amjad Masad
LinkedIn - https://www.linkedin.com/in/amjadmasad
X/Twitter - https://x.com/amasad
FIRSTMARK
Website - https://firstmark.com
X/Twitter - https://twitter.com/FirstMarkCap
Matt Turck (Managing Director)
LinkedIn - https://www.linkedin.com/in/turck/
X/Twitter - https://twitter.com/mattturck
(00:00) Intro
(01:36) The origins of Replit
(15:54) Amjad’s decision to restart Replit
(19:00) Joining Y Combinator
(30:06) AI and ML at Replit
(32:31) Explain Code
(39:09) Replit Agent
(52:10) Balancing usability for both developers and non-technical users
(53:22) Sonnet 3.5 stack
(58:43) The challenge of AI evaluation
(01:00:02) ACI vs. HCI
(01:05:02) Will AI replace software development?
(01:10:15) If anyone can build an app with Replit, what’s the next bottleneck?
(01:14:31) The future of SaaS in an AI-driven world
(01:18:37) Why Amjad embraces techno-optimism
(01:20:36) Defining civilizationism
(01:23:11) Amjad’s perspective on government’s role
--------
1:29:39
Trino, Iceberg and the Battle for the Lakehouse | Justin Borgman, CEO, Starburst
In this episode, we explore the cutting-edge world of data infrastructure with Justin Borgman, CEO of Starburst — a company transforming data analytics through its open-source project, Trino, and empowering industry giants like Netflix, Airbnb, and LinkedIn.
Justin takes us through Starburst’s journey from a Yale University spin-out to a leading force in data innovation, discussing the shift from data lakes to lakehouses, the rise of open formats like Iceberg as the future of data storage, and the role of AI in modern data applications. We also dive into how Starburst is staying ahead by balancing on-prem and cloud offerings while emphasizing the value of optionality in a rapidly evolving, data-driven landscape.
Starburst Data
Website - https://www.starburst.io
X/Twitter - https://x.com/starburstdata
Justin Borgman
LinkedIn - https://www.linkedin.com/in/justinborgman
X/Twitter - https://x.com/justinborgman
FIRSTMARK
Website - https://firstmark.com
X/Twitter - https://twitter.com/FirstMarkCap
Matt Turck (Managing Director)
LinkedIn - https://www.linkedin.com/in/turck/
X/Twitter - https://twitter.com/mattturck
(00:00) Intro
(01:32) What is Starburst?
(02:32) Understanding the data layer
(05:06) Justin Borgman’s story before Starburst
(10:41) The evolution of Presto into Trino
(13:20) Lakehouse vs. data lake vs. data warehouse
(22:06) Why Starburst backed the lakehouse from the start
(23:20) Starburst Enterprise
(27:31) Cloud vs. on-prem
(29:10) Starburst Galaxy
(31:23) Dell Data Lakehouse
(32:13) Starburst’s data architecture explained
(38:30) The rise of data apps
(38:54) Starburst AML
(40:41) “We actually built the Galaxy twice”
(43:13) Managing multiple products at scale
(45:14) “We founded the company on the idea of optionality”
(47:20) Iceberg
(48:01) How open-source acquisitions work
(51:39) Why Snowflake embraced Iceberg
(53:15) Data mesh
(55:31) AI at Starburst
(57:16) Key takeaways from go-to-market strategies
(01:01:18) Lessons from the Dell partnership
(01:04:40) Predictions for 2025
--------
1:06:24
Understanding Data Engineering in 2025 | Ben Rogojan, Seattle Data Guy
As AI takes over the world, data is more than ever “the new oil”, and data engineering is the discipline that makes data usable behind the scenes. In this episode, we dive deep into the present and future of data engineering with Ben Rogojan, also known as the Seattle Data Guy. A seasoned data engineering consultant, Ben has built a big brand and reputation in the field with over 100k followers on platforms like YouTube and Substack.
We started the conversation with a deep dive into data engineering as a profession: what do data engineers actually do? What is the career path, and what should aspiring data engineers learn?
We then explored some of the biggest stories of 2024 (including the rise of Iceberg) and went into some predictions for 2025, as a way to discuss some key topics everyone should be familiar with in data engineering, including the integration of AI in data workflows, the potential for automation, and why SQL isn't going anywhere. Discover how companies are navigating the complexities of data infrastructure, the rise of open table formats like Iceberg, and the ongoing battle between data giants like Snowflake and Databricks.
Ben Rogojan
Website - https://www.theseattledataguy.com
Newsletter - https://seattledataguy.substack.com
LinkedIn - https://www.linkedin.com/company/seattle-data-guy
X/Twitter - https://x.com/seattledataguy
FIRSTMARK
Website - https://firstmark.com
X/Twitter - https://twitter.com/FirstMarkCap
Matt Turck (Managing Director)
LinkedIn - https://www.linkedin.com/in/turck/
X/Twitter - https://twitter.com/mattturck
(00:00) Intro
(01:20) Why 2025 will be huge for data engineering
(02:55) The story of the Seattle Data Guy
(06:51) What exactly is data engineering?
(07:41) Data, AI, and ML: where do they overlap?
(09:23) Data analyst vs. data engineer vs. data scientist: what’s the difference?
(11:20) A day in the life of a data engineer
(12:58) Data engineering: Silicon Valley vs. everywhere else
(15:27) How to become an AI engineer
(28:46) Will AI replace AI engineers?
(33:42) Why is the data world so complex?
(36:53) The functional consolidation of the data world
(38:34) Big data stories from 2024
(39:28) Why Iceberg is a game-changer
(46:02) How startups manage data in their early days
(48:44) Seattle Data Guy’s favorite tools
(50:09) Bold predictions for 2025
--------
1:02:24
What You MUST Know About AI Engineering in 2025 | Chip Huyen, Author of “AI Engineering”
In this episode, we dive deep into the world of AI engineering with Chip Huyen, author of the excellent, newly released book "AI Engineering: Building Applications with Foundation Models".
We explore the nuances of AI engineering, distinguishing it from traditional machine learning, discuss how foundational models make it possible for anyone to build AI applications and cover many other topics including the challenges of AI evaluation, the intricacies of the generative AI stack, why prompt engineering is underrated, why the rumors of the death of RAG are greatly exaggerated, and the latest progress in AI agents.
Book: https://www.oreilly.com/library/view/ai-engineering/9781098166298/
Chip Huyen
Website - https://huyenchip.com
LinkedIn - https://www.linkedin.com/in/chiphuyen
Twitter/X - https://x.com/chipro
FIRSTMARK
Website - https://firstmark.com
Twitter - https://twitter.com/FirstMarkCap
Matt Turck (Managing Director)
LinkedIn - https://www.linkedin.com/in/turck/
Twitter - https://twitter.com/mattturck
(00:00) Intro
(02:45) What is new about AI engineering?
(06:11) The product-first approach to building AI applications
(07:38) Are AI engineering and ML engineering two separate professions?
(11:00) The Generative AI stack
(13:00) Why are language models able to scale?
(14:45) Auto-regressive vs. masked models
(16:46) Supervised vs. unsupervised vs. self-supervised
(18:56) Why does model scale matter?
(20:40) Mixture of Experts
(24:20) Pre-training vs. post-training
(28:43) Sampling
(32:14) Evaluation as a key to AI adoption
(36:03) Entropy
(40:05) Evaluating AI systems
(43:21) AI as a judge
(46:49) Why prompt engineering is underrated
(49:38) In-context learning
(51:46) Few-shot learning and zero-shot learning
(52:57) Defensive prompt engineering
(55:29) User prompt vs. system prompt
(57:07) Why RAG is here to stay
(01:00:31) Defining AI agents
(01:04:04) AI agent planning
(01:08:32) Training data as a bottleneck to agent planning
--------
1:12:35
Dataiku's Secret to Scaling AI in Global Enterprises | Florian Douetteau, CEO, Dataiku
In this episode, we sit down with Florian Douetteau, co-founder and CEO of Dataiku, a global category leader in enterprise AI and a fixture on the Forbes Cloud 100 list and in the Gartner Leader Quadrant.
Florian shares his journey from a Parisian student fascinated by functional programming to leading a global enterprise software company. We discuss how Dataiku bridges the gap between technical and business teams to democratize AI in the enterprise, the challenges of selling to enterprise clients, and how Dataiku acts as an orchestration layer for Generative AI, helping businesses manage complex data processes and control AI, so they can build more with AI.
Dataiku
Website - https://www.dataiku.com/
X/Twitter - https://twitter.com/dataiku
Florian Douetteau
LinkedIn - https://www.linkedin.com/in/fdouetteau
X/Twitter - https://twitter.com/fdouetteau
FIRSTMARK
Website - https://firstmark.com
X/Twitter - https://twitter.com/FirstMarkCap
Matt Turck (Managing Director)
LinkedIn - https://www.linkedin.com/in/turck/
X/Twitter - https://twitter.com/mattturck
(00:00) Intro
(02:08) Florian's life before Dataiku
(06:58) Creation of Dataiku
(12:08) Secret behind the Dataiku's name
(12:47) How does Dataiku stay insightful about the future?
(14:46) Building a platform, not just a tool
(17:26) How to sell to the enterprise from the beginning
(20:09) Dataiku platform today
(26:55) Data is always the problem
(28:50) LLM Mesh
(36:02) Will Gen AI replace ML?
(39:41) Managing Gen AI and traditional AI on one platform
(40:37) Gen AI deployment in the enterprise
(48:33) Dataiku's roadmap
(50:28) What has changed with the company's growth?
The MAD Podcast with Matt Turck, is a series of conversations with leaders from across the Machine Learning, AI, & Data landscape hosted by leading AI & data investor and Partner at FirstMark Capital, Matt Turck.
Listen to The MAD Podcast with Matt Turck, All-In with Chamath, Jason, Sacks & Friedberg and many other podcasts from around the world with the radio.net app