EP59: Charting the Course: The Evolution and Future of Apache Iceberg and Polaris
This session will provide a comprehensive overview of Iceberg's journey, its current role within the data ecosystem, and the promising future it holds with the integration of Polaris (incubating). We will discuss how these technologies redefine table formats and catalog management, empowering organizations to efficiently manage and analyze large-scale data. Attendees will gain valuable insights into the evolving landscape, ensuring they remain at the forefront of innovation and continue to shape thought leadership in the data ecosystem.
--------
38:45
EP58 - Transforming the Landscape of Real-Time Data Analytics
Try Out Dremio on your Laptop: https://drmevn.fyi/youtubelakehouse102924
--------
14:58
EP57 - From Hadoop & Hive to Minio & Dremio: Moving Towards a Next Gen Data Architecture
Legacy data platforms often fall short of the performance, processing and scaling requirements for robust AI/ML initiatives. This is especially true in complex multi-cloud (public, private, edge, airgapped) environments.
The combined power of MinIO and Dremio creates a data lakehouse platform that overcomes these challenges, delivering scalability, performance and efficiency to ensure successful AI initiatives.
Watch Brenna Buuck, Sr. Technical Evangelist at MinIO and Alex Merced, Sr. Technical Evangelist at Dremio provided insights on:
- AI Workflows: How a data lakehouse simplifies critical AI tasks like model training, refinement, feature selection and real-time inference for faster decisions
- Scalability and Performance: How a data lakehouse architecture scales seamlessly to meet the fast-growing demands of AI applications
- Data Management Efficiency: How a data lakehouse streamlines data management for IT teams, allowing them to focus on innovation
--------
1:04:18
EP56 - What’s New in Dremio: Improved Automation, Performance + Catalog for Iceberg Lakehouses
Dremio unveiled new features in our latest release that enhance the creation, performance, and management of Apache Iceberg data lakehouses.
You will learn how Dremio delivers market-leading SQL query and write performance, improved federated query security and management as well as streamlined data ingestion by delivering:
- Live Reflections on Iceberg tables that will accelerate performance, ensure up-to-date data and reduce management overhead.
- Result Set Caching that can accelerate query performance up to 28X
- Merge-on-Read that can enhance write and ingestion speed
- Auto Ingest Pipes that eliminate complex pipeline setup and maintenance
- User Impersonation for federated queries that allows for granular permissions, better access control, and user workload tracking
--------
31:39
EP55 - Unite Data Across Dremio, Snowflake, Iceberg, and Beyond
Organizations want to empower teams with data at their fingertips and in every part of their business. They want their teams to move quickly with data never as a bottleneck, but an accelerant to decision making —all without the curiosity tax too common in consumption-based cloud platforms. Dremio enables data teams to unify all of their disparate data, from Snowflake to Iceberg and other sources, by combining an intelligent semantic layer with a powerful SQL platform that eliminates silos, optimizes costs through intelligent query acceleration, and enables self-service analytics.
You will how Dremio enables Snowflake users to:
- Unify all of your data from Snowflake and all sources
- Optimize analytics costs and performance
- Use easy self-service analytics for faster time-to-insight
- Ensure Apache Iceberg native compatibility for future-proof data access
Gnarly Data Waves is a weekly show about the world of Data Analytics and Data Architecture. Learn about the technologies giving the company access to cutting-edge insights. If you work datasets, data warehouses, data lakes or data lakehouses, this show it for you!
Join us for our live recordings to participate in the Q&A:
dremio.com/events
Subscribe to the Dremio youtube channel on:
youtube.com/dremio
Take the Dremio Platform for a free test-drive:
https://www.dremio.com/test-drive/