Agile Data N’ Info
Join the Agile Data N' Info Podcast where we discuss how data and analytics teams can apply agile, product and data patterns to change the way they work.
Episodes
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the Data Match.
The Data Match pattern provides an automated, granular comparison capability to efficiently identify and report discrepancies between two datasets, moving from row counts to specific data values.
This 'data diff' solution transforms hours of manual data reconciliation into minutes by optimising comparisons for clo...
Join Shane Gibson as he chats with Nick Zervoudis about patterns that you can use to quickly and easily define the ROI of your data products, before you build them. You can get in touch with Nick via LinkedIn or over at https://blog.valuefromdata.ai If you want want to read a summary generated with GenAI, head over to:
https://agiledata.substack.com/i/172748370/google-notebooklm-briefing
If you want to download the transcri...
Join Shane Gibson as he chats with Johnny Winter about the core patterns that make up Dimensional (Star Schema) Modeling. You can get in touch with Johnny via LinkedIn or over at https://greyskullanalytics.com/ If you want want to read a summary generated with GenAI, head over to:
https://agiledata.substack.com/i/171239242/google-notebooklm-briefing
If you want to download the transcript for the podcast, head over to:
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the AgileData Activity Event Tile.
The Activity Event Tile pattern tracks a sequence of events (e.g., subscription signups, subscription payments) for a core business concept by storing minimal event data and using a hydration layer to automatically generate pre-calculated metrics as views.
This allows business users and analysts...
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the AgileData Event Tile.
The Event Tile Data Modeling pattern captures business processes and transactions within AgileData's three-layered data architecture, modeling "who does what" at a specific point in time. It achieves this by storing only a small number of core business keys in insert-only event tables. These event record...
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern of Automated Load Patterns based on Source Data Profiles.
The Automated Load Patterns based on Source Data Profiles pattern automatically profiles incoming data to determine its optimal loading method. It classifies data as either event data (immutable, append-only) or change data (evolving records) by analysing characteristics like ...
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern of Trust Rules to validate data.
The Trust Rules pattern provides automated data validation to ensure all incoming data is fit for purpose and trustworthy. It bakes in essential checks such as unique business keys and business effective dates, which run automatically upon data load or table refresh. Users can also define custom valid...
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern of Unioning two or more tables together automatically.
The Automated Table Unioning pattern automatically combines two or more tables by intelligently looking up column names and data types to generate safe SQL under the covers. It supports disparate data sources, such as those from multiple publishers in a data clean room, and creat...
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern of Orchestrating Dynamic Data Flows. The Dynamic Data Flow Orchestration pattern dynamically generates and self-heals data flow manifests (DAGs) at runtime from a central context database, enabling adaptive, cost-effective, and low-latency data processing primarily for micro-batching workloads An AgileData Engineering Pattern is ...
Join Shane Gibson as he chats with Roelant Vos about a number of Data Engine Thinking patterns and his new book Data Engine Thinking. You can get in touch with Roelant via LinkedIn or over at https://roelantvos.com/blog/ Or you can grab a copy of the Data Engine Thinking book on Amazon or at https://dataenginethinking.com/en/ If you want want to read a summary generated with GenAI, head over to:
Join Shane Gibson as he chats with Chris Gambill about a number of Data Engineering patterns. You can get in touch with Chris via LinkedIn or view his YouTube channel https://www.youtube.com/@GambillDataEngineering
If you want want to read a summary generated with GenAI, head over to:
https://agiledata.substack.com/i/165842333/google-notebooklm-briefing
If you want to download the transcript for the podcast, head over to...
Join Ramona C Truta as she interviews Shane Gibson about the patterns of writing a data book (and they discuss a whole lot of other data things) You can get in touch with Ramona via LinkedIn or read more on substack https://ramonatruta.substack.com/ Or buy a copy of Shanes book "an Agile Data Guide to Information Product Canvas", and finally fix those data requirement gathering problems. If you want to download the transcr...
Join Shane Gibson as he chats with Andrew Foad on his data modeling pattern "Hook" You can get in touch with Andrew via LinkedIn or read more on substack https://hookcookbook.substack.com If you want to download the transcript for the podcast, head over to:
https://agiledata.io/podcast/agiledata-podcast/the-hook-data-modeling-pattern-with-andrew-foad/#read
If you want want to read a summary generated with GenAI, head over t...
Join Shane Gibson as he chats with Aaron Wilkerson on ways data teams can increase the perception of the value they add to their organisation. You can get in touch with Aaron via LinkedIn or read his newsletter on substack https://aaronwilkerson.substack.com If you want to read the transcript for the podcast head over to: https://agiledata.io/podcast/agiledata-podcast/increasing-the-perceived-value-of-your-data-team-with-a...
Join Shane Gibson as he chats with Remco Broekmans about the pattern templates that are part of the Ensemble Logical Modeling (ELM) patterns. You can find more about ELM and its templates over at: https://www.elmstandards.com/ Find Remco's book on Amazon: https://www.amazon.com/Stories-Solutions-Redefining-Communication-Professionals-ebook/dp/B0DXQ8RR3X/ You can get in touch with Remco via LinkedIn or get in touch vi...
Join Shane Gibson as he chats with Dylan Anderson about the patterns required to define a Data Operating Model. This conversation was based on this article written by Dylan: https://thedataecosystem.substack.com/p/issue-13-defining-the-data-operating And specifically this pattern diagram: You can get in touch with Dylan via LinkedIn or subscribe to his newsletter at https://thedataecosystem.substack.com or get in to...
Join Shane Gibson as he chats with Chris Bergh on improving your teams way of working by using DataOps patterns. You can get in touch with Chris via LinkedIn or over at https://datakitchen.io If you want to read the transcript for the podcast head over to: https://agiledata.io/podcast/agiledata-podcast/dataops-patterns-with-chris-bergh/#read
Listen to more podcasts on applying AgileData patterns over at https://agiledata...
Join Shane Gibson as he chats with Patrick Cuba on combining the Data Vault data modeling pattern with the Medallion Architecture pattern. This discussion was based on the patterns described in this article: https://medium.com/the-modern-scientist/the-modern-data-vault-stack-75103102e3d2 You can get in touch with Patrick via LinkedIn or you can read his thoughts on Data Vault patterns over at https://patrickcuba.medium.com
...Join Shane Gibson as he chats with Eric Broda on the patterns required to create an ecosystem to support the use of Agents in enterprise organisations. You can get in touch with Eric via LinkedIn or you can read his thoughts on Agentic Mesh over at https://medium.com/@ericbroda
If you want to read the transcript for the podcast head over to: https://agiledata.io/podcast/agiledata-podcast/agentic-mesh-ecosystem-patterns-with...
Join Shane Gibson as he chats with Petr Pascenko on the pattern of Reliability Engineering of AI Agents You can get in touch with Petr via LinkedIn or you can read his thoughts on Agentic Mesh over at https://evalmy.ai/
If you want to read the transcript for the podcast head over to: https://agiledata.io/podcast/agiledata-podcast/reliability-engineering-of-ai-agents-with-petr-pascenko/#read
Popular Podcasts
Gregg Rosenthal and a rotating crew of elite NFL Media co-hosts, including Patrick Claybon, Colleen Wolfe, Steve Wyche, Nick Shook and Jourdan Rodrigue of The Athletic get you caught up daily on all the NFL news and analysis you need to be smarter and funnier than your friends.
I’m Jay Shetty host of On Purpose the worlds #1 Mental Health podcast and I’m so grateful you found us. I started this podcast 5 years ago to invite you into conversations and workshops that are designed to help make you happier, healthier and more healed. I believe that when you (yes you) feel seen, heard and understood you’re able to deal with relationship struggles, work challenges and life’s ups and downs with more ease and grace. I interview experts, celebrities, thought leaders and athletes so that we can grow our mindset, build better habits and uncover a side of them we’ve never seen before. New episodes every Monday and Friday. Your support means the world to me and I don’t take it for granted — click the follow button and leave a review to help us spread the love with On Purpose. I can’t wait for you to listen to your first or 500th episode!
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com
Football’s funniest family duo — Jason Kelce of the Philadelphia Eagles and Travis Kelce of the Kansas City Chiefs — team up to provide next-level access to life in the league as it unfolds. The two brothers and Super Bowl champions drop weekly insights about the weekly slate of games and share their INSIDE perspectives on trending NFL news and sports headlines. They also endlessly rag on each other as brothers do, chat the latest in pop culture and welcome some very popular and well-known friends to chat with them. Check out new episodes every Wednesday. Follow New Heights on the Wondery App, YouTube or wherever you get your podcasts. You can listen to new episodes early and ad-free, and get exclusive content on Wondery+. Join Wondery+ in the Wondery App, Apple Podcasts or Spotify. And join our new membership for a unique fan experience by going to the New Heights YouTube channel now!
The Clay Travis and Buck Sexton Show. Clay Travis and Buck Sexton tackle the biggest stories in news, politics and current events with intelligence and humor. From the border crisis, to the madness of cancel culture and far-left missteps, Clay and Buck guide listeners through the latest headlines and hot topics with fun and entertaining conversations and opinions.