Book Review Plus Podcast and Blog Updates
The AI-Driven Leader, Stay Current with Fabric, Frameworks
The AI-Driven Leader
Frank La Vigne and I had were honored to interview Geoff Woods for season 9, episode 1 of the DataDriven Podcast. Geoff is the author of The AI-Driven Leader, an insightful look into applying AI in business strategy.
Geoff shares from personal experience. His path started with some great advice from a mentor early in his career, advice which he continues to apply to this day.
In the interview and in the book, I am struck by Geoff’s focus on application. He shares prompts and sticky notes aimed at helping individuals make better strategic decisions using LLMs as Thought Partners. One of my favorite ideas from Geoff is his Personal AI Board.
Recommended.
<ad>
Is Your Data Team Still Fighting Azure Data Factory?
Even experienced ADF developers get stuck in:
❌ Hardcoded values that slow scaling
❌ Unclear error logs that waste hours
❌ Copy-pasted pipelines that are hard to maintain
It doesn’t have to be that way.
Join us for a one-day live virtual training on June 11, designed to help your team:
✅ Master dynamic pipelines
✅ Troubleshoot like an expert
✅ Build reusable, scalable frameworks
And it’s only $249 - down from $999.
First 20 to register received these bonuses:
A follow-along workbook
1-year replay access
A 30-minute post-class Q&A with the trainer
</ad>
Three Links to Stay Current on Microsoft Fabric
In Three Links to Stay Current on Microsoft Fabric, I share… three links to help you stay current on Fabric. It helps if you read the previous sentence like Wayne said, “Hi. I’m in Delaware.”
Spoiler: I find these three sites – Microsoft Fabric Blog, Microsoft Fabric Updates Blog, and Fabric Roadmap – helpful in keeping up with the evolving nature of Microsoft Fabric. I hope you find them useful as well!
Metadata-Driven Fabric Data Factory Pipeline Orchestration From ADF
I wrote the lengthy and complex Metadata-Driven Fabric Data Factory Pipeline Orchestration From ADF to combine thoughts on metadata-driven execution orchestration frameworks covered previously in three earlier posts:
Fabric Data Factory Design Pattern – Execute a Collection of Child Pipelines from Metadata
Configure Azure Security for the Fabric Data Factory REST API
Fabric Data Factory Pipeline Execution From Azure Data Factory
I touch on material from these three posts, drawing them together into a basic framework parent package, which serves as the basis from which to continue exploring one way to build a metadata-driven execution orchestration framework.
The first of the listed three posts was written in November 2024. The second and third posts represent a reboot of sorts written during the past month or so. To me, Metadata-Driven Fabric Data Factory Pipeline Orchestration From ADF is a reboot of the Data Engineering Execution Orchestration Frameworks in Fabric Data Factory Series series.
Speaking of metadata-driven execution orchestration frameworks…
Data Engineering Friday is Tomorrow!
In this week’s installment of Data Engineering Fridays (at 12:00 PM ET tomorrow!), I continue editing child pipeline executions state capture in my metadata-driven Azure Data Factory execution orchestration framework.
We’ll begin by modifying the code for the Failed (application pipeline execution instance) state. It currently reports “Canceled” because, well, we cancel parent pipeline execution to halt an application if an application pipeline fails and the Fail Application on Application Pipeline Failure bit is set.
Our next step is to add a Cancel Application on Application Pipeline Cancel bit that will add even more metadata-driven fault tolerance.
Visit Data Engineering Fridays to learn more.
I hope to see you there!