Engineer of Data

Engineer of Data

Share this post

Engineer of Data
Engineer of Data
Test Your Data Engineering Software

Test Your Data Engineering Software

Some testing is obvious. Other types of testing, not so much.

Engineer of Data's avatar
Engineer of Data
Feb 21, 2025
∙ Paid
4

Share this post

Engineer of Data
Engineer of Data
Test Your Data Engineering Software
3
Share
Pipeline Success (maybe…)

Let’s talk about types of testing applied to data engineering software.

I can hear some of you thinking, “software, Andy?”
Yes.
Data engineering development is software development.

Pipeline Succeeds

First, “succeeds” testing need not apply to a pipeline. It can just as readily apply to a notebook, package, or script. Any artifact t…

Keep reading with a 7-day free trial

Subscribe to Engineer of Data to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Andy Leonard
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share