Test Your Data Engineering Software
Some testing is obvious. Other types of testing, not so much.
Let’s talk about types of testing applied to data engineering software.
I can hear some of you thinking, “software, Andy?”
Yes.
Data engineering development is software development.
Pipeline Succeeds
First, “succeeds” testing need not apply to a pipeline. It can just as readily apply to a notebook, package, or script. Any artifact t…
Keep reading with a 7-day free trial
Subscribe to Engineer of Data to keep reading this post and get 7 days of free access to the full post archives.