Test Your Data Engineering Software

Some testing is obvious. Other types of testing, not so much.

Pipeline Success (maybe…)

Let’s talk about types of testing applied to data engineering software.

I can hear some of you thinking, “software, Andy?”
Yes.
Data engineering development is software development.

Pipeline Succeeds

First, “succeeds” testing need not apply to a pipeline. It can just as readily apply to a notebook, package, or script. Any artifact t…