Hey there Just to let everyone know that Canonical announced the first release of Charmed Spark as GA yesterday.
Spark is a solution for building big data parallel processing jobs that run on a compute cluster. Charmed Spark enables you to run big data processing jobs (aka. data pipelines) on Kubernetes clusters.
If you want to get started, read the docs which are right over here.