Hey there Just to let everyone know that Canonical announced the first release of Charmed Spark as GA yesterday.
Spark is a solution for building big data parallel processing jobs that run on a compute cluster. Charmed Spark enables you to run big data processing jobs (aka. data pipelines) on Kubernetes clusters.
The official press release has a brief overview of the solution whilst you can read my personal blog post to get the full lo-down.
If you want to get started, read the docs which are right over here.
Many thanks to all of the extended team that made this release possible but in particular @deusebio, @paolosottovia and Abhishek Verma. Couldn’t be without all of your hard work.