Charmed Spark 3 Beta Release Notes
The Canonical Data Fabric team is proud to release Charmed Spark 3 Beta!
This is a Beta release for what will become the first stable release of the solution, Charmed Spark.
The stable release will provide an integrated way of managing Spark applications on Kubernetes and deliver enterprise support, security maintenance and extended capabilities for Apache Spark 3.4.
Charmed Spark is the first piece of an integrated suite of solutions for data-intensive applications that Canonical will release.
Beta Charmed Spark is in a beta preview and therefore are subject to change. We invite users to try the solution and provide feedback.
This first release of Charmed Spark comes with features to deploy and interact with Spark applications on Kubernetes clusters.
spark-client snap for launching and interacting with Spark applications on Kubernetes, including the Apache Spark runtime binaries and the
spark8t toolkit to help simplify working with Spark on Kubernetes.
Spark8t Python package
spark8t Python package contains additional tools to help simplify working with Spark on Kubernetes.
Releases can be found on Github
Charmed-spark OCI image
charmed-spark security maintained OCI container image for Kubernetes, containing the Apache Spark runtime binaries, OpenJDK and Python, based on Ubuntu 22.04 LTS.
Releases can be found on GitHub
spark-history-server-k8s charm which automates deployment of the Spark History Server using Juju. Juju is an open source orchestration engine for software operators that enables the deployment, integration and lifecycle management of applications at any scale, on any infrastructure.
Users can find documentation for the Charmed Spark solution and a guide to getting started on charmhub discourse.