The Apache Spark History Server K8s Operator deploys and operates the Apache Spark History Server UI which is a component of the Apache Spark ecosystem that provides a web app to allows Data Scientist and Data Engineers to analyse the logs and resource consumption for their Apache Spark Jobs (GitHub - parca-dev/parca: Continuous profiling for analysis of CPU and memory usage, down to the line number and throughout time. Saving infrastructure cost, improving performance, and increasing reliability.). You can read more about Spark History server in the Spark Monitoring Guide.
Documentation Links
The Charmed Apache Spark History Server K8s Operator is part of the Charmed Apache Spark solution. Please refer to the solution docs for more information about how to deploy it and configure it (see here and here). More information about how the Spark History server fit in the Charmed Spark solution can be found in the explanation section.
Metadata links
- charmhub page
- Github project repository
- Contribution
- Licensing
- Publisher: Canonical