Apache Spark Client Snap - Reference Requirements

[deusebio (Enrico Deusebio)]

Minimum system requirements

The following are the minimum system requirements for Charmed Apache Spark:

• 8GB of storage.
• 2 CPU threads per host.
• Access to the internet for downloading the Canonical Apache Spark image.
• Access to a Kubernetes cluster, e.g. MicroK8s or Charmed Kubernetes.

[gustavosr98 (Gustavo Sanchez)]

Hi @deusebio What would be some minumum and recommended RAM for Spark? Do we have some mininum and recommended specs for Kyuubi?

[deusebio (Enrico Deusebio)]

The requirements above are for the platform components, not for the Spark Jobs and workloads. There is no general recommendation for the RAM requirements imposed by the workload as these would largely depend on the use case and the type of aggregation/processing being run