This RADEN video shows how to identify over-provisioned clusters in Databricks which unnecessarily consume DBUs, increase costs, and underutilize resources.
- Analyze jobs and clusters, highlighting metrics such as single-execution usage and inactive workers.
- Identify over-provision candidates and jobs with underutilized resources.
- Get recommendations to optimize cluster sizes based on these insights, ensuring efficient resource utilization.