Delight is a free, hosted, cross-platform monitoring dashboard for Apache Spark with memory and CPU metrics that will hopefully delight you!



Get started and do your work with all the common data sources supported by Spark.

  • We built a fleet of Docker Images combining various versions of Spark, Python, Scala…


Goals of this migration

Lingk.io is a data loading, data pipelines, and integration…



Recent developments with Spark 3.0, Spark-on-Kubernetes going GA, PySpark usability improvements, and more.

Source: Unsplash. Not a photo of the actual conference, which was entirely online this year.


Introducing Delight, an open-source project providing a free & cross-platform monitoring dashboard for Apache Spark

Spark UI Screenshot. Image by Author.


How to install our free, open-source, Spark UI & Spark History Server on top of any Spark platform


How our startup Data Mechanics (YCombinator, S19) builds on top of the open-source project


Spark & Docker Development Iteration Cycle. Image by author.
Spark & Docker Development Iteration Cycle. Image by author.

Jean Yves

Co-Founder @Data Mechanics, The Cloud-Native Spark Platform For Data Engs. We make Spark more dev-friendly & cost-effective! Former software eng @Databricks.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store