When Apache Spark became a top-level project in 2014, and shortly thereafter burst onto the big data scene, it along with the public cloud disrupted the big data market. Databricks Inc. cleverly optimized its tech stack for Spark and took advantage ...