Job Description Data is a valuable business asset. Some call it the new oil. The data engineer collects, transform and refine raw data into information that can be used by business analysts and data scientists. As part of your internship, ...
Databricks is an optimized data analytics platform based on Apache Spark. Monitoring Databricks plateform is crucial to ensure data quality, job performance, and security issues by limiting access to production workspaces. Spark application metrics, logs, and events produced by a ...
A few months ago, I wrote about my migration from Postgres to SQLite. I ended that with a “to be continued” because I had a number of issues related to memory and CPU spikes that I couldn’t really explain. For ...
