We use essential cookies

Please Accept our Privacy Policy

Databricks Data Engineer

Apolis

Atlanta, GA 30326 • $45.00 to $47.00 / hr • 11/18/2026

Job Description

Job Description
Job Title: Databricks Data Engineer\n\n

Location: USA
\nExperience: 8 Years (Preferred)
\n

\n\nJob Description\n\n

We are looking for an experienced Databricks Data Engineer with strong expertise in Apache Spark, PySpark, Azure data engineering, and large-scale data pipeline development.

\n\n

The ideal candidate will have hands-on experience building and supporting batch and real-time data pipelines, working with distributed computing frameworks, and optimizing data processing across large-scale datasets.

\n\nTop Required Skills\n\n
    \n
  1. \n

    Apache Spark / PySpark – Strong hands-on expertise using Jupyter Notebooks, Google Colab, or Databricks (preferred).

    \n
  2. \n
  3. \n

    Azure Data Engineering – Hands-on experience in data pipeline development and data ingestion patterns.

    \n
  4. \n
  5. \n

    Data Orchestration & SQL – Experience with Azure Data Factory (ADF) or Apache Airflow, along with strong SQL skills.

    \n
  6. \n
  7. \n

    Data Modeling – Experience with denormalized data modeling for large-scale big data systems.

    \n
  8. \n
\n\nKey Responsibilities\n\n
    \n
  • \n

    Design, develop, and support batch-based, distributed, and real-time data pipelines.

    \n
  • \n
  • \n

    Build highly available, fault-tolerant, self-healing, and adaptive data processing solutions.

    \n
  • \n
  • \n

    Develop scalable data engineering solutions using Apache Spark and PySpark.

    \n
  • \n
  • \n

    Implement data ingestion patterns and pipelines within Azure environments.

    \n
  • \n
  • \n

    Design and manage workflow orchestration using Azure Data Factory (ADF) or Apache Airflow.

    \n
  • \n
  • \n

    Optimize queries processing billions of rows across distributed query engines.

    \n
  • \n
  • \n

    Perform root cause analysis and implement permanent solutions for technical and business process issues.

    \n
  • \n
  • \n

    Provide technical consultation and lead the implementation of complex data engineering projects.

    \n
  • \n
  • \n

    Develop and maintain technical documentation for assigned systems and projects.

    \n
  • \n
  • \n

    Ensure data accuracy, reliability, scalability, and performance across data platforms.

    \n
  • \n
\n\nRequired Qualifications\n\n
    \n
  • \n

    Strong hands-on experience with Apache Spark and PySpark.

    \n
  • \n
  • \n

    Experience working with Jupyter Notebooks, Google Colab, or Databricks (Databricks preferred).

    \n
  • \n
  • \n

    Hands-on experience developing data pipelines and implementing data ingestion patterns in Azure.

    \n
  • \n
  • \n

    Experience with Azure Data Factory (ADF) or Apache Airflow.

    \n
  • \n
  • \n

    Strong SQL development and query optimization skills.

    \n
  • \n
  • \n

    Experience with denormalized data modeling for big data systems.

    \n
  • \n
  • \n

    Understanding of distributed computing, batch processing, and real-time data processing.

    \n
  • \n
  • \n

    Experience handling large-scale datasets and distributed query engines.

    \n
  • \n
  • \n

    Strong problem-solving, analytical, and communication skills.

    \n
  • \n
\n\n