Builds systems that gather, store, and process large volumes of data for analysis.
Responsibilities:
Develop ETL pipelines, ensure data quality, optimize data storage solutions.
Responsible for building scalable ingestion, transformation, and storage pipelines across DataBricks Medallion Layers, Azure Data Factory, SQL Server, and staging/data layers, supporting Metrics Repository and onboarding of new datasets
Skills:
Python, SQL, cloud data tools experience- Azure Data Factory)
