Location:
McLean, VA
Salary Range:
Competitive and commensurate with experience
Introduction
Join a dynamic team where you will be responsible for designing and implementing high-performance data pipelines to handle large volumes of data. This role requires expertise in ensuring data integrity through advanced quality checks and lineage tracking. You will work in a collaborative environment focused on innovation and excellence.
Required Skills & Qualifications
- Expert-level proficiency in Python and PySpark.
- Deep hands-on experience with AWS Glue and Amazon EMR.
- Proven track record of building scalable pipelines for large-scale data (Terabyte-scale preferred).
- Demonstrated experience implementing frameworks for Data Lineage and Data Quality.
- Strong experience working with S3-based lakes and relational databases (RDS/PostgreSQL/MySQL).
- Must have previous client experience working for this customer in the past 5 years.
Preferred Skills & Qualifications
- Experience within the Financial Services industry is a huge plus.
- Experience with Kinesis or Kafka integration for low-latency data delivery.
- Familiarity with CI/CD for data pipelines and Infrastructure as Code.
Day-to-Day Responsibilities
- Design and implement high-performance data pipelines.
- Ensure data integrity through advanced quality checks and lineage tracking.
- Collaborate with cross-functional teams to optimize data workflows.
Company Benefits & Culture
- Competitive salary and comprehensive benefits package.
- Inclusive and innovative company culture.
- Opportunities for professional growth and development.
For immediate consideration please click APPLY to begin the screening process with Alex.
