Data Engineer (Microsoft Fabric and Databricks)

Location: Reston, VA

Onsite Flexibility: Hybrid

• Position Type: Contract
• Contract Duration: 12 months
• Pay Rate: $59.35 $77.03 / Hour (USD)
• Work Authorization: Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.

The Senior Data Engineer is responsible for the design, development, administration, governance, and operational support of enterprise data platforms built on Microsoft Fabric. This role combines deep data engineering expertise with platform administration capabilities to ensure scalable, secure, reliable, and cost-effective data solutions that support business operations, analytics, AI initiatives, and project delivery.

The position requires 10 15 years of overall relevant experience in data engineering, data platforms, cloud technologies, and enterprise data management.

The role will design, build, and support data ingestion, ETL/ELT pipelines, lakehouse architectures, and analytical datasets using Microsoft Fabric, Databricks, Python, PySpark, SQL, Spark, Delta Lake, OneLake, and Data Pipelines. In addition, the role will govern Databricks and Fabric environments, including security, access management, monitoring, performance tuning, capacity management, and platform operations.

The Senior Data Engineer will collaborate with business stakeholders, architects, and analytics teams to deliver robust data solutions while ensuring platform reliability, compliance, security, and operational excellence. This role will also drive continuous improvement in data quality, governance, automation, performance, and cost optimization.

Data Engineering & Solution Delivery

• Own end-to-end technical design, development, and delivery of enterprise data engineering solutions.
• Design and implement scalable ETL/ELT, data integration, and data transformation pipelines for structured and unstructured data sources.
• Develop and maintain batch, near real-time, and streaming data ingestion pipelines from databases, APIs, files, cloud storage, and enterprise applications.
• Build reusable notebooks, data transformations, and processing frameworks using Databricks, Microsoft Fabric, Python, PySpark, and SQL.
• Design and implement Lakehouse architectures using Delta Lake, OneLake, and medallion architecture (Bronze, Silver, Gold layers).
• Create trusted datasets, curated data products, and semantic-ready data structures supporting analytics, reporting, AI, and machine learning initiatives.
• Implement data quality frameworks, validation rules, reconciliation controls, and exception management processes.
• Design scalable data models, dimensional schemas, and data marts to optimize reporting and analytical workloads.
• Optimize Spark workloads, SQL queries, storage strategies, partitioning, and data processing performance.

Databricks & Microsoft Fabric Administration

• Administer Databricks workspaces, Fabric capacities, Fabric workspaces, Lakehouses, Data Warehouses, Dataflows, and Pipelines.
• Configure and maintain user access, security groups, RBAC permissions, service principals, and identity integrations.
• Manage secrets, credentials, key vault integrations, and secure access to enterprise data sources.
• Monitor platform health, resource utilization, workload performance, and capacity consumption.
• Perform platform upgrades, feature enablement, release validation, and environment maintenance activities.
• Implement capacity planning, workload management, and resource allocation strategies.
• Support governance initiatives by enforcing workspace standards, naming conventions, tagging, and compliance controls.

Operations, Governance & Reliability

• Develop operational runbooks, support procedures, and disaster recovery documentation.
• Monitor data pipelines and platform services to ensure availability and reliability.
• Establish and maintain metadata management, data lineage, cataloging, and governance processes.
• Implement observability, logging, monitoring, and alerting across the data platform ecosystem.
• Drive cost optimization initiatives across compute, storage, Fabric capacities, and Databricks workloads.
• Establish Git-based source control and branching strategies for notebooks, pipelines, and infrastructure components.
• Implement CI/CD pipelines for automated deployment, testing, environment promotion, and release management.
• Develop reusable deployment templates and engineering accelerators for platform consistency and scalability.
• Communicate technical solutions, trade-offs, risks, dependencies, and delivery plans to both technical and non-technical stakeholders.

Data Engineering

• Strong expertise in Databricks, Spark, Delta Lake, Microsoft Fabric, OneLake, Lakehouse, and Data Warehouse architectures.
• Advanced proficiency in Python, PySpark, SQL, and Notebook-based development.
• Expertise in ETL/ELT frameworks, data ingestion patterns, incremental processing, CDC, and data transformation techniques.
• Strong understanding of dimensional modeling, data warehousing, and semantic data structures.
• Experience with batch processing, streaming architectures, and real-time data integration.

Platform Administration

• Strong knowledge of Databricks Workspace Administration and Microsoft Fabric Administration.
• Experience managing capacities, workspaces, governance controls, security policies, and platform operations.
• Expertise in Microsoft Entra ID (Azure AD), RBAC, access controls, service principals, and security integration.
• Experience with secrets management, key vaults, credential management, and secure data access.
• Knowledge of platform monitoring, observability, troubleshooting, incident management, and operational excellence.

Governance & DevOps

• Strong understanding of data governance, metadata management, lineage, data cataloging, and compliance controls.
• Experience with Git, Azure DevOps, CI/CD pipelines, release management, and automated testing.
• Knowledge of Infrastructure as Code, automation frameworks, and deployment standards.
• Experience implementing enterprise data quality and reliability frameworks.

Performance & Cost Optimization

• Experience tuning Spark applications, SQL workloads, storage structures, and distributed compute environments.
• Knowledge of Fabric capacity optimization, Databricks cluster optimization, workload management, and FinOps practices.
• Ability to balance performance, scalability, reliability, security, and cost considerations.
• Ability to work effectively in a fast-paced enterprise environment supporting multiple business priorities.

• B.Tech in Computer Science, Information Technology, Engineering, or an equivalent degree is required.
• Microsoft Certified: Fabric Analytics Engineer Associate (preferred)
• Microsoft Certified: Azure Data Engineer Associate (preferred)
• Databricks Certified Data Engineer Professional (preferred)
• Databricks Certified Data Engineer Associate (preferred)

• 10 15 years of overall relevant experience in data engineering, data platforms, analytics, and cloud technologies.
• Minimum 5 years of hands-on experience with Databricks and 2 years with Microsoft Fabric environments.
• Proven experience designing and supporting production-grade ETL/ELT and data integration solutions.
• Experience administering enterprise-scale Databricks and Microsoft Fabric platforms.
• Strong experience working with Azure data services and cloud-native architectures.
• Demonstrated experience in stakeholder engagement, solution ownership, and technical leadership.

• Experience mentoring engineers and supporting enterprise platform operations.

• Medical, Vision, and Dental Insurance Plans
• 401k Retirement Fund

This client is a privately held global leader in engineering, procurement, and construction, with a project portfolio spanning more than 25,000 engagements across 160 countries on all seven continents over more than 125 years of operation. The organization delivers some of the world's most consequential infrastructure projects at exceptional scale, including power plants and pipelines, airports and transit systems, defense facilities and nuclear infrastructure, and industrial-scale clean energy initiatives across the energy and industrial, infrastructure, nuclear and environmental remediation, government services, and mining and metals sectors. With a Glassdoor rating of 4.0 stars from nearly 2,500 employee reviews and 78 percent of employees recommending the organization to a friend including a 4.0-star rating for career opportunities, among the highest in its sector this client has earned genuine employee endorsement for competitive compensation, large-scale project experience, and strong career development. Teams here include civil and structural engineers, project controls specialists, procurement managers, nuclear and environmental remediation professionals, and corporate IT and ERP specialists who operate in demanding, fast-paced environments delivering projects that would challenge any firm on earth.

GTT is an NMSDC-certified Minority Business Enterprise (MBE) headquartered in Portsmouth, New Hampshire. GTT is a subsidiary of Chenega Corporation, an Alaska-based company and one of the largest Alaska Native-owned corporations. An Inc. 5000 honoree and one of SIA's Best Staffing Firms to Work For, GTT connects professionals with Fortune 500 organizations across IT, engineering, construction, utilities, life sciences, financial services, and healthcare throughout the U.S. and Canada. We're committed to diverse, inclusive workplaces and to placing people in roles where they can do their best work.

Job Number: 26-17774 Industry: Data & Analytics

#LI-Hybrid #LI-GTT #gttce #gttjobs

Global Technical Talent is a subsidiary of Chenega Corporation (www.Chenega.com) with over 1.3 billion US$ in revenue and 5800 US employees. We provide Total Talent Solutions, Global staffing, SOW, RPO, Direct Sourcing, and Global Payroll with physical offices in US, Canada, and India. GTT Digital headquartered in Toronto specializes in providing high-tech digital and banking talent to some of the nation’s largest financial institutions. As a leader in the staffing industry for over 22 years, we have become one of the largest staffing firms in the New England region, working with Fortune 500 clients and cutting-edge, technology-driven recruiting infrastructure.

We are a Native American-owned, economically disadvantaged corporation that highly values diverse and inclusive workplaces. Our clients and partners are among the most successful and innovative organizations in the world. Our top clients are Fortune 500 banking, insurance, and financial services firms, some of the nation’s largest life sciences, biotech, utility, and retail companies, and prestigious educational institutions in the Ivy League tier.

There is always a new opportunity for success when you look through all of the open job opportunities on our website’s career page. Just click on this link: https://bit.ly/gttcareers

Awards

SIA’s Fastest Growing Staffing Firm: 2023 and 2015
SIA’s Best Staffing Firm to Work for: 2019 -2023
Inc 5000 Fastest Growing Private Company: 2023, 2022, 2016, 2015
Randstad Preferred Supplier: 2020 - 2023
TechServe Alliance Excellence Award. 2019
NH Business Magazines Fast 5 fastest growing companies
Ernst & Young Entrepreneur of the Year Finalist: 2015