Search

Senior Data Engineer

The DNA group
locationWashington, DC, USA
PublishedPublished: 6/14/2022
Technology
Full Time

Job Description

Job Description

Location: Washington, DC.

Work Arrangement: Hydrid

Duration:12-month contract, with possible extension

W-2 or 1099

No C2C, visa transfers, or sponsorship

Our client is seeking a highly experienced data engineering professional to support DHCF’s Medicaid data modernization initiatives. As part of this effort, the organization is looking for a Senior Data Engineer to serve as the primary technical engine for the agency’s Medicaid data ecosystem.

This role is responsible for maintaining the stability and reliability of legacy Medicaid reporting environments while leading the execution of a cloud modernization roadmap. Under the direction of the Lead Data Warehouse Solution Architect, the Senior Data Engineer ensures uninterrupted compliance reporting while building the future-state Azure Synapse and Databricks Lakehouse architecture.

Responsibilities

  • Maintain, troubleshoot, and enhance complex SSIS ETL packages supporting high-volume Medicaid claims, provider, and member data.
  • Manage version control, deployments, and branching strategies within Team Foundation Server (TFS) to ensure continuous integration of legacy SQL assets.
  • Support and optimize SSRS report queries and SSAS tabular and multidimensional models to maintain federal and state compliance reporting.
  • Implement modern cloud-based data architectures, including Medallion Architecture (Bronze/Silver/Gold), using Azure Databricks (PySpark and SQL).
  • Lead the refactoring and migration of legacy SSIS logic into Azure Data Factory (ADF) pipelines and Databricks notebooks.
  • Facilitate DevOps transformation by migrating source control and CI/CD pipelines from TFS to Azure DevOps (Git).
  • Build, tune, and maintain Dedicated and Serverless SQL Pools within Azure Synapse to support advanced analytics and AI readiness.
  • Implement Row-Level Security (RLS) and automated data masking to protect PHI/PII in compliance with HIPAA, CMS MARS-E, and NIST standards.
  • Develop automated data validation and data quality frameworks to ensure parity between legacy SQL systems and the cloud-based Lakehouse.
  • Serve as a technical subject matter expert, guiding the adoption and efficient use of advanced data platforms and technologies.
  • Create and support implementation, testing, and integration plans for enterprise data modernization initiatives.

Minimum Qualifications

  • Bachelor’s degree in Information Technology or a related field, or equivalent professional experience.
  • Minimum of 7 years of experience leading advanced technology or service projects.
  • Minimum of 7 years of experience across the full system engineering lifecycle.
  • Training or certification in a specific IT product, platform, or service, as required.
  • Demonstrated expertise in enterprise data platforms, cloud technologies, and system integration.

Required Experience

  • Bachelor’s degree in Information Technology or related field, or equivalent experience: Required
  • Maintaining SQL Server environments (SSIS, SSAS, SSRS) while concurrently deploying Azure cloud solutions: 7 years (Required)
  • Expert-level proficiency in SSIS and T-SQL, with advanced proficiency in Azure Databricks (Unity Catalog, Delta Lake) and Azure Synapse: 7 years (Required)
  • Deep experience with TFS and migration of workflows to Git/Azure DevOps: 7 years (Required)
  • Mastery of SQL and Python (PySpark): 7 years (Required)
  • Leading advanced technology or service projects: 7 years (Required)
  • Full system engineering lifecycle experience: 7 years (Required)

Preferred Qualifications

  • Experience with Microsoft Purview for enterprise data cataloging.
  • Extensive experience with Medicaid and Medicare data structures, including MMIS, EDI 837/835, and claims processing.
  • Microsoft Certified: Azure Data Engineer Associate or Databricks Certified Professional Data Engineer.
  • Experience working in government or highly regulated environments.

This Job Is Ideal for Someone Who Is

  • A senior-level data engineer with deep expertise in both legacy SQL Server environments and modern cloud data platforms.
  • Comfortable operating simultaneously in legacy and cloud ecosystems while driving modernization efforts forward.
  • Highly detail-oriented, with a strong understanding of the regulatory and compliance requirements surrounding Medicaid data.
  • Collaborative and able to translate architectural direction into production-ready, high-performance data solutions.
  • Committed to delivering reliable, secure, and scalable data systems that support mission-critical reporting and analytics.

The DNA Group is a drug-free workplace. Pre-employment of drug testing may be required in accordance with federal, state, and local laws.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...