Job Description
We are looking for a Lead Data Engineer to spearhead the creation of scalable, high-performance data solutions. This key leadership role demands both deep technical expertise in modern data architectures and a strategic mindset to advance our enterprise data platform into a reliable, unified data lakehouse.
- Architect and implement data solutions aligned with the long-term strategy of an enterprise-wide, centralized data lakehouse.
- Design and build robust ELT pipelines using Azure and Microsoft Fabric, ensuring smooth system integration and alignment with business needs.
- Enhance ingestion, storage, and transformation workflows within Fabric to support efficient, high-performance handling of structured and semi-structured data.
- Develop reusable data models and curated datasets from diverse sources while ensuring compliance with data governance, lineage, and quality standards.
- Partner with Information Security and Infrastructure teams to implement data security protocols and streamline data integration efforts.
Qualifications
- Bachelor’s degree required; Master’s preferred in Computer Science, Data Science, Engineering, or a related field.
- 5+ years of hands-on data engineering experience with proven success delivering large-scale data solutions.
- Advanced proficiency in Python/PySpark for data transformation.
- Solid experience with SQL, NoSQL databases, and modern data warehouses.
- Deep knowledge of Azure data services, particularly Data Factory and Microsoft Fabric.
- Experience with major cloud platforms (Azure, AWS, GCP) and their integration with Fabric.
- Expertise in data modeling, data architecture, and data warehouse optimization.
- Familiarity with CI/CD tools and practices, such as Azure DevOps.
- Experience in a data solution architect role is a strong plus.