Job Description
Job Description
Job Summary:We are seeking a seasoned Databricks Technical Lead to join our HR Systems Engineering team. This high-impact role involves leading the design, build, and optimization of a modern data platform, services, APIs, and cloud migration efforts that support over 420,000 associates. Operating within a product-centric, agile delivery model, this position is ideal for a technical leader passionate about performance, scalability, and delivering business value. Join an organization honored as one of the Best Places to Work in IT for seven consecutive years.
Job Responsibilities:
- Lead enterprise-grade data engineering initiatives using Azure Databricks and Medallion architecture
- Drive hands-on design and development of data pipelines, data platforms, and APIs using Python, PySpark, and Scala
- Build and manage REST, GraphQL, and gRPC APIs and integrate with microservices architecture
- Collaborate with product owners, engineers, and business leaders to align deliverables with business objectives
- Implement secure, scalable solutions ensuring compliance with HR data privacy and security protocols
- Optimize performance, cost, and scalability of data workloads in Azure
- Develop CI/CD pipelines using Terraform, Bicep, and other Infrastructure-as-Code (IaC) tools
- Utilize Azure Data Factory, Azure Synapse, Delta Lake, and related services for ETL/ELT processes
- Lead platform security including encryption, access controls, and auditing
- Provide mentorship and leadership in a fast-paced, agile environment
- Support integration with Oracle HCM, Informatica, and event-driven architectures
Required Skills:
- 10+ years in data engineering, big data, or API development
- 3+ years in a technical leadership role
- Expertise in Azure Databricks, Apache Spark, Azure SQL
- Strong skills in Python, PySpark, Scala, and SQL
- Experience with Terraform, CI/CD, Azure DevOps, Infrastructure-as-Code
- Hands-on development of APIs and services (REST, GraphQL, gRPC)
- Knowledge of Azure Data Factory, Delta Lake, Synapse Analytics
- Experience with data security and compliance practices
- Familiarity with Docker, Kubernetes, and event-driven architecture
- Exposure to Informatica ETL tools
- Excellent communication, collaboration, and leadership skills
Preferred Skills:
- Microsoft Certified: Azure Solutions Architect Expert or Databricks Certified Engineer/Architect
- Experience with Scrum, SAFe, or similar agile frameworks
- Familiarity with Azure API Management, Event Hub
- Exposure to Oracle HCM data models and integration methods
- Experience with HR analytics platforms
- Hands-on use of Informatica PowerCenter or IICS
Certifications:Preferred: Microsoft or Databricks technical certifications
Education:Bachelor’s or master’s degree in computer science, Data Engineering, or related field
Education: Bachelors Degree
Company DescriptionCompunnel Inc., established in 1994; is a leading provider of Staffing, IT/Software, e-Learning/Training, Business Intelligence, and Cloud Solutions. A leader in contingent and permanent workforce solutions, we also provide temp-to-hire staffing, project-based/SOW staffing, and payroll services to our esteemed clientele which includes Fortune 500 companies of diverse industry segments. Ranked as one of the largest staffing firms in the US which is our primary service market; we also have a significant presence in Europe and Asia. As a national service provider in the US, we are serving our customers all major states and regions; thereby generating numerous job opportunities for prospective employees in their preferred locations of choice.
We have witnessed multi-fold YOY growth, and continuously adding a large pool of talented resources to our employee base every year. Our extensive experience in hiring professionals of multiple in-demand skill sets (IT, Engineering, Healthcare, Admin-Clerical, Finance, Professional, Light Industrial, etc.) further makes Compunnel a wider and preferred platform for people to pursue their careers in the US. We welcome people from all walks of life and cultures, and we support workforce diversity by providing equal employment opportunities to people without any discrimination based on race, color, gender, religion, national/ethnic region, disability, or any other basis.
Company Description
Compunnel Inc., established in 1994; is a leading provider of Staffing, IT/Software, e-Learning/Training, Business Intelligence, and Cloud Solutions. A leader in contingent and permanent workforce solutions, we also provide temp-to-hire staffing, project-based/SOW staffing, and payroll services to our esteemed clientele which includes Fortune 500 companies of diverse industry segments. Ranked as one of the largest staffing firms in the US which is our primary service market; we also have a significant presence in Europe and Asia. As a national service provider in the US, we are serving our customers all major states and regions; thereby generating numerous job opportunities for prospective employees in their preferred locations of choice.\r\n\r\nWe have witnessed multi-fold YOY growth, and continuously adding a large pool of talented resources to our employee base every year. Our extensive experience in hiring professionals of multiple in-demand skill sets (IT, Engineering, Healthcare, Admin-Clerical, Finance, Professional, Light Industrial, etc.) further makes Compunnel a wider and preferred platform for people to pursue their careers in the US. We welcome people from all walks of life and cultures, and we support workforce diversity by providing equal employment opportunities to people without any discrimination based on race, color, gender, religion, national/ethnic region, disability, or any other basis.