Job Description
Job DescriptionData Engineer
Contract (6 Months + Possible Extension)
Austin, TX (Onsite)
Pay Rate: $70-75 an hour on W2
Key Responsibilities:
- Design and build robust data pipelines in Python to extract, transform, and load data from MF4/MDF4 files (e.g., automotive telemetry and sensor logs).
- Architect scalable ETL/ELT workflows in Databricks, leveraging Delta Lake and cloud-native storage solutions.
- Optimize performance and ensure reliability of pipelines handling large-scale, high-frequency time-series datasets.
- Mentor junior engineers and contribute to technical design reviews, architecture discussions, and code quality initiatives.
- Stay current with industry trends in data engineering, Lakehouse architecture, and modern data workflows.
Required Qualifications:
- 5+ years of experience in data engineering and software development.
- Advanced proficiency in Python, including performance tuning and large-scale data processing.
- Strong experience with Databricks, Delta Lake, and Spark (PySpark or Scala).
- Proven ability to design and implement high-throughput, fault-tolerant pipelines in production environments.
- Familiarity with cloud platforms (AWS, Azure, or GCP), including data storage, compute, and security best practices.
Preferred Qualifications:
- Experience in automotive, IoT, or telemetry-intensive industries.
- Hands-on experience parsing and processing MF4/MDF4 files (ASAM standards).
- Exposure to Databricks Unity Catalog and Delta Live Tables.
- Understanding of GitOps practices and CI/CD pipelines.
#LI-SJ3
Benefits via Pride Global
Eligible employees receive:
- Medical, dental, and vision insurance
- 401(k) retirement savings
- Life and disability insurance
- Accident & critical illness coverage
- Legal and employee assistance programs (EAP)
- Pet, auto, and home insurance
- Discounts with preferred vendors