Search

Senior Data Platform Engineer

Eitacies Inc
locationAustin, TX, USA
PublishedPublished: 6/14/2022
Technology
Full Time

Job Description

Job DescriptionBenefits:

  • 401(k)


Senior Data Platform Engineer
Onsite Austin, TX

Job Description
We are hiring a Senior Data Platform Engineer for an onsite role in Austin, TX
This role requires strong hands-on experience building and operating data pipelines on Google Cloud Platform.

Key Responsibilities:

  • Design and maintain Airflow DAGs for production data workflows
  • Develop and optimize Spark / PySpark jobs on Dataproc
  • Build and optimize complex SQL transformations
  • Develop REST APIs using FastAPI Python to support data services
  • Implement robust data quality and validation frameworks
  • Monitor pipeline performance, retries, and SLA compliance

Required Skills:

  • 9+ years of data engineering experience
  • Strong Python programming skills
  • Production experience with Apache Spark PySpark
  • Experience with Airflow DAG development
  • Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)
  • Experience building APIs using FastAPI
  • Strong SQL and data modeling knowledge
  • Experience implementing data quality checks (schema validation, row count checks, anomaly detection)



Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...