Search

Data Pipeline Engineer

FOCUSKPI INC
locationMountain View, CA, USA
PublishedPublished: 6/14/2022
Technology
Full Time

Job Description

Job Description

FocusKPI is seeking a Data Pipeline Engineer to join one of our clients, a high-tech SaaS company.

The team is seeking world-class server software engineers with experience in Big Data Infrastructure and Data warehousing to join their technology innovation group, which focuses on rapidly developing AI-driven, cloud-based end-to-end mobile applications and services.

Work Location: Mountain View, CA (Hybrid role, 4 days/week onsite mandatorily)
Duration: 12-month contract with potential to convert depending on the candidate's performance
Pay Range: $85/hr to $95/hr

**No C2C resumes are considered**

Responsibilities:

  • Implement, maintain, and evolve the big data platform and infrastructure
  • Responsible for designing, implementing, and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence systems
  • Perform extensive research and analysis to make optimal architecture and design decisions
  • Write large amounts of code, perform code reviews, write unit tests, and documentation
  • Interface with other groups, including Product Management, QA, and Operations · Create quick proof-of-concept prototypes
  • Work in a scrum team with ML & Cloud Engineers

Qualifications:

  • Minimum of 3 years of hands-on experience in Big Data technologies like Apache Iceberg, Spark, Spark ML, & KafkaAn
  • MS in Computer Science or equivalent experience is preferred
  • Strong skills in statistical analysis: correlation analysis, regression analysis, univariate and multivariate analysis
  • Programming Language: Python
  • Strong skills in algorithms, Data structures, UNIX/Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking
  • Hands-on experience in building REST API’s
  • Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering
  • Desire to learn fast and pick up the latest and greatest technologies


Preferred qualifications:

  • Preferred 7+ years of experience in Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, & YARN
  • Machine Learning: PyTorch, TensorFlow, Spark ML
  • REST API: Flask, FastAPI, or Django
  • Data Quality tools such as Monte Carlo, Great Expectations, or Databand
  • Experience with teams using MLflow


**No C2C resumes are considered**

Thank you!

FocusKPI Hiring Team

Founded in 2010, FocusKPI, Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley, California, with an East Coast office in Boston, Massachusetts.

NOTICE: Please be aware of fraudulent emails regarding job postings, job offers, and fake checks. FocusKPI's recruiting team will strictly reach out via @focuskpi.com email domain. If you have received fraudulent emails now or in the past, please report them to https://reportfraud.ftc.gov/ .
The domain @focuskpijobs.com is fraudulent and not related to FocusKPI. Please do not reply or communicate with anyone with @focuskpijobs.com.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...