Senior Data Engineer (Python / PySpark / Kafka)

Computer Task Group, Inc

Piscataway, NJ 08854, USA

Published: 6/14/2022

Technology

Full Time

Job Description

Overview

CTG is seeking to fill a Senior Data Engineer (Python / PySpark / Kafka) position for our client.

Location: Piscataway, NJ
Duration: 12 months

Duties:

Design and develop scalable data pipelines and data processing systems for enterprise analytics.
Build distributed data workflows using Python and PySpark.
Develop real-time data streaming solutions using Apache Kafka.
Integrate data from multiple sources and ensure data quality, reliability, and performance.
Collaborate with data scientists, analysts, and engineering teams to support analytics and machine learning initiatives.
Monitor, troubleshoot, and optimize large-scale data processing environments.

Skills:

Strong hands-on experience with Python.
Extensive experience with PySpark for distributed data processing.
Proven experience with Kafka and real-time/stream processing architectures.
Experience building ETL/ELT pipelines and large-scale data platforms.
Strong problem-solving, performance tuning, and data engineering best practices.

Experience:

8+ years of experience in Data Engineering or Big Data development.
Demonstrated experience working with Python, PySpark, and Kafka in production environments.
Experience with large-scale distributed data systems and modern data architectures.

Education:

Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field, or equivalent experience.

Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.

CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee based recruitment services for this role.

To Apply:
To be considered, please apply directly to this requisition using the link provided. For additional information, please contact Laura Dominguez at Laura.Dominguez@ctg.com. Kindly forward this to any other interested parties. Thank you!

The expected base salary for this position ranges from $70.00 to $80.00/hour. Salary offers are based on a wide range of factors including relevant skills, training, experience, education, market factors, and where applicable, licensure or certifications obtained. In addition to salary, a competitive benefit package is also offered.