Job Description
Job Description
Role: Big Data Engineer
Location: Jersey City, NJ
Type: Full-Time
Description:
We are seeking an experienced Big Data Engineer with hands-on experience in designing, developing, and managing scalable big data pipelines and platforms. The ideal candidate should have strong expertise in Hadoop, Spark, Hive, and distributed computing concepts. You will work closely with data scientists, analysts, and business stakeholders to build data solutions that support analytics, reporting, and advanced insights.
Responsibilities:
- Design and develop end-to-end data pipelines using big data technologies.
- Optimize and tune Spark/Hadoop jobs for large-scale processing.
- Implement data ingestion frameworks from multiple sources (streaming & batch).
- Collaborate with cross-functional teams to define data architecture and strategy.
- Ensure data quality, security, and compliance across all platforms.
Required Skills:
- Strong experience with Hadoop ecosystem (HDFS, Hive, Pig).
- Expertise in Apache Spark (PySpark/Scala/Java).
- Proficient in SQL and data modeling techniques.
- Familiarity with data pipeline orchestration tools (Airflow, Oozie, etc.).
- Good understanding of cloud platforms like AWS/GCP/Azure is a plus.
- Excellent problem-solving and communication skills.