Search

Big Data Architect

CEI
locationChicago, IL, USA
PublishedPublished: 6/14/2022
Technology
Full Time

Job Description

Job DescriptionJob Title: AWS Big Data Architect III
Job at a Glance: Hands-on Big Data/Data Engineering role to design, build and operate scalable data warehouse and data lake solutions (real-time and batch) for enterprise analytics.
Location: 350 North Orleans Street Chicago Illinois 60654 United States
Work Schedule: 4 days onsite, Friday remote
Pay Rate: $60-$65/hr W2 + optional benefits (Medical, Dental, Vision, and 401k)
Duration of Contract: Long term contract with extension/conversion possibility
Responsibilities:

  • Design, build, and operate scalable enterprise data platforms (data warehouse + data lake) to support analytics use cases.
  • Develop and maintain end-to-end data pipelines supporting batch and real-time processing.
  • Implement and optimize Spark workloads (including Spark SQL / DataFrames) for performance, reliability, and cost efficiency.
  • Build and manage AWS-based big data solutions, especially: EC2, S3, Redshift
  • Write and tune complex SQL for transformation logic, validation, and analytical modeling.
  • Build reusable engineering frameworks/components (Java/Scala) to standardize ingestion, transformation, and monitoring.
  • Perform data modeling and support the creation of curated datasets for enterprise reporting and advanced analytics.
  • Partner with product owners, data scientists, and architects to translate requirements into technical designs and deliverables.
  • Implement CI/CD for data engineering code (e.g., Jenkins), including automated build/test/deploy where applicable.
  • Use Git/Bitbucket for source control, code review, and branching strategies.
  • Work effectively in a Linux environment for development, job execution, troubleshooting, and operational support.
  • Support production operations: monitoring, incident triage, root-cause analysis, and ongoing improvements.

Required Skills:

  • Scala
  • Apache Spark
  • Hadoop
  • SQL
  • AWS
  • Python

Company Culture:

  • From your first day, you’ll have the support and resources needed to grow your career to new heights and direction.
  • Get ready to impact the lives of millions as you work together to create amazing experiences and breakthrough products at an exciting pace.

As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers' workforce and project requirements.

#INDGEN #ZR

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...