Data Engineer - Data Platforms-AWS
Job Description
Job Description
Overview
CTG is seeking to fill a Data Engineer - Data Platforms-AWS position for our client.
Location: Reston, VA
Duration: 12 months
Duties:
-
Collaborate with product owners and development team members to define new features and user stories for large and complex projects.
-
Create or update technical documentation including detailed specifications, implementation guides, architecture diagrams, and design documents.
-
Participate in code reviews to ensure adherence to user stories, architecture patterns, and standard development practices.
-
Respond to production support issues to quickly resolve problems and maintain application uptime.
-
Mentor and provide technical guidance to less experienced staff, leveraging advanced development tools as needed.
-
Lead projects or initiatives end-to-end with minimal supervision.
-
Utilize Fannie Mae DevOps tool stack to build, inspect, deploy, test, and promote new or updated features; may serve as technical lead, architect, or principal developer on large projects.
-
Demonstrate expert proficiency in unit testing and coding in Python, Java, or other applicable languages.
Skills:
-
Expert in Python, SQL, Spark, and Amazon EMR.
-
Extensive experience building and deploying applications in AWS including S3, Lambda, Elastic Beanstalk, Hive, Glue, Redshift, RDS, CloudWatch, SNS, SQS, and Kinesis.
-
Experience processing large amounts of structured and unstructured data.
-
Proficient with CI/CD pipelines using Git, Bitbucket, and Jenkins.
-
Skilled in AWS Compute (EC2, Lambda, Beanstalk, ECS, EMR) and AWS Database products (RDS, Redshift, Aurora).
-
Knowledge of AWS Management and Governance tools such as CloudTrail and CloudWatch.
-
Familiarity with statistics-based programming language R for data visualization.
Experience:
-
Minimum of 5+ years of relevant experience.
-
3+ years of experience with Python, SQL, Spark, and Amazon EMR.
-
3+ years of experience in building and deploying applications in AWS.
Education:
-
Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).
Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.
CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services for this role.