Search

Data Engineer

Progression Inc
locationWashington, DC, USA
PublishedPublished: 6/14/2022
Technology
Full Time

Job Description

Job Description

MUST:
Active Top Secret clearance is required
Experienced Data Engineer with Palantir products, AWS, MS Google, Databricks IBM
7+ years of experience bringing databases, data integration, and data analytics/ML technologies to production
Mastery in developing software code in one or more programming languages (Python, JavaScript, Java, Matlab, etc.)
Expert knowledge in databases (SQL, NoSQL, Graph, etc.) and data architecture (Data Lake, Lakehouse)
Experience with AWS solutions (Kubernetes, DataLakes, Open AI Services).
Experience with PostgreSQL, ElasticSearch, MongoDB, and graph databases.
Experience with GenAI enabled daily workflows (coding, testing, analytics).
Experience with one or more SQL-on-Hadoop technology (Spark SQL, Hive, Impala, Presto, etc.)
Experience with short-release cycles and the full software lifecycle
Experience with Agile development methodology (e.g., Scrum)
Current Security+ certification (or must obtain within 30 days)
Bachelor's degree in Computer Science/Data Science/Computer Engineering or relevant field, or 4+ years of experience with a PhD/MS.

DUTIES:
Lead the design, development, testing, and documentation of software code and data pipelines (batch and streaming) for data extraction, ingestion, transformation, cleaning, correlation, and analytics.
Architect, develop, and scale new data services/products, ensuring robust performance and operational efficiency.
Collaborate with cross-functional teams - including Program Managers, Subject Matter Experts, Architects, Engineers, and Data Scientists - to understand customer requirements, develop prototypes, and optimize existing data services/products.
Participate in research, case studies, and prototype development to explore and leverage cutting-edge technologies.

Company DescriptionWe staff quicker than any agency in town for a reason. Rapid responses, delivering rapid results. IT, Cyber Security, Legal, Admin & Accounting.

Company Description

We staff quicker than any agency in town for a reason. Rapid responses, delivering rapid results. IT, Cyber Security, Legal, Admin & Accounting.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...