Data Engineer (AWS/Azure)

TL;DR

Data Engineer (AWS/Azure): Designing and implementing scalable ETL/ELT pipelines for federal government data integration with an accent on ontology-driven transformations and high-volume streaming. Focus on building production-grade data systems, optimizing diverse storage engines, and integrating LLMs for intelligent data routing.

Location: Onsite in Springfield, VA; active TS/SCI clearance required

Salary: $60,000 – $180,000 USD

Company

hirify.global is a Federal IT services provider specializing in data delivery, analytics, and cybersecurity for government agencies.

What you will do

• Develop scalable ETL/ELT pipelines to clean, normalize, and semantically align data from various structured and unstructured sources.
• Build and deploy data infrastructure on AWS or Azure using services like Lambda, Glue, and Azure Data Factory.
• Optimize diverse storage engines including PostgreSQL, Redshift, ElasticSearch, and DynamoDB.
• Implement high-volume, low-latency data streams using Apache Kafka.
• Orchestrate complex data workflows using Apache Airflow.
• Collaborate with data scientists to integrate LLMs and ML models for data enrichment and routing.

Requirements

• Active TS/SCI security clearance
• 10+ years of experience in data engineering or software development.
• Strong proficiency in Python (pandas, PySpark, FastAPI).
• Experience with cloud-native data engineering tools on AWS or Azure.
• Proven track record with Kafka and Airflow.
• Bachelor's or Master's degree in Computer Science or a related field.

Nice to have

• Knowledge of data cataloging and semantic layer design.
• Experience with Docker and Kubernetes.
• Familiarity with MLOps tools like SageMaker or MLflow.

Culture & Benefits

• Competitive compensation package.
• Focus on diversity and inclusive perspectives.
• Opportunity to work on critical federal government projects.
• Company recognized as one of the Inc. 5000 Fastest-Growing Private Companies.