15 часов назад
Data & Software Engineer (AI)
150 000 - 250 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data & Software Engineer (Python/Apache Spark/AWS): Building complex production data flows, pipelines, and ETL workflows for a custom application with an accent on large-scale data processing, data security, and cloud deployment. Focus on designing reliable data solutions, optimizing analytical databases and queries, and integrating AI/ML services in a national security environment.
Location: McLean, Virginia, United States
Salary: $150,000–$250,000 USD per year
Company
delivers mission and technical expertise for national security, technology, and defense challenges.
What you will do
- Build complex data flows, production data pipelines, and ETL workflows for a custom application.
- Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions independently.
- Investigate data quality issues, pipeline failures, and performance bottlenecks.
- Contribute to large-scale data migration and platform modernization initiatives.
- Document data engineering practices, best practices, and design patterns.
Requirements
- Active TS/SCI clearance with Polygraph applicable to the customer.
- At least 5 years of experience with Apache Spark, PySpark, advanced Python, Pandas, NumPy, Docker, Podman, AWS services, Apache Iceberg, Airflow, SQL, NoSQL, data catalogs, and infrastructure-as-code tools.
- Experience building end-to-end Python data pipelines and configuring and updating Spark jobs with orchestration tools.
- Experience containerizing and deploying applications in AWS, including S3, Lambda, and Step Functions.
- Experience with MySQL and PostgreSQL, including schema design, performance tuning, and query optimization for analytical workloads.
- Knowledge of Git, Bash scripting, data lineage, geospatial data formats, H3, PostGIS, Unity Catalog OSS, Apache Polaris, OpenLineage, Apache Superset, and AI/ML service integration.
Culture & Benefits
- Comprehensive medical, dental, and vision coverage.
- Health Savings Account with a company contribution and a 401(k) with company match.
- Paid time off, paid holidays, and paid parental leave.
- Training and development opportunities, award programs, and company-sponsored events.
- Benefits supporting financial wellness, retirement planning, family assistance, and work-life balance.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →