9 часов назад
Data & Software Engineer (AI/ML)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data & Software Engineer (AI/ML): Building complex production data flows, pipelines, and ETL workflows for a custom application with an accent on Python, Apache Spark, AWS, data security, and governance. Focus on orchestrating and scaling data pipelines, optimizing analytical databases, integrating AI/ML services, and solving data quality and performance challenges.
Location: Chantilly, Virginia, United States; on-site
Company
Develops a custom application supported by complex production data flows and data engineering infrastructure.
What you will do
- Build end-to-end data pipelines and ETL workflows with Python and Apache Spark.
- Orchestrate, deploy, and maintain production pipelines, including Spark jobs.
- Containerize and deploy applications in AWS cloud environments.
- Design and optimize MySQL and PostgreSQL schemas and queries for complex analytical workloads.
- Work with stakeholders to assess data requirements, design solutions, and resolve data quality, pipeline, and performance issues.
- Contribute to large-scale data migration or platform modernization efforts, documentation, best practices, and design patterns.
Requirements
- Minimum 5 years of experience in data engineering or software engineering.
- Advanced Python, including Pandas and NumPy, plus familiarity with Java.
- Experience with Apache Spark, PySpark, Airflow, Apache Iceberg, SQL with Trino, NoSQL, and DynamoDB.
- Experience with Docker, Podman, AWS S3, Lambda, Step Functions, and infrastructure-as-code using Terraform or CloudFormation.
- Knowledge of Unity Catalog OSS, Apache Polaris, Apache Superset, OpenLineage, H3, and PostGIS.
- Understanding of data security, privacy, governance, compliance, data catalogs, lineage, geospatial data, Bash scripting, and AI/ML service integration.
Culture & Benefits
- Work as part of a small team.
- Employer-paid medical, dental, and vision coverage.
- 401(k) or IRA retirement plan with matching.
- Paid vacation, sick leave, and public holidays.
- Life insurance, short- and long-term disability coverage, and an employee assistance program.
- Training and development opportunities.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 дня назад
Data Engineer (Snowflake/Agentic AI)
110 000 - 155 000$
4 дня назад
Data & Software Engineer (AI)
75 000 - 93 000$
3 дня назад
Senior Data Scientist (AI)
5 дней назад
Senior Data Scientist (AI/ML)
124 000 - 329 200$
3 дня назад
Data Engineer (AI)
5 дней назад
Senior People Data and AI Engineer
142 600 - 257 600$