5 дней назад
Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Databricks/PySpark): Building scalable data pipelines and analytics-ready assets for federal agency programs with an accent on SQL optimization, distributed processing, and governed lakehouse architecture. Focus on designing ETL/ELT workflows, solving data quality and performance challenges, and delivering dashboards and analytical insights for government stakeholders.
Location: 100% remote; U.S. citizenship required
Company
is a technology solutions firm delivering AI, data intelligence, automation, enterprise platforms, and engineering services for federal agencies, with a focus on national security and federal financial programs.
What you will do
- Design, build, and maintain scalable ETL/ELT pipelines using PySpark and Python in Databricks.
- Develop optimized SQL queries, data models, schemas, partitioning strategies, and performance improvements for large datasets.
- Automate ingestion from APIs, flat files, relational databases, and streaming sources.
- Monitor pipeline health, resolve data quality issues, and implement logging and alerting.
- Perform exploratory analysis and deliver dashboards, reports, visualizations, written findings, and briefings.
- Collaborate with data scientists, program analysts, IT engineers, architects, and federal agency stakeholders in Agile delivery workflows.
Requirements
- Bachelor’s degree in a relevant technical field.
- 3+ years of experience in data engineering, data analytics, or a related discipline.
- Experience supporting federal government programs or agency data environments.
- Strong SQL skills, including complex joins, window functions, CTEs, and performance tuning.
- Hands-on experience with PySpark, Python, Databricks, notebooks, jobs, clusters, and Unity Catalog.
- U.S. citizenship and the ability to obtain and maintain a government suitability clearance are required.
Nice to have
- Databricks certification for Apache Spark or data engineering.
- Experience with AWS GovCloud, Microsoft Azure Government, or Google Cloud for Government.
- Knowledge of CI/CD for data pipelines using Azure DevOps or GitHub Actions.
- Experience with Tableau or Power BI connected to Databricks SQL endpoints.
Culture & Benefits
- 100% remote work arrangement.
- Collaborative work with federal stakeholders and multidisciplinary technical teams.
- Participation in Agile sprint ceremonies, backlog grooming, peer review, and audit-ready documentation.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →