4 дня назад
Senior Data Engineer (Databricks)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Databricks) (Clinical Platforms): Building a next-generation clinical trial software platform and its enterprise data infrastructure with an accent on Databricks lakehouse architecture, clinical data standards, and regulated environments. Focus on designing scalable ingestion pipelines, API-driven data layers, and compliant systems for high-throughput clinical workflows.
Location: Remote - Latin America
Company
is a remote-first startup building data products, machine learning systems, cloud data infrastructures, and custom AI solutions for business clients.
What you will do
- Design, build, and optimize enterprise data pipelines, lakehouse storage layers, and data models with Databricks, PySpark, Spark SQL, and Delta Lake.
- Develop API-driven endpoints, ingestion engines, and query layers for proprietary clinical trial software.
- Build data structures for EDC outputs, audit trails, device telemetry, and patient-reported outcomes.
- Integrate legacy clinical systems, central labs, EHRs, and wearable devices through real-time and batch ingestion jobs.
- Monitor and optimize Spark jobs, Delta Lake tables, and query execution for high-throughput clinical workflows.
- Collaborate with frontend developers, software architects, clinical research teams, and Clinical QA and Validation teams.
Requirements
- 4+ years of production experience with Databricks, Delta Lake, Apache Spark, and lakehouse architectures.
- Experience building or maintaining custom clinical trial applications such as EDC, CTMS, clinical data repositories, or eCOA/ePRO platforms.
- Knowledge of CDISC standards, including SDTM, ADaM, and CDASH, plus 21 CFR Part 11, GxP validation, and ICH-GCP guidelines.
- Experience with relational schema design, dimensional modeling, unstructured data, Python, SQL, RESTful APIs, CI/CD, Git, and automated testing.
- Experience with cloud platforms; AWS is preferred, with Azure or GCP also accepted.
- Advanced English is required for discussing technical requirements and solutions with clients in the United States.
Nice to have
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Bioinformatics, or a related quantitative field.
- Experience with Databricks Workflows, Delta Live Tables, Unity Catalog, or Computer System Validation.
Culture & Benefits
- Remote-first work environment with a collaborative, ownership-driven culture.
- Certifications in AWS, dbt, Google Cloud, Azure, and Databricks are fully covered.
- In-company English lessons.
- Birthday day off and an additional vacation week.
- Referral bonuses, monthly benefits marketplace credits, an annual team trip, and monthly childcare reimbursement.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →