Senior Staff Engineer, Data Platform (AI)

Location: United States - Remote

Salary: $215,000–$235,000 per year, plus equity and benefits.

Company

hirify.global builds generative AI infrastructure for healthcare, including AI governance guardrails, healthcare-specific agent creation, and real-time algorithm monitoring.

What you will do

• Set technical direction and build the Data Platform hands-on across multiple engineering, AI, and product teams.
• Architect and evolve the Databricks lakehouse using medallion layering, Delta Lake, Unity Catalog, and appropriate workspace and compute strategies.
• Design, build, and optimize Spark and SQL pipelines, including incremental processing, data quality, performance tuning, and cost management.
• Build governed data foundations for AI products, including LLM-ready datasets, retrieval and vector-search pipelines, evaluation data, and safe interfaces for consuming data.
• Design durable Temporal workflows for scheduled Databricks pulls, file ingestion, and long-running LLM extraction and enrichment jobs, including retries, idempotency, versioning, backfills, and observability.
• Mentor engineers, define agentic development practices, review technical designs, make build-versus-buy decisions, and communicate trade-offs across technical and non-technical stakeholders.

Requirements

• Bachelor’s degree in Computer Science, Electrical Engineering, Mathematics, or a related field.
• At least 12+ years of software or data engineering experience, including designing and operating production data platforms at scale and setting architecture across multiple teams.
• Professional experience in a highly regulated domain such as healthcare, insurance, or finance is required.
• Deep hands-on Databricks expertise is highly preferred; Snowflake or Microsoft Fabric expertise is also aligned. Experience with Spark, Delta Lake, Unity Catalog, Workflows or equivalent, and performance and cost tuning at scale is required.
• Experience building ML or LLM application pipelines, such as LLM-based extraction, embeddings and vector search, feature pipelines, or evaluation datasets.
• Fluency in Python and SQL, with testing, CI/CD, infrastructure as code, and code review practices.
• Practical experience using agentic coding tools such as Claude Code in real delivery work, with judgment about when to trust, verify, and constrain them.
• Experience owning ambiguous cross-team problems end to end, influencing without direct authority, and writing clear design documents and communications.

Nice to have

• Healthcare data experience, including claims, EHR, FHIR, HL7, or HIPAA-compliant handling of PHI.
• Databricks certifications or experience with Delta Live Tables, Lakeflow, or Databricks Asset Bundles.
• Experience with Airflow, Dagster, Prefect, and choosing the appropriate orchestrator.
• Experience with GCP, AWS, or Azure, Terraform, and Kubernetes.
• Contributions to open-source data, workflow, or AI infrastructure projects.

Culture & Benefits

• Full-time role at a fast-growing, mission-driven company building a healthcare AI product.
• Flexible working hours and remote work for this role; hybrid work options are also offered by the company.
• Competitive annual salary of $215,000–$235,000, equity package, and medical, dental, and vision insurance.
• Inclusive environment focused on creativity, innovation, and diversity.

Hiring process

• Apply by sending a resume through the application below.