aipythonsqlazuredatabrickspysparkdata pipelinesspark sqldelta lake
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
Нижеразвернуть
$85к-115к/год
$120к$140кмедиана$180к
По похожим ролям (48) ~ $140к/год
На СНГ рынке: $2.2к/мес ($1.5к - $3к)
73
Хорошая вакансия
развернуть
Задачи чётко очерчены и включают участие в масштабной миграции банка на Databricks, но обязательная работа в офисе и строгие условия проверок могут подойти не всем.
Ниже рынка
Актуальный стек
Понятная зона ответственности
Только офис
Строгие проверки
Практика с ИИ
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Databricks Data Engineer (Databricks/Data Engineering): Building production lakehouse pipelines to modernize the bank's SQL Server and SSIS-based enterprise data warehouse with an accent on Lakeflow, Bronze/Silver/Gold modeling, governance, and operational reliability. Focus on designing custom Spark ingestion, validating CDC and SCD behavior, managing secure regulated data, and supporting AI/ML capabilities on governed datasets.
Location: Onsite at the HQ in San Diego, CA, or the Las Vegas, NV office locations; remote work is not available.
Salary: $85,000–$115,000 per year, plus eligible annual discretionary cash and restricted stock unit bonus targets of 10% each.
Company
hirify.global provides technology-driven financial tools and services for individuals, small businesses, and companies.
What you will do
Design and build production Databricks pipelines using Lakeflow, Auto Loader, Delta Lake, Spark, PySpark, and Spark SQL.
Develop Bronze, Silver, and Gold medallion models to replace or complement legacy SQL Server and SSIS loads.
Ingest data from SQL Server, Salesforce, Workday, APIs, files, and SFTP using connectors or custom Python/PySpark jobs.
Schedule, monitor, tune, and troubleshoot jobs, including clusters, Photon, partitioning, liquid clustering, Z-ORDER, CDC, refresh strategies, and DBU costs.
Implement alerts, runbooks, governance, security controls, data validation, and documented cutover and rollback plans.
Support downstream reporting, analytics, and application consumers while contributing to governed AI/ML capabilities and mentoring the EDW team.
Requirements
Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent experience.
4+ years of experience building production data pipelines for warehouses, lakes, or lakehouses.
Production Databricks experience with Spark, PySpark and/or Spark SQL, Delta Lake, and Jobs/Workflows.
Professional use of AI coding assistants on production data engineering work and/or hands-on AI/ML or generative-AI development involving MLflow, model serving, RAG, vector search, or Mosaic AI.
Strong SQL skills, including reading and replacing T-SQL and stored-procedure logic with lakehouse equivalents.
Experience with at least one cloud platform, preferably Azure, and object storage such as ADLS, S3, or GCS.
Git-based delivery, pull requests, and code review experience.
Experience ingesting data from JDBC/SQL sources, APIs, and files/SFTP.
Clear written communication for runbooks, design notes, and review comments in a regulated environment.
Nice to have
Lakeflow Connect, DLT/Declarative Pipelines, Auto Loader, Structured Streaming, or CDC experience.
Unity Catalog, including grants, row filters, column masks, and lineage.
Azure Entra, Key Vault, private networking, and monitoring.
SQL Server, SSIS, Fivetran, Data Vault, Collibra, Tableau, dbt on Databricks, or similar frameworks.
Financial services or other regulated-data experience, including GLBA, SOX, or BSA/AML-adjacent work.
Databricks certifications, GitHub Actions CI, Mosaic AI, Vector Search, or Feature Store experience.
Culture & Benefits
Onsite work is required; the role is based at the San Diego or Las Vegas office.
Medical, dental, vision, and life insurance may be available.
Paid sick leave, three weeks of vacation, and approximately 11 holidays.
HSA or FSA, voluntary benefits, a 401(k) employer match, and a 529 savings plan.
Employee mortgage loan program and access to an hirify.global account with self-directed trading.
Employment is subject to credit, criminal background, and pre-employment drug screening, including marijuana screening.
Hiring process
Offers are contingent on successfully passing the required credit check, criminal background check, and pre-employment drug screening.
Employment eligibility is verified through the U.S. Department of Homeland Security E-Verify program.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →