4 дня назад
Senior Data Engineer (Azure & Databricks)
149 000 - 190 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Azure & Databricks) (Databricks, Spark, Delta Lake): Building scalable enterprise data platforms and pipelines for analytics, AI applications, and operational systems with an accent on distributed processing, data modeling, and master data management. Focus on architecting reliable batch and near-real-time ingestion, implementing governance and lineage frameworks, and optimizing large-scale workloads for performance, cost efficiency, security, and observability.
Location: New York, NY, USA; 4 days per week in the office and 1 hybrid/remote day
Salary: $149,000–$190,000 per year
Company
provides niche consulting services for the architecture, engineering, and construction industries, including building performance, energy efficiency, sustainability, code advisory, and construction advisory solutions.
What you will do
- Design and build ’s enterprise data platform, including scalable ingestion and transformation pipelines for ERP, CRM, and operational data.
- Develop and maintain Databricks pipelines using Apache Spark and Delta Lake for structured and semi-structured data.
- Architect and implement a Databricks-based master data management platform with consistent golden records.
- Build data models and high-quality datasets for analytics, AI applications, dashboards, digital products, and operational systems.
- Establish data governance, lineage, quality, monitoring, observability, and alerting practices.
- Define data architecture and pipeline standards while optimizing large-scale processing for reliability, scalability, security, performance, and cost efficiency.
Requirements
- 7–10 years of hands-on experience with Databricks.
- Strong hands-on experience with Databricks, Apache Spark, and Delta Lake.
- Experience designing and owning large enterprise data projects and enterprise-scale ETL/ELT pipelines.
- Strong SQL and Python skills, with experience in data modeling, distributed systems, and cloud data platforms such as AWS or Azure.
- Experience working with complex enterprise data systems and across multiple business units and data sources.
- Must be legally authorized to work in the United States without current or future employer sponsorship.
Nice to have
- Experience building master data management systems.
- Experience integrating ERP systems such as Deltek, SAP, or Oracle.
- Experience with data governance, data lineage, and metadata management.
- Familiarity with lakehouse architectures and modern data platforms.
Culture & Benefits
- Join a growing technology group building platforms for the built environment.
- Work on AI-powered compliance systems, intelligent inspection workflows, enterprise analytics platforms, and large-scale data infrastructure.
- Collaborate with software engineering, platform, AI, and business teams.
- Hybrid work arrangement with one remote day per week.
- Equal opportunity workplace with confidential applicant information handled according to EEO guidelines.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
5 дней назад
Sr Data Engineer (Azure)
141 800 - 173 300$
5 дней назад
Principal Data Engineer
200 000 - 280 000$
9 часов назад
Senior Data Engineer (Databricks)
130 000 - 160 000$
6 дней назад
Senior Data Engineer
110 000 - 200 000$
4 часа назад
Data Engineer (Azure)
2 дня назад
Senior Data Ops Developer (Azure)
94 000 - 151 000$