1 час назад
Data Operations Engineer II (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Operations Engineer II (Databricks): Building, monitoring, and maintaining data ingestion pipelines and operational systems that move, store, and transform weather data with an accent on scripting, automation, and operational reliability. Focus on diagnosing incidents, developing automated monitoring and alerting, maintaining SQL databases, and delivering repeatable CI/CD deployments.
Location: Remote within the United States or onsite at the global headquarters in State College, Pennsylvania, USA
Company
provides weather forecasts, warnings, and data products through consumer, media, business, and government platforms worldwide.
What you will do
- Build, monitor, maintain, and optimize data ingestion processes and pipelines across platforms, including Databricks, the Data Marketplace, and the Ad Platform.
- Develop complex Python, PowerShell, Bash, or similar scripts for data collection, monitoring, and automation.
- Own pipeline operations, incident response, root-cause analysis, recovery validation, escalation, and resolution documentation.
- Maintain SQL databases used for forecast, current, historical, and location data loading and deployment.
- Build monitoring systems, automated alerts, unit tests, CI/CD pipelines, and repeatable deployment processes.
- Administer managed file transfer platforms, perform proactive maintenance, and improve runbooks and technical documentation.
Requirements
- Bachelor’s degree in Computer Science, Information Technology, or a related field, plus 3+ years of experience in data operations, scripting, and automation.
- Intermediate proficiency in Python, PowerShell, Bash, or similar scripting languages.
- Professional competency with Azure, Databricks, Snowflake, and SQL Server.
- Experience managing relational SQL databases and debugging systems to identify root causes.
- Ability to work independently, prioritize multiple tasks, communicate incident updates, and collaborate in an Agile environment.
Nice to have
- Experience with C++, Java, or another object-oriented programming language.
- Experience with DataDog or similar monitoring and performance-tracking tools.
- Experience with CI/CD, Git, cloud platforms such as AWS or GCP, and managed file transfer tools such as GoAnywhere.
Culture & Benefits
- Work remotely within the United States or from the State College headquarters.
- Collaborate with cross-functional teams supporting data operations for a global audience.
- Participate in an Agile-based environment with opportunities to share knowledge and coach peers.
- is an Equal Opportunity/Affirmative Action Employer and provides reasonable accommodations during the employment process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
1 час назад
Senior Data Engineer (Databricks)
1 день назад
Data Engineer (LADS - Logistics Analytics Data Services) - Active Secret Clearance
140 000 - 160 000$
45 минут назад
Data Engineer (BI)
Linear
3 дня назад
Analytics Engineer
6 дней назад
Lead Data Engineer (Snowflake)
3 дня назад
Data Specialist (AI)
85 000 - 105 000$