Data Ops Engineer

TL;DR

Data Ops Engineer (Streaming Pipelines): Design, build, and maintain real-time data ingestion pipelines from diverse sources into data platforms with an accent on data quality, observability, and scalability. Focus on implementing resilient streaming systems, error-handling strategies, and automation for monitoring data feeds supporting DoD and Intelligence missions.

On-site in San Diego, CA. U.S. citizenship and active TS/SCI clearance required.

Company

hirify.global is a Service-Disabled Veteran-Owned Small Business providing strategy and technology solutions to Federal, Defense, and Intelligence organizations.

What you will do

• Design, build, and maintain real-time data ingestion pipelines ensuring reliable streaming data flow, quality, and low-latency delivery.
• Monitor data quality, health of ingest processes, and deliver continual data feeds to users.
• Build resilient pipelines with backpressure, prioritization, retries, and error-handling.
• Employ data manipulation and visualization tools to convey status and trends to leadership and teams.
• Collaborate with engineers to reconfigure pipelines for reliability and support incident management with root cause analysis.
• Automate monitoring of real-time feeds and partner with security teams on encryption and governance.

Requirements

• U.S. citizenship and active TS/SCI clearance.
• Bachelor of Science in Computer Science, Mathematics, EE, Physics, Information Systems, or Information Technology.
• 3+ years in data engineering, data operations, or DevOps supporting production pipelines.
• Proficiency in Python, bash scripting, and tools like NiFi, Kafka, Grafana, Prometheus, Flink/Spark Streaming, Snowflake, Elasticsearch.
• Experience with data formats (Excel, CSV, JSON, XML), Windows, Linux (RedHat).

Culture & Benefits

• Family-focused business emphasizing employee and customer care.
• Rapidly growing company with exceptional culture.
• EEO employer participating in E-Verify and Affirmative Action.