Software Developer (Spark/PySpark)

Location: Hyderabad or Ahmedabad, India

Company

hirify.global is hiring a software developer focused on cloud applications, data pipelines, and large-scale data processing.

What you will do

• Develop efficient applications and data pipelines using Python or Scala, with a preference for Python.
• Deploy applications and pipelines on AWS or Azure, including cloud storage and serverless services.
• Process large files and high-volume datasets using multiprocessing, multithreading, and coroutines.
• Build event-driven solutions using async/await, publish-subscribe patterns, Redis, RabbitMQ, or Kafka.
• Work with relational and NoSQL databases, including complex SQL queries, MongoDB, and Cassandra.
• Use PySpark and ETL technologies for large-scale data processing and data warehouse projects.

Requirements

• Strong Python or Scala development skills, preferably Python.
• Experience deploying applications or data pipelines in AWS or Azure.
• Experience processing large datasets and working with concurrency techniques.
• Strong RDBMS knowledge, including complex SQL, ORM concepts, and SQL optimization.
• Experience with NoSQL databases such as MongoDB or Cassandra.
• Knowledge of software development practices, including Git branching, unit testing, documentation, coding standards, and effort estimation.

Nice to have

• Experience with PySpark and large-scale data projects.
• Experience with ETL tools or libraries.
• Experience with data warehouses.

Culture & Benefits

• Full-time position based in Hyderabad or Ahmedabad.
• Work with AWS or Azure compute, storage, networking, databases, and security services.