2 months ago
Data Developer (PySpark)
Vacancy from Hirify Global, list of international tech companiesPlus is required to make matches and apply
Match & Cover letter
Plus required for matching with this vacancy
Job description
Text:
TL;DR
Data Developer (PySpark): Designing and operating data pipelines on modern cloud platforms to transform raw vendor data into production-ready financial datasets with an accent on scalability, reliability, and accuracy. Focus on building PySpark workflows in Databricks and integrating global financial data feeds.
Location: Singapore (Hybrid)
Company
provides enterprise data management solutions to the global investment community, powering intelligence for over US$75 trillion in assets under management.
What you will do
- Build and maintain scalable data pipelines using Databricks and PySpark to ingest and transform financial datasets.
- Ensure datasets are accurate, consistent, and validated for downstream analytics and reporting.
- Integrate and manage data from global vendors, adapting to feed changes and evolving requirements.
- Translate business and client requirements into robust, production-ready data workflows.
- Collaborate with product and client teams to deliver data outputs within agreed timelines.
- Operate within structured processes and tooling to ensure traceability and operational resilience.
Requirements
- Strong programming skills in Python and PySpark.
- Hands-on experience with Databricks or similar distributed data processing platforms.
- Degree in a technical discipline such as Engineering, Computer Science, or Mathematics.
- At least 1 year of experience working with data in a technical or project-based context.
- Experience with data transformation and validation of structured or semi-structured data.
- Familiarity with version control systems such as Git.
Nice to have
- Experience with SQL and data lake / lakehouse architectures.
- Familiarity with Parquet, XML, and API-based ingestion.
- Exposure to platforms like Snowflake or Palantir Foundry.
- Understanding of financial markets or financial datasets.
- Experience using Excel for data analysis or progress toward a CFA qualification.
Culture & Benefits
- Flexible hybrid work environment.
- Private Health Insurance, including coverage for eligible dependents.
- 23 days of annual leave.
- Access to an Employee Assistance Programme.
Be careful: if the employer asks you to log into their system using iCloud/Google, send codes/passwords, or run code/software, don't do it - these are scammers. Always click "Report" or contact support. More in guide →