Senior Data Extraction Engineer (AI)

TL;DR

Senior Data Extraction Engineer (AI): Designing and deploying large-scale web scraping solutions for AI training datasets with an accent on data integrity and compliance. Focus on building robust, distributed crawlers, optimizing data preprocessing workflows for machine learning models, and collaborating with cross-functional AI teams.

Location: Chengdu (Onsite)

Company

Razer is a global leader in gaming hardware and lifestyle, dedicated to revolutionizing the gaming experience through innovative technology and software.

What you will do

• Design, develop, and deploy scalable web scraping solutions to collect datasets for AI training.
• Build robust crawlers to extract structured and unstructured data from diverse online sources.
• Clean, preprocess, and organize scraped data for integration into machine learning models.
• Ensure data accuracy, integrity, and strict adherence to crawling ethics and regulations.
• Monitor and optimize crawler performance to ensure high efficiency and system reliability.
• Collaborate with AI teams to define data requirements and ensure high relevance of collected content.

Requirements

• Bachelor's or Master’s degree in Computer Science, Software Engineering, or a related field.
• Strong experience with web scraping frameworks such as Scrapy, Selenium, or BeautifulSoup.
• Proficiency in programming languages including Python, Java, or Node.js.
• Solid understanding of HTTP, HTML parsing, JSON, SQL, and NoSQL databases.
• Experience with cloud platforms (AWS, GCP) and containerization tools like Docker.
• Understanding of web crawling best practices and data compliance regulations.

Nice to have

• Experience with large-scale distributed crawlers and handling diverse data formats.
• Knowledge of AI and machine learning concepts, particularly data preprocessing.
• Familiarity with browser automation tools for dynamic content rendering.

Culture & Benefits

• Global mission-driven environment focused on revolutionizing the gaming industry.
• Opportunity for professional growth and impact across a team spanning five continents.
• Exposure to gamer-centric culture and innovative AI development challenges.