Data Engineer (Python/SQL/Spark)

Data Engineer

Company

JLabs Digital

Conditions

6 days agoJunior Anywhere Remote Full Time Data Science Jobs by JLabs Digital

JLabs Digital Stealth Distributed View jobs by JLabs Digital

Skills

Agile Amazon Web Services Analytics Big Data Data Cleaning Data Collection Data Lake Data Pipeline Data Processing Data Visualization Etl Git Google Cloud Platform Mobile Development Nosql Prototyping Python Spark Sql Ui/Ux Web Development

About the Role

You will design, build and maintain data pipelines and data lakes. You will collect, clean and process data while ensuring its quality and availability. You will work with data scientists, platform engineers and front-end engineers to define requirements, create new data processes, and improve existing ones. You will also develop data visualization and analytics tools.

Requirements

• Experience designing, building and maintaining data pipelines and data lakes
• Experience with Amazon Web Services, Google Cloud Platform and ETL pipelines
• In-depth knowledge of SQL and NoSQL databases
• Experience with Spark or other big data frameworks
• Fluency in Python
• Experience developing web and mobile applications
• Experience collaborating with UI/UX designers
• Experience with rapid prototyping
• Working experience with Git
• Exposure to agile software development methodology
• 1 to 3 years of experience
• B.E., B.Tech, BCA, MCA, B.Sc or M.Sc

Responsibilities

• Design, build and maintain data pipelines and data lakes
• Collect, clean and process data while ensuring data quality and availability
• Collaborate with data scientists, platform engineers and front-end engineers to define requirements and design data processes
• Maintain and improve existing data processes
• Design, develop and implement data visualization and analytics tools
• Collaborate with UI/UX designers
• Create rapid prototypes

Показать контакты