Summary:
We are seeking a highly skilled Data Engineer with deep expertise in Spark and AWS Glue to design, develop, and maintain scalable ETL pipelines. The ideal candidate will have experience working with large-scale data processing, cloud-native services, and modern data architecture.
Responsibilities:
• Collaborate with stakeholders to communicate complex technical concepts effectively.
• Provide technical guidance and mentorship to junior engineers and architects.
• Actively participate in the evaluation and selection data modeling and technologies.
• Lead design, develop, and optimize ETL/ELT pipelines using AWS Glue and Python
• Build and maintain data lakes and data warehouses on AWS (e.g., S3, Redshift).
• Collaborate with data analysts, scientists, and business stakeholders to understand data requirements.
• Implement data quality, governance, and security best practices.
• Monitor and troubleshoot Spark jobs and Glue workflows for performance and reliability.
• Develop and maintain documentation for data workflows and architecture.
• Ensure the quality delivery for batch ETL
Qualifications:
• Bachelor's degree in computer science or a related field
• 4+ years of experience as a Spark Senior (data modeling) and AWS Glue or in a similar role.
• 4+ years of hands-on experience with AWS services, including EC2, VPC, S3, Lambda, ECS/EKS, RDS, IAM, and more.
• Proficiency in scripting languages such as Python or Bash.
• Experience with containerization technologies such as Docker.
• Excellent communication, presentation, and interpersonal skills (English).
• Strong analytical and problem-solving abilities.
• Nice to have experience working with Japan Project
Fostering innovation through diverse perspectives
Hitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people, which drives our innovation and growth.
We are committed to building an inclusive culture based on mutual respect and merit-based systems. We believe that when people feel valued, heard, and safe to express themselves, they do their best work.
How we look after you
We help take care of your today and tomorrow with industry-leading benefits, support, and services that look after your holistic health and wellbeing. We’re also champions of life balance and offer flexible arrangements that work for you (role and location dependent). We’re always looking for new ways of working that bring out our best, which leads to unexpected ideas. So here, you’ll experience a sense of belonging, and discover autonomy, freedom, and ownership as you work alongside talented people you enjoy sharing knowledge with.
We’re proud to say we’re an equal opportunity employer and welcome all applicants for employment without attention to race, colour, religion, sex, sexual orientation, gender identity, national origin, veteran, age, disability status or any other protected characteristic. Should you need reasonable accommodations during the recruitment process, please let us know so that we can do our best to set you up for success.