Prudential’s purpose is to be partners for every life and protectors for every future. Our purpose encourages everything we do by creating a culture in which diversity is celebrated and inclusion assured, for our people, customers, and partners. We provide a platform for our people to do their best work and make an impact to the business, and we support our people’s career ambitions. We pledge to make Prudential a place where you can Connect, Grow, and Succeed.
Role and Responsibilities
- Design, develop and deliver the building of data pipelines across various integration points for the global Financia Data Layer (FDL)
- Create and maintain scalable data pipelines using Pyspark and ETL workflows using Azure Databricks and Azure Data Factory
- Data Modelling and Architecture: Build and optimize data models and structures to support analytics and business requirements
- Performance Optimization: Monitor, tune, and troubleshoot pipeline performance to ensure efficiency and reliability
- Collaboration: Partner with business analysts and stakeholders to understand data needs and deliver actionable insights
- Governance: Implement data governance practices, ensuring data quality, security, and compliance with regulations
- Documentation: Develop and maintain comprehensive documentation for data pipelines and architecture
- Testing: Experience in testing and test automation
- Collaborate with cross-functional teams to understand data requirements and provide technical advice
Qualifications
- Experience Level: Extensive experience in Azure Databricks, Unity Catalog, Azure Data Factory, Azure DevOps Delta Lakes, DevSecOps, NFRs (Non-Functional Requirements); experience in insurance domain desirable
- Education Level: Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Science or a related relevant field;
- Certification in Azure Data Engineer Associate or similar, and experience with additional Azure services (e.g., Azure Synapse Analytics, Azure SQL Database)
- Personal Attributes: Strong analytical skills, leadership capabilities, effective communication, and problem-solving ability
Mandatory skills
- Strong background in data engineering, with experience architecting complex data systems in large-scale environments
- Technical Skills: Proficiency in SQL, Azure Databricks (Spark, Delta Lake), Azure Data Factory, and programming languages such as Python or Scala.
- Communication: Strong problem-solving skills and the ability to communicate complex technical concepts to non-technical stakeholders
Prudential is an equal opportunity employer. We provide equality of opportunity of benefits for all who apply and who perform work for our organisation irrespective of sex, race, age, ethnic origin, educational, social and cultural background, marital status, pregnancy and maternity, religion or belief, disability or part-time / fixed-term work, or any other status protected by applicable law. We encourage the same standards from our recruitment and third-party suppliers taking into account the context of grade, job and location. We also allow for reasonable adjustments to support people with individual physical or mental health requirements.