Capgemini is currently seeking an Azure Data Engineer Lead to become part of our esteemed IT team in Malaysia. As an Azure Data Engineer Lead, you will have the chance to work on innovative projects and collaborate with diverse teams to deliver exceptional data solutions. This is a rare opportunity to demonstrate your skills and expertise in a forward-thinking and ambitious organization.

Role and Responsibilities

• Design, develop and deliver the building of data pipelines across various integration points.
• Develop and confirm pipeline tools for ingestion, transformation, and distribution, based on fact-finding and assessment of existing solutions within frameworks.
• Implement data models, ensuring scalability, performance, and reliability.
• Collaborate with diverse teams to identify data requirements and provide technical advice.
• Select appropriate tools and technologies for data storage, processing, and analysis.
• Optimize data infrastructure for cost-effectiveness and performance.
• Work with the Develops team to ensure data security, compliance, and governance standards are met.

Mandatory Skills

• Extensive experience in data engineering, including the design and implementation of intricate data systems in high-volume settings.
• Experience in the successful delivery of complex finance data-related projects end to end.
• Experience in Agile and DevSecOps delivery, quality practices, techniques, test automation, and tools required for all aspects of data engineering/data platforms.
• Experience with cloud-based technologies including Microsoft Azure, Databricks, and Delta Lake.
• Experience in data ingestion tools of CDC, ADF, and Qlik Replicate.
• Experience in the adoption of data governance frameworks using Collibra and Unity Catalog.
• Experience with JIRA, Confluence, Github, Bitbucket, and other similar developer tools.
• Experience in using PowerBI for data visualization and analytics, assiting a data-enabled organization.