Cloud Data Engineer(005933)
BASF
Data Science
Nanjing, Jiangsu, China
Posted on Oct 9, 2024
位于南京的巴斯夫中国数字化中心吸引、培养和发展充满热情的数字化人才，他们将对巴斯夫的数字化未来产生深远的影响。快来加入我们，成为巴斯夫数字化之旅的一部分。
Digital Hub China in Nanjing attracts, grows, and develops passionate people who will meaningfully impact the digital future of BASF. Come join us and be a part of our digitalization journey.
Objectives:
Our team “Data and AI China” develops innovative platforms to derive insights from data that support better and faster business decisions. We implement end to end solutions in their complete lifecycles and provide comprehensive services in various domains for BASF China business partners.
In this role, you will contribute to building a robust and scalable China Data Lake for managing and deriving insights from vast quantities of data. By utilizing Azure's PaaS components, our platform streamlines the deployment and handling of Big Data workloads (i.e. Data ingestion, data transformation and distribution), empowering our clients to make data-driven decisions and propel business expansion.
Main Task:
- Design, implement and maintain a meta-data driven data ingestion framework
- Create data transform functions to increase data quality using Azure Databricks and Azure Data Factory
- Develop and maintain data distribution using Unity Catalog with Azure Databricks and Azure Data Factory
- Implement quality control measures to ensure accuracy and consistency of data.
- Collaborate with the global enterprise data lake team and data science team to create synergies between global and local data ecosystems
- Support our internal business partners/customers regarding new data source onboarding to CDL and data provisioning
- Develop and maintain technical documentation.
Job Requirements:
- Bachelor's or master's degree in computer science, Information Technology, Engineering, Business, or related fields.
- Minimum 3-4 years related working experience as data Engineer on cloud-based platforms
- Experience in Agile way of working with a DevOps mindset
- In-depth know how with Big Data concepts (data lake, data warehouse, Lakehouse, metadata) and tech skills (Spark, Python, SQL).
- Strong software engineering and development skills to build Data platform.
- Familiar with Azure cloud automation & scripting with tools like Azure DevOps pipelines, Azure Data Factory, etc.
- Nice to have experiences with managing and operating solutions via command line utilities and working to improve automation and enlist modern practises (DevOps, CI/CD, Terraform, etc.).
- Integration knowledge between Data Catalog Collibra and Big Data Platforms is a plus.
- Ideally, backed up by vendor certifications (e.g. Azure).
- Fluent English and Mandarin skills
巴斯夫中国数字化中心于2020年在南京成立。作为全球数字中心的重要部分，中国中心正在迅速发展中，未来将会有更多岗位开放。巴斯夫专注于数字化和创新的IT解决方案，以增强巴斯夫在中国的IT化和专业化，为巴斯夫带来了一支全方位的数字化人才团队，在中国独特的数字化环境中创造解决方案。中心还为湛江一体化基地等大型项目的智能制造做出贡献。
在巴斯夫，我们为可持续发展的未来，创造化学新作用。我们将经济成功与环境保护相结合。我们肩负社会责任。巴斯夫集团超过110，000名员工为巴斯夫的成功做出了贡献。我们的客户遍布世界上几乎所有行业和几乎每个国家。我们的产品组合分为六个部分：化学品，材料，工业解决方案，表面活性剂，营养与护理以及农业解决方案。巴斯夫2020 年销售额为 590 亿欧元。更多信息请见 www.basf.com。
Digital Hub China was founded in 2020 in Nanjing. As part of the Global Digital Hub Verbund, the hub is rapidly growing with a target of a three-digit number of employees in coming years. Focused on digitalization and innovative IT solutions to enhance BASF’s IT portfolio and expertise in China, it brings an all-around capable team of digital talents to create solutions in the context of China’s unique digital landscape to BASF. It also contributes to the smart manufacturing endeavors for the new mega project in Zhanjiang.
At BASF, we create chemistry for a sustainable future. We combine economic success with environmental protection and social responsibility. More than 110,000 employees in the BASF Group contribute to the success of our customers in nearly all sectors and almost every country in the world. Our portfolio is organized into six segments: Chemicals, Materials, Industrial Solutions, Surface Technologies, Nutrition & Care and Agricultural Solutions. BASF generated sales of €59 billion in 2020. Further information at www.basf.com.
BASF Asia-Pacific Service Center is based in Malaysia, we may reach you via Malaysia phone number.
请时刻警惕任何可能的招聘欺诈行为！请注意，巴斯夫绝不会在任何情况下向候选人以任何形式收取任何费用。
Digital Hub China in Nanjing attracts, grows, and develops passionate people who will meaningfully impact the digital future of BASF. Come join us and be a part of our digitalization journey.
Objectives:
Our team “Data and AI China” develops innovative platforms to derive insights from data that support better and faster business decisions. We implement end to end solutions in their complete lifecycles and provide comprehensive services in various domains for BASF China business partners.
In this role, you will contribute to building a robust and scalable China Data Lake for managing and deriving insights from vast quantities of data. By utilizing Azure's PaaS components, our platform streamlines the deployment and handling of Big Data workloads (i.e. Data ingestion, data transformation and distribution), empowering our clients to make data-driven decisions and propel business expansion.
Main Task:
- Design, implement and maintain a meta-data driven data ingestion framework
- Create data transform functions to increase data quality using Azure Databricks and Azure Data Factory
- Develop and maintain data distribution using Unity Catalog with Azure Databricks and Azure Data Factory
- Implement quality control measures to ensure accuracy and consistency of data.
- Collaborate with the global enterprise data lake team and data science team to create synergies between global and local data ecosystems
- Support our internal business partners/customers regarding new data source onboarding to CDL and data provisioning
- Develop and maintain technical documentation.
Job Requirements:
- Bachelor's or master's degree in computer science, Information Technology, Engineering, Business, or related fields.
- Minimum 3-4 years related working experience as data Engineer on cloud-based platforms
- Experience in Agile way of working with a DevOps mindset
- In-depth know how with Big Data concepts (data lake, data warehouse, Lakehouse, metadata) and tech skills (Spark, Python, SQL).
- Strong software engineering and development skills to build Data platform.
- Familiar with Azure cloud automation & scripting with tools like Azure DevOps pipelines, Azure Data Factory, etc.
- Nice to have experiences with managing and operating solutions via command line utilities and working to improve automation and enlist modern practises (DevOps, CI/CD, Terraform, etc.).
- Integration knowledge between Data Catalog Collibra and Big Data Platforms is a plus.
- Ideally, backed up by vendor certifications (e.g. Azure).
- Fluent English and Mandarin skills
巴斯夫中国数字化中心于2020年在南京成立。作为全球数字中心的重要部分，中国中心正在迅速发展中，未来将会有更多岗位开放。巴斯夫专注于数字化和创新的IT解决方案，以增强巴斯夫在中国的IT化和专业化，为巴斯夫带来了一支全方位的数字化人才团队，在中国独特的数字化环境中创造解决方案。中心还为湛江一体化基地等大型项目的智能制造做出贡献。
在巴斯夫，我们为可持续发展的未来，创造化学新作用。我们将经济成功与环境保护相结合。我们肩负社会责任。巴斯夫集团超过110，000名员工为巴斯夫的成功做出了贡献。我们的客户遍布世界上几乎所有行业和几乎每个国家。我们的产品组合分为六个部分：化学品，材料，工业解决方案，表面活性剂，营养与护理以及农业解决方案。巴斯夫2020 年销售额为 590 亿欧元。更多信息请见 www.basf.com。
Digital Hub China was founded in 2020 in Nanjing. As part of the Global Digital Hub Verbund, the hub is rapidly growing with a target of a three-digit number of employees in coming years. Focused on digitalization and innovative IT solutions to enhance BASF’s IT portfolio and expertise in China, it brings an all-around capable team of digital talents to create solutions in the context of China’s unique digital landscape to BASF. It also contributes to the smart manufacturing endeavors for the new mega project in Zhanjiang.
At BASF, we create chemistry for a sustainable future. We combine economic success with environmental protection and social responsibility. More than 110,000 employees in the BASF Group contribute to the success of our customers in nearly all sectors and almost every country in the world. Our portfolio is organized into six segments: Chemicals, Materials, Industrial Solutions, Surface Technologies, Nutrition & Care and Agricultural Solutions. BASF generated sales of €59 billion in 2020. Further information at www.basf.com.
BASF Asia-Pacific Service Center is based in Malaysia, we may reach you via Malaysia phone number.
请时刻警惕任何可能的招聘欺诈行为！请注意，巴斯夫绝不会在任何情况下向候选人以任何形式收取任何费用。
