Big Data Engineer（Retail Industry）
IBM
Data Science
Shanghai, China
Posted on Dec 21, 2024
Introduction
As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world’s technology leader. Come to IBM and make a global impact!
Your Role and Responsibilities
As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world’s technology leader. Come to IBM and make a global impact!
Your Role and Responsibilities
- Be part of a growing team that establishes new services based in China
- Work with a diverse team of different technical backgrounds on establishing a localized solution for service stability
- Help cross function teams investigate production issues with strong analytical reasoning and evidence
- Leverage existing tools to find service bottlenecks and opportunities for improvements
- Build on top of existing observability platforms to address new challenges
- Be part of on-call rotation that responds to urgent issue
Required Technical and Professional Expertise
- 5~8 years experiencing developing scalable data lake / data warehouse on top of big data platform.
- Have deep Knowledge and experiences on Spark SQL / Hive SQL language, good knowledge of Presto or other MPP databases.
- Have good experiences on Airflow or other data warehouse scheduling tools.
- Have good experiences on data warehouse modeling.
- Have good knowledge on AWS S3, EMR, lambda and AWS components or similar tech stack on other cloud.
- Experiences on real time data processing, streaming data processing will be strong plus
- Have experiences on Python programming
- Strong skills building positive relationships across Product and Engineering.
- Able to quickly pick up new programming languages, technologies, and frameworks.
- Experience working in Agile and Scrum development process.
Preferred Technical and Professional Expertise
- Fluent English skill (including oral and written English)
- Experience of order process in retail industry
