Tech Jobs for Talents without Borders
English-1st. Relocation-friendly. Curated daily by Imagine.
5,280 Jobs at 194 Companies

Professional Data Engineer

Kion Group AG

Kion Group AG

Data Science
Waterloo, ON, Canada
Posted on Friday, November 3, 2023
As customers grapple with the challenges of e-commerce fulfillment with ever increasing need to handle more volume, variety and variation with ever decreasing delivery time expectations, Dematic’s growth directly depends on bringing the next generation of intelligent supply chain solutions to market. These solutions include flexible order fulfillment, warehouse management systems, warehouse and supply chain execution systems, and supply chain optimization. A key strategy for Dematic to deliver on these growth priorities is to create a data engineering systems that will support operational analytics, process optimization, training of Machine Learning models and other differentiating features for Dematic customers. This position is within the Dematic Software R&D team and will provide technical and architectural leadership to make better business decisions.

What we offer:

Responsibilities:

  • Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.
  • Design and develop microservices to
  • Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.
  • Implement data integration and data quality processes to ensure the accuracy and reliability of data for analytics and reporting.
  • Optimize data storage, processing, and querying performance for large-scale datasets.
  • Enable advanced analytics and machine learning capabilities on the data platform.
  • Continuously monitor and improve data quality and data governance practices.
  • Stay up to date with the latest data engineering trends, technologies, and best practices.

Tasks and Qualifications:

What We Are Looking For:

Responsibilities:

  • Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.
  • Design and develop microservices to
  • Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.
  • Implement data integration and data quality processes to ensure the accuracy and reliability of data for analytics and reporting.
  • Optimize data storage, processing, and querying performance for large-scale datasets.
  • Enable advanced analytics and machine learning capabilities on the data platform.
  • Continuously monitor and improve data quality and data governance practices.
  • Stay up to date with the latest data engineering trends, technologies, and best practices.

Requirements:

  • Bachelor’s degree in computer science, Engineering, or a related field.
  • 5+ of proven experience in data engineering, data warehousing, and ETL processes.
  • Proficiency in data engineering tools and technologies such as SQL, Python, Spark, Hadoop, Airflow, Apache Kafka and Presto.
  • Solid experience with table formats such as Apache Iceberg or Delta Lake.
  • Design and development experience with batch and real time streaming infrastructure and workloads.
  • Solid experience with data lineage, data quality and data observability.
  • Solid experience designing and developing microservices and distributed architecture.
  • Hands-on experience with cloud-based data platforms (e.g., AWS, Azure, GCP) preferably GCP and data lakehouse architectures.
  • Strong experience with container technologies such as Docker, Kubernetes.
  • Strong understanding of data modeling, data architecture, and data governance principles.
  • Excellent experience with DataOps principles and test automation.
  • Familiarity with data processing and querying using distributed systems and NoSQL databases.
  • Ability to optimize and tune data processing and storage for performance and cost-efficiency.
  • Excellent problem-solving skills and the ability to work on complex data engineering challenges.
  • Strong communication and collaboration skills to work effectively with cross-functional teams.
  • Previous experience mentoring and guiding junior data engineers is a plus.
  • Relevant certifications in data engineering or cloud technologies are desirable.
  • Applicants must be authorized to work for any employer in the US. This position is not eligible for an employment visa sponsorship.

Nice to have:

  • Experience working in a Data Mesh architecture.

What We Offer:

  • Career Development
  • Competitive Compensation and Benefits
  • Pay Transparency
  • Global Opportunities

Learn More Here: https://www.dematic.com/en-us/about/careers/what-we-offer

Dematic provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.