Data DevOps Engineer

As Data DevOps Engineer, you will spearhead functional development, deploy new ingestion end-points, optimize our Data Lake storage, and ensure the maintenance and monitoring of our platform.

This position is available for candidates in either Rotterdam, Netherlands, or Warsaw, Poland.

Your tasks

• Develop and maintain scalable data ingestion end-points to handle increasing data volume and complexity
• Load data from various sources in different formats into the data lake
• Manage resource groups and access rights
• Monitor performance and availability of data endpoints to meet uptime requirements
• Troubleshoot, analyze, and resolve issues related to data ingestion
• Optimize data storage to ensure scalability for growing data volumes
• Perform platform-related tasks such as scripting, creating serverless functions, and managing containers
• Ensure cloud platform services are up-to-date and migrate as older versions are retired
• Define, implement, and maintain deployment pipelines
• Contribute to platform documentation
• Implement and manage build infrastructure for the DevOps platform
• Automate builds and ensure the smooth operation of the pipeline
• Oversee infrastructure management tasks

Your profile

• University degree in IT, Mathematics, Science, Engineering, or a related discipline
• 3+ years’ experience of development engineering related to big data analytics environments
• Good knowledge of Azure Cloud Services, especially the Big Data/Analytics stack (EventHubs, Blob Storage, Functions, HDInsight, etc.)
• Big Data Architectural understanding like scalability, loose coupling between services, hot vs. cold path, Lambda, etc.
• Familiarity with scripting languages like JavaScript and/or Python
• Good knowledge of JSON, Parquet, Avro
• Knowledge about Azure Databricks/Spark, Redis, NoSQL and/or CosmosDB
• Understand big data related concepts such as Machine Learning and Artificial Intelligence

Our offer

We can offer you a new challenge, with interesting tasks and much more – including an open corporate culture, flat hierarchies, support for further training and development, opportunities to take on responsibility, an excellent range of foods, sports and cultural facilities, attractive employment conditions, and flexible working time models. Employment level: 80 - 100%.

Marcel Huber, Senior Manager Recruitment Delivery CH & PL, is looking forward to receiving your complete application via our online job application platform.

For this vacancy only direct applications will be considered.