Job Description - Grade Specific

• Direct experience developing ETLs and data pipelines using Apache Spark with PySpark library.
• Experience with Azure Stack.
• Experience with work flow management tools like Apache Airflow.
• Scrum and DevOps methodology

Primary Skills

• Azure services (ADF, ADLS Gen2, Event Hub etc..).
• Databricks (preferably certified on both), Python, Pyspark, Spark SQL.
• Experience with Azure Stack.

Skills (competencies)