TECHNICAL SKILLS AND EXPERIENCE
· 7+ years professional experience as a data engineer, with at least 4 utilizing cloud technologies.
· Proven experience working with Databricks either in Azure or AWS.
· Strong experience with the Microsoft Azure Data Stack (Databricks, Data Lake Gen2, ADF etc.
· Expertise building ETL and data pipelines on Databricks using data engineering languages Python and SQL on Azure.
· Strong SQL skills and proficiency in programming languages such as Python, Scala, Java.
· Familiarity with big data technologies such as Hadoop, Spark, or Kafka.
· Proven experience with unit testing and applying appropriate testing methodologies.
· Demonstrable experience with CICD, including release and test automation tools and processes.
· Strong understanding of data modeling, data warehousing, and OLAP concepts.
· Experience with data visualization tools such as Tableau, Power BI, or Looker is a plus.
· Excellent technical documentation skills.