Responsibilities

- Design, build, and maintain scalable and robust data pipelines using Azure Data Factory, Azure Synapse, and other relevant tools.

- Leverage Apache Spark or Databricks for big data processing and analytics.

- Develop and optimize data models, schema design and architectures for data warehousing and business intelligence using Power BI and other analytics tools.

- Lead and mentor teams of Data Engineers, providing technical guidance and oversight to ensure project success.

- Collaborate with cross-functional teams, including data scientists, business analysts, and IT professionals, to understand data needs and deliver comprehensive data solutions.

- Implement and maintain data security and compliance measures in line with organizational policies and regulations.

- Stay abreast of industry trends and advancements in data engineering and analytics technologies, applying best practices to improve processes and solutions.

- Drive the adoption of innovative data engineering techniques and tools, fostering a culture of continuous improvement and learning.