Azure Data Engineer (West Bengal)

Roles and Responsibilities

- Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions such as Azure Blob Storage, Azure SQL Database, and Azure Synapse Analytics.

- Collaborate with cross-functional teams to understand business requirements and design scalable data architectures that meet those needs.

- Develop complex data transformations using PySpark on Azure Databricks to integrate with other systems and services.

- Ensure high availability, security, and performance of deployed ADF workflows by monitoring logs, troubleshooting issues, and implementing improvements.

- Participate in code reviews to ensure adherence to coding standards and best practices. Apply on Kit Job: kitjob.in/job/4na3nz