Data Engineer

Key Responsibilities- Design, develop, and maintain scalable data pipelines and ETL/ELT solutions using Azure services.- Build and optimize data processing workflows using Azure Databricks, Apache Spark, and Python.- Develop and manage enterprise data integration solutions using Azure Data Factory (ADF) and SQL Server Integration Services (SSIS).- Design and implement data storage solutions using Azure Data Lake Storage Gen2 (ADLS Gen2) and Azure Synapse Analytics.- Perform advanced SQL development, query tuning, and performance optimization for large datasets.- Collaborate with business stakeholders, analysts, and architects to understand data requirements and deliver robust solutions.- Implement data quality, security, governance, and monitoring processes.- Participate in code reviews, version control management, and deployment activities using Git.- Troubleshoot and resolve data pipeline failures, performance bottlenecks, and production issues.- Follow best practices for cloud architecture, data modeling, and engineering standards. Required Skills & QualificationsMust-Have Skills- Strong hands-on experience with Azure Synapse Analytics- Expertise in Azure Databricks- Experience with Azure Data Factory (ADF)- Strong knowledge of SQL Server Integration Services (SSIS)- Advanced SQL programming and Query Optimization- Deep understanding of Apache Spark for batch and distributed data processing- Proficiency in Python for data engineering and automation- Experience with Git Version Control- Knowledge of Azure Data Lake Storage (ADLS Gen2)- Strong analytical, troubleshooting, and problem-solving skills- Excellent communication and stakeholder management abilities