Job Role: - Azure Data Engineer
Job Location :- Gurgaon/Chennai/Bangalore/Pune/Bhopal/Jaipur/Hyderabad
Experience:- 5+ Years
We are looking for a highly skilled Azure Data Engineer for an engagement to build scalable, production-ready data solutions.
The ideal candidate will have strong hands‑on experience with Python, PySpark, Azure Databricks, and Azure Data Factory, along with a solid understanding of modern data engineering best practices.
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines using Python, PySpark, and Spark SQL
Build and optimize workloads on Azure Databricks (notebooks, job clusters, workflows)
Implement Delta Lake best practices (schema evolution, partitioning, performance tuning, merge strategies)
- Develop robust ingestion frameworks integrating with Azure Data Lake Storage Gen2 and Azure SQL
- Implement data validation, transformation logic, and quality control frameworks
- Ensure performance optimization and cost-efficient execution
- Support production deployments, monitor pipelines, and resolve incidents
- Maintain version control using Git and follow CI/CD best practices
- Collaborate with architects, analysts, and business stakeholders
Mandatory Skills
Strong hands-on experience in PySpark and Spark SQL
Proven experience in Spark performance tuning & optimization
Solid expertise in Azure Databricks
Strong knowledge of Delta Lake architecture
- Experience working with Azure Data Lake Storage Gen2
- Git-based version control experience
- Production support and troubleshooting experience
Good to Have
Exposure to data governance, data security, and compliance frameworks
- Experience integrating data from SAP ERP systems
- Knowledge of Azure Data Factory (ADF)
- Understanding of DevOps and CI/CD pipelines
A new age company, we are passionate about bringing a revolution in the business world. With the policy of contract staffing, we create a dexterous team that can help you reach your potential.
We also provide training solutions, to equip your employees with relevant skills. Moreover, with the help of our digital transformation, one learns to deeply engage their customers and value their personalised experience.
What makes us unique is our far-sighted vision. Eliminating short-lived gratification, we provide you with solutions that are durable and promise larger gains.
With a dynamic outset, we at epergne solutions provide you with essential training programs such as team building and skill development, for better exposure. With ever-growing globalisation, we offer you a flexible, agile and interactive structure, to reach your dreams!
We would be happy to be your friend, guide and teammate as you take your journey to establish your dreams. We assure you of a perfect support system that will help you meet the demands of the 21st century.