ByPosition: Azure Data Engineer
Location: Bengaluru, India
Experience Required: 3-6 years
Job Description:
Antal International is looking for a highly skilled Azure Data Engineer to join their team. The candidate will be responsible for designing, building, and maintaining scalable data pipelines within an Azure cloud environment, working closely with data scientists, analysts, and other stakeholders to ensure efficient data flow and storage.
Key Responsibilities:
- Design and implement data pipelines using Azure Data Factory and PySpark.
- Develop and maintain data models in Azure SQL Database, Azure Synapse Analytics, and other Azure services.
- Optimize and manage large datasets, ensuring high availability, performance, and security.
- Monitor and troubleshoot data pipelines, ensuring data integrity.
- Document processes and data architectures for team clarity.
Must-Have Skills:
- Proficiency in Python for data manipulation.
- Extensive experience with PySpark for large-scale data processing.
- Hands-on experience with Azure Data Factory.
- Strong knowledge of Azure SQL Database and Azure Synapse Analytics.
- Experience in optimizing Azure Databricks environments.
- Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.
- Strong problem-solving skills.
Preferred Qualifications:
- Experience with Azure Blob Storage, Azure Cosmos DB, and Azure Data Lake.
- Knowledge of DevOps practices, including CI/CD pipelines using Azure DevOps.
- Certification in Azure Data Engineering or related fields.
- Excellent communication skills.
Education: Bachelor’s degree in Computer Science, Information Technology, or a related field.
Company: Antal International, a global recruitment firm specializing in finding mid to senior-level candidates across various sectors.
If this role matches your experience and interests, you can apply directly using the following link: Apply Now.
