Location: Abu Dhabi
Job code: 101280
Posted on: Jul 21, 2025
About Us:
AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare, supply chain & logistics, consumer retail, manufacturing, eGovernance and other industry sectors.
We are looking for hungry, highly skilled and motivated individuals to join our dynamic team. If you’re passionate about technology and thrive in a fast-paced environment, we want to hear from you.
Job Summary:
We are looking for an experienced AI & Azure Databricks Engineer to join our growing data engineering and AI solutions team. In this role, you will design, develop, and optimize scalable data pipelines and machine learning workflows using Microsoft Azure and Databricks. You will collaborate with data scientists, analysts, and business stakeholders to deliver reliable, secure, and high-performance data and AI solutions that drive business impact.
- Design and implement end-to-end data pipelines on Azure Databricks, integrating various data sources (structured and unstructured) using Apache Spark and other modern big data technologies.
- Develop and maintain ETL/ELT processes using Azure Data Factory, Azure Synapse Analytics, and related services.
- Build and deploy scalable machine learning models using Databricks MLflow, PySpark, and Azure Machine Learning.
- Optimize data workflows for performance, scalability, and cost-efficiency in a cloud environment.
- Ensure best practices for data governance, security, and compliance within the Azure ecosystem.
- Collaborate with data scientists, analysts, and business units to understand requirements and translate them into robust technical solutions.
- Automate deployment and monitor pipelines using CI/CD tools and DevOps practices.
- Troubleshoot, debug, and resolve data processing and integration issues in production and development environments.
- Stay up to date with emerging technologies in cloud, AI, and big data ecosystems, and propose innovative solutions to improve our platform.
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or related field.
- 6+ years of hands-on experience with Azure cloud services, including Azure Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics, and Azure Machine Learning.
- Strong programming skills in PySpark, Python, and SQL.
- Solid understanding of data modeling, distributed computing, and big data architectures.
- Experience deploying and managing machine learning workflows with MLflow or similar frameworks.
- Familiarity with CI/CD pipelines and version control systems (e.g., Git, Azure DevOps).
- Good understanding of security best practices in cloud data environments (e.g., IAM, encryption, networking).
- Excellent problem-solving skills and ability to work in a collaborative, agile team environment.
- Opportunities to work on transformative projects, cutting-edge technology and innovative solutions with leading global firms across industry sectors.
- Continuous investment in employee growth and professional development with a strong focus on up & re-skilling.
- Competitive compensation & benefits, ESOPs and international assignments.
- Supportive environment with healthy work-life balance and a focus on employee well-being.
- Open culture that values diverse perspectives, encourages transparent communication and rewards contributions.
How to Apply:
If you are interested in joining our team and meet the qualifications listed above, please apply and submit your resume highlighting why you are the ideal candidate for this position.
