to design and build scalable, high-performance data platforms. The ideal candidate should have a strong background in AWS and other Public cloud services, data engineering, AI platform development, data integrity, and schema design. The role demands expertise in ETL techniques, open-source tools, data migration, and enterprise data architecture.
Key Responsibilities:
Architect and Design
scalable and secure data platforms, ensuring high availability and performance.
Develop and Optimize
data pipelines and ETL processes using modern frameworks and methodologies.
Implement AI & ML Platforms
, ensuring seamless integration with enterprise data ecosystems.
Ensure Data Integrity & Governance
by enforcing best practices for security, compliance, and quality.
Oversee Data Migration
strategies and execution from legacy to modern cloud-based architectures.
Leverage AWS Services
, including but not limited to S3, Redshift, Glue, EMR, Athena, Lambda, DynamoDB, and Kinesis.
Lead Open Source Adoption
, integrating tools like Apache Spark, Airflow, Kafka, and Flink for data processing.
Collaborate with Cross-Functional Teams
including Data Engineers, Data Scientists, and DevOps to streamline data workflows.
Monitor Performance & Scalability
, proactively addressing bottlenecks in data processing and analytics.
Establish Best Practices
for data modeling, schema design, and data architecture across various domains.
Mentor and Guide
engineering teams to enhance data capabilities within the organization.
Required Skills & Qualifications:
15+ years of experience
in data engineering, data architecture, and cloud-based platforms.
Expertise in AWS Cloud Services
and hands-on experience with data storage, compute, and analytics tools.
like Apache Spark, Hadoop, Airflow, Kafka, Flink, and Presto.
Deep Understanding of AI & ML Workflows
and their integration with data platforms.
Proven Experience in Data Migration Strategies
from on-premises to cloud.
Expertise in Data Schema Design, Modeling, and Optimization
for relational and NoSQL databases.
Solid Programming Skills
in Python, SQL, and Spark.
Strong Problem-Solving Abilities
with an analytical and strategic mindset.
Excellent Leadership and Communication Skills
, capable of working with technical and business stakeholders.
Preferred Qualifications:
AWS Certified Solutions Architect or AWS Certified Data Analytics Certification.
Experience working in
AI-driven data platforms
or
MLOps environments
.
Familiarity with
Kubernetes, Docker
, and CI/CD pipelines for data workflows.
Why Join Us?
Work with cutting-edge technologies in data and AI.
Influence key architectural decisions and drive innovation.
Competitive compensation and benefits package.
A collaborative and high-performing team environment.
If you are passionate about data platforms and have a strong technical foundation, we invite you to apply and be part of our growing team!
Job Category:
Information Technology
Job Type:
Contract
Job Location:
Dubai
Languages:
English
Experience:
15 + years
Beware of fraud agents! do not pay money to get a job
MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.