Senior Data Engineer For A Long Term Implementation Project, Uae

United Arab Emirates, United Arab Emirates

Job Description

Client > Consulting FirmRole > Senior Data EngineerOverview > As a Senior Data Engineer, you will play a crucial role in designing, building, and maintaining our data infrastructure. You will be responsible for ensuring the availability, integrity, and efficiency of our data pipelines, enabling our organization to make informed, data-driven decisions. The value you bring will be instrumental in delivering measurable value to the Company, its portfolio of companies, and beyond using data and AI.Responsibilities > own overall data lake and data warehouse architecture with the responsibilities to design, architect, and maintain the data warehouse infrastructure to support data management, data governance, analytics, ML & AI needs and address future challenges; Design, build, and maintain scalable data pipelines for ingesting, processing, and transforming data from various sources, ensuring data quality, scalability, and reliability; Develop and maintain data models, architecture patterns, schemas, and structures that support the needs of data analysts, data scientists, and other stakeholder; Create and optimize ETL processes to extract data from diverse sources, transform it into usable formats, and load it into data warehouses or other storage solutions; Implement and maintain data security measures to protect sensitive information and ensure compliance with data privacy regulations; Maintain thorough documentation of data engineering processes, data models, and data dictionaries.Qualifications > Bachelor\xe2\x80\x99s degree in computer science, information technology, or a related field (master\'s degree is a plus); Demonstrable experience of minimum 10 years with at least 5 years in a leadership position as a Senior Data Engineer or similar, with a portfolio of projects 10+ years of experience in data engineering with a focus on designing and implementing data lakes, data warehouses, data modelling, ETL processes, and data transformation pipelines; Experience in cloud-based data platforms (e.g., Spark, Azure Synapse Analytics etc.); Proficiency in programming languages such as Python, Java, or Scala; Experience with orchestration services (i.e., Azure Data Factory (ADF), Azure Logic Apps, Azure Functions, Databricks Jobs, Airflow etc.); Experience with cloud platforms like AWS, GCP, or Azure; Excellent communications, leadership, and collaboration skillsTech Skills > Data management & databases: Oracle, SAP, SQL, NoSQL, Data Warehousing; Big data technologies: Apache Hadoop, Spark, Kafka; Data governance: Experience with Ab Initio, Informatica, Collibra, Purview, IBM InfoSphere, Great Expectations, Deepchecks, Databricks\xe2\x80\x99 Unity Catalog, Databricks\xe2\x80\x99 Delta Sharing; Data visualization: Familiarity with Matplotlib, Seaborn, Tableau, Power BI; Cloud platforms: Experience with Microsoft Fabric, Azure (Synapse Analytics, Databricks, Machine Learning, AI Search, Functions, etc.), Databricks on Azure, AWS (S3, Redshift, SageMaker, etc.), Google Cloud Platform (BigQuery, Dataflow, etc.).Workload/Location > Full time role, UAEEngagement > 6 months > This role offers an exciting opportunity to as the Client will be ready to-hire the Candidate once the 6-months cooperation modelling will be completed.Start date > research very URGENT, immediately available Candidates preferred

DIKTUCOM

Beware of fraud agents! do not pay money to get a job

MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1728599
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    United Arab Emirates, United Arab Emirates
  • Education
    Not mentioned