Databricks Senior Data Engineer

Abu Dhabi, AZ, AE, United Arab Emirates

Job Description

Abu Dhabi, United Arab Emirates


Relocation friendly


ETL (Informatica, Ab Initio etc.)


BCM Industry


06/08/2024


Req. VR-107048



##### Project description

We are hiring for projects in the Middle East. The team comprises front-end and back-end developers, data analysts and data scientists, architects, analysts, and project managers. You will work with modern technologies and be an integral part of continuing to evolve our high-performing platforms. If you are serious about being a part of this fast-paced and exciting journey, this project should be top of the list!

This role will be primarily responsible for closely collaborating with a business SME to implement data validation rules.


##### Responsibilities


Collaborating with a business SME to implement data validation rules.


Understand business requirements and actively provide input from a data perspective.


Understand the underlying data and flow of data.


Understand overall platform architecture and capabilities and how to load data effectively.


Recognize and adapt to the changes in processes.


##### Skills


Must have


7 years + of relevant experience.


Proficient hands-on experience with Azure Databricks (3y+).


Proficiency in Python and PySpark (5y+).


Advanced knowledge in SQL (5y+).


Should be able to analyse and understand complex data.


Knowledge of Azure data/delta lake, Azure DevOps, CI/CD, and Git is essential.


Should clearly understand the data platform lifecycle and contribute to preparing Design documents, Unit Test plans, and Code review reports.


Knowledge of data Lake house and business intelligence architecture.


Experience working in an Agile environment (Scrum, Agile) is a plus.


Interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision.


Bachelor's degree in IT/Computer Science or related field


Nice to have


Knowledge of the financial markets, portfolio theory, and risk management is a plus


##### Other


Languages


English: C1 Advanced


Seniority


Senior

Beware of fraud agents! do not pay money to get a job

MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1718700
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Abu Dhabi, AZ, AE, United Arab Emirates
  • Education
    Not mentioned