Etl Engineer

Abu Dhabi, AZ, AE, United Arab Emirates

Job Description

Russian hacker, Vladimir Leonidovitch Levin, attempted the biggest bank heist the world had ever seen via dial-up internet in 1994, Zia Hayat, Callsign CEO and founder, was hooked - armchair fraud became a real possibility. From this moment, Zia knew he wanted to play a part in stopping the bad guys and securing the internet for all. Founded In 2012, Callsign's mission has been to make Digital Identity simple and secure for everyone and everything. In that time, we've grown to over 200 employees, opened offices in Singapore and Abu Dhabi, been recognised as a WEF Global Innovator and our technology is being used by many of the world's leading financial institutions to keep millions of consumers safe.


But we aren't stopping here. The identity revolution has only just begun, and we are looking to hire the brightest and inquisitive minds to help us make every web, mobile and physical Interaction seamless and secure. If this sounds like you, lets chat.

Responsibilities:

• Develop and maintain ETL pipelines to extract data from multiple production environments, for ingestion into a data warehouse, and transformation into an analytics layer
• Transform the data using techniques such as cleaning, aggregating, and filtering to prepare it for analysis and reporting.
• Proactively improve processes and documentation around data management, ingestion, versioning, and storage
• Manage internal stakeholders and interface with consumers of the data warehouse, including data science, analytics and governance
• Develop tooling for internal developers who consume the data (data scientists, business analysts, and technical consultants)
• Always keeping security, performance, scalability and cost in mind when designing solutions or working on existing ones
• Develop, maintain and assist with the release of microservices related to data extraction
• Optimize the performance and scalability of ETL pipelines by choosing appropriate tools and technologies, and by tuning and optimizing data models and data flows.

Requirements

• Strong experience with multiple database technologies, including SQL and NoSQL
• Experience developing scalable ETL pipelines that can handle large volumes and throughput of data
• Experience with data warehousing, management and governance
• Experience with distributed computing frameworks (Spark, Hadoop or similar)
• Cloud development (especially the AWS ETL stack: Glue, Athena, S3)
• 5+ years of collaborative development experience with Python, including CI/CD, version control

About you:

• Comfortable working in a fast-paced, multi-tasking, evolving environment
• You strive for technical excellence, collaboration and continuous improvement
• Able to find and analyze trade-offs and pick practical solutions
• Proactive in communicating with stakeholders about requirements and pain-points, and then translating these to concrete improvements.

Desirable Skills and Experience:

• Cloud-native development (kubernetes/helm or similar), familiarity with microservices
• Experience with streaming frameworks (kafka/flink or similar)
• Infrastructure-as-code experience (terraform/CloudFormation/pulumi or similar)
• MLOps experience
• Static-typed compiled languages like java/scala

Benefits

• Health Insurance
• Visa costs including 1 month paid hotel stay
• Annual Airfare Allowance for the home country
• 3 months full pay maternity leaves & 2 weeks full pay paternity leaves
• 25 days of annual leave + Callsign Bank Holiday (not included in holiday allowance)
• Competitive Salary
• Gratuity as EOSB
• If you feel you have the above skills we would love to hear from you!

Beware of fraud agents! do not pay money to get a job

MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1775085
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Contract
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Abu Dhabi, AZ, AE, United Arab Emirates
  • Education
    Not mentioned