Good experience in Kafka.js/Spark/structure streaming.
Good experience in KSQL to create streams, query, join streams.
Good Understanding of Schema Registry.
Good experience in real-time data processing and micro batch processing.
Good experience in Scala to write streaming jobs
Good experience in creating different-different source and sink connectors.
Good understanding of Confluent Kafka components.
Looking for an individual with a minimum of 1 to 2 years of experience in KAFKA streaming.
Essential qualifications include expertise in data streaming, familiarity with Azure Cloud, and a track record of at least a year-long project involving data streaming.
Candidates should be capable of articulating their understanding of KAFKA components, Schema Registry, Connectors, Spark, and possess knowledge of programming languages such as Scala or others, with a focus on workable proficiency in Databricks.
A total of 4 to 6 years of overall experience, with at least 1 to 2 years specifically in Kafka Streaming, is required for this long-term banking project.
Able to troubleshoot and debug application issues
Able to write producer and consumer applications to meet business requirements.
Good to have knowledge of Hadoop, HBase and Hive or cloud