Free

Kafka community meetup #2

Event Information

Share this event

Date and Time

Location

Location

HubHub Twin City C

16 Mlynské nivy

821 09 Staré Mesto

Slovakia

View Map

Event description

Description

We are thrilled to invite you to 2nd Kafka community meetup Bratislava.

1st presentation of the evening will be: Data Streaming - There and Back Again
Speakers: Daniel Buchta, Patrik Beka, Peter Vašek
Presentation language: Slovak/ English

Intro: Fresh look at technology stack within Kafka – Kafka connect, Kafka streams, KSQL, covering also NiFi as a distributed file transfer engine.

Demo: How to build a simple data processing pipeline (using Kafka/NiFi/Kafka Connect/KSQL) that will: split your files to records using NiFi custom Kafka processor change data format from json to avro using KSQL inject metadata and transform messages of the final stream using Kafka SMT before writing them to parallel into SQL database using Kafka JDBC Sink Connect and into HBase using Kafka HBase Sink Connect or into HDFS using Kafka HDFS Sink Connect.

Outro: Next Best Action and CDR tool as examples of projects where this pattern fits.

2nd presentation of the evening will be:The Internals of Apache Kafka -- The Role of Brokers, Kafka Controller and Zookeeper
Speaker: Jacek Laskowski

Managing consistent state in a distributed system is certainly not easy and I was not surprised to learn a bit about the "Kafka way" (of how brokers do it in a cluster). This talk is about the internals of KafkaController and how much Apache Kafka relies on Zookeeper (that may help understand the pros and cons of KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum https://cwiki.apache.org/confluence/display/KAFKA/KIP-500%3A+Replace+ZooKeeper+with+a+Self-Managed+Metadata+Quorum). During this talk, you will learn the role of brokers, Kafka controller and Zookeeper and their interactions. We start gently with the Kafka architecture to lay the ground for the internals. No experience with Kafka is expected.

Space is limited, registration is required.

Share with friends

Date and Time

Location

HubHub Twin City C

16 Mlynské nivy

821 09 Staré Mesto

Slovakia

View Map

Save This Event

Event Saved