Streaming with Structure
You need to be signed in to add a collection
Using a publish-subscribe messaging system like Apache Kafka is a great way to minimise coupling between your applications. The stream history that Kafka provides allow consumers to come and go, without the producers ever being aware. This works fine until an application changes the shape of the events it is producing — how do consumers understand and handle the change? This is where schemas and a schema registry comes in. This session will introduce the common schema formats that are used in the Kafka community and some schema registries that support these. It will also cover how to use schemas in different types of Kafka applications. Learn how to effectively manage and evolve the structure of your events. **In this talk, you'll learn:** * Some of the best schema formats when using Kafka * How to effectively manage and structure your events
Transcript
Using a publish-subscribe messaging system like Apache Kafka is a great way to minimise coupling between your applications.
The stream history that Kafka provides allow consumers to come and go, without the producers ever being aware. This works fine until an application changes the shape of the events it is producing — how do consumers understand and handle the change? This is where schemas and a schema registry comes in.
This session will introduce the common schema formats that are used in the Kafka community and some schema registries that support these. It will also cover how to use schemas in different types of Kafka applications. Learn how to effectively manage and evolve the structure of your events.
In this talk, you'll learn:
- Some of the best schema formats when using Kafka
- How to effectively manage and structure your events
About the speakers
Software engineer at IBM Event Streams