Kafka, DevOps ...And Resilience for All
You need to be signed in to add a collection
So you’ve made the enlightened choice to use Kafka in your architecture, and you know you need to provision your cluster using infrastructure as code (IAC), but why stop at just provisioning brokers? In this talk we will explore the available options to make deploying your Kafka-based applications more repeatable, resilient and observable. We’ll look at specific examples and techniques for applying IAC to the following areas : * Topic and partition creation * Secrets management * Configuration options I’ll also share some lessons I’ve learned related to tooling, monitoring and backup management. And finally we’ll look at some resilience do’s and don’ts with some specific examples of where these tools have helped, and where their absence has hindered. **Attendees:** <a href="https://gotopiachicago2021.slack.com/archives/C01U6LMG9K8" target="_blank">Join the #devops channel on Slack to send your questions to James</a>
Transcript
So you’ve made the enlightened choice to use Kafka in your architecture, and you know you need to provision your cluster using infrastructure as code (IAC), but why stop at just provisioning brokers?
In this talk we will explore the available options to make deploying your Kafka-based applications more repeatable, resilient and observable. We’ll look at specific examples and techniques for applying IAC to the following areas :
- Topic and partition creation
- Secrets management
- Configuration options
I’ll also share some lessons I’ve learned related to tooling, monitoring and backup management. And finally we’ll look at some resilience do’s and don’ts with some specific examples of where these tools have helped, and where their absence has hindered.
Attendees: Join the #devops channel on Slack to send your questions to James
About the speakers
Technical Delivery Director at OpenCredo