Home Conference Sessions Introduction to ...

Introduction to Stateful Stream Processing with Apache Flink

Robert Metzger | GOTO Amsterdam 2019

You need to be signed in to add a collection

Stream Processing has evolved quickly in a short time: only a few years ago, stream processing was mostly simple real-time aggregations with limited throughput and consistency. Today, many stream processing applications have sophisticated business logic, strict correctness guarantees, high performance, low latency, and maintain terabytes of state without databases. Stream processing frameworks also abstract a lot of the low-level details away, such as routing the data streams, taking care of concurrent executions, and handling various failure scenarios while ensuring correctness. This talk will give an introduction into Apache Flink, one of the most advanced open source stream processors that powers applications in Netflix, Uber, and Alibaba among others. In particular, we will go through the use cases that Flink was designed for, explain concepts like stateful and event-time stream processing, and discuss Flink's APIs and ecosystem. **What will the audience learn from this talk?**<br> * A brief introduction to stateful stream processing, including concepts of state and event time * Presentation of use cases for stateful stream processing * Introduction to Apache Flink, its users, API, and eco-system **Does it feature code examples and/or live coding?**<br> No live coding **Prerequisite attendee experience level:** <br> [Level 100](https://gotoams.nl/2019/pages/experience-level)

Share on:
linkedin facebook
Copied!

Transcript

Stream Processing has evolved quickly in a short time: only a few years ago, stream processing was mostly simple real-time aggregations with limited throughput and consistency. Today, many stream processing applications have sophisticated business logic, strict correctness guarantees, high performance, low latency, and maintain terabytes of state without databases. Stream processing frameworks also abstract a lot of the low-level details away, such as routing the data streams, taking care of concurrent executions, and handling various failure scenarios while ensuring correctness.

This talk will give an introduction into Apache Flink, one of the most advanced open source stream processors that powers applications in Netflix, Uber, and Alibaba among others. In particular, we will go through the use cases that Flink was designed for, explain concepts like stateful and event-time stream processing, and discuss Flink's APIs and ecosystem.

What will the audience learn from this talk?

  • A brief introduction to stateful stream processing, including concepts of state and event time
  • Presentation of use cases for stateful stream processing
  • Introduction to Apache Flink, its users, API, and eco-system

Does it feature code examples and/or live coding?
No live coding

Prerequisite attendee experience level:
Level 100

About the speakers

Robert Metzger

Robert Metzger

PMC member of the Apache Flink project; Co-founder, Engineering Lead Ververica

Related topics