The Sparking Solution That Scales to IoT

Updated on May 10, 2016
Ken Sipe
Ken Sipe

Cloud Solution Architect at Mesosphere

This talk will then be code and demonstration focused with a demonstration of spinning up an entire infrastructure on Apache Mesos. Several code examples will show off Spark coding techniques with AKKA, Spark streaming and SparkSQL.

 

The world of is seeing a growing intersection between large scale big data analytics and the Internet of Things (IoT) resulting in:

  1. Architecture such as the Lamdba architecture,
  2. The need to dynamical scale with infrastructure such as Apache Mesos and
  3. The need for stream processing.

At the center of solving this challenge is Spark and Scala. We will start out with a walk through of the Lamdba architecture and each of it's components (including AKKA, Kafka, Spark Stream and Cassandra). Attendees will leave with a full understanding of to scale Scala to the IoTs.

Related

CONTENT

Minimum Viable Migrations (MVMs): A Path to Cloud Native EDAs
Minimum Viable Migrations (MVMs): A Path to Cloud Native EDAs
GOTO EDA Day 2022
Visualizing Cloud Systems
Visualizing Cloud Systems
GOTO Chicago 2020
"Good Enough" Architecture [VIRTUAL]
"Good Enough" Architecture [VIRTUAL]
GOTO Oslo 2020