The Sparking Solution That Scales to IoT
This video is available in the GOTO Play video app! Download it to enjoy offline access to our conference videos while on the move.
This talk will then be code and demonstration focused with a demonstration of spinning up an entire infrastructure on Apache Mesos. Several code examples will show off Spark coding techniques with AKKA, Spark streaming and SparkSQL.
The world of is seeing a growing intersection between large scale big data analytics and the Internet of Things (IoT) resulting in:
- Architecture such as the Lamdba architecture,
- The need to dynamical scale with infrastructure such as Apache Mesos and
- The need for stream processing.
At the center of solving this challenge is Spark and Scala. We will start out with a walk through of the Lamdba architecture and each of it's components (including AKKA, Kafka, Spark Stream and Cassandra). Attendees will leave with a full understanding of to scale Scala to the IoTs.