SESSION + Live Q&A
Streaming Reactive Systems & Data Pipes w. squbs
Reactive libraries are nothing new to the JVM. Reactive Streams as an SPI has even made its way into Java 9. However, their uses within microservice components are still for relatively narrow purposes like service orchestration. But we think differently. Our whole presence and universe can be thought of as streams of events and activities. And that's the core concept of a new kind of system we design/built - streams end-to-end.
This talk will focus on modeling and building software that considers all input and all output as stream of events backed by Akka Streams. We will also go over a set of high level use cases and patterns we successfully used in production for this streaming model. For the curious minds, we’ll deep dive into our experiences building low-level stream resiliency components, and especially modeling and managing the back-pressure aspects of such components in the Akka Streams ecosystem.
Speaker
Akara Sucharitakul
Principal MTS, Architect @PayPal
Akara Sucharitakul founded project squbs (pronounced s-cubes) for Internet scale Akka productionalization. He works in the PayPal infrastructure team, on both squbs and messaging. Akara is a 20 year veteran of the JVM from its very early days and of a veteran of Sun for 15 years. He left his...
Read moreFind Akara Sucharitakul at:
Speaker
Anil Gursel
Software Engineer @PayPal
Anil Gursel has been working on the JVM since 2004. His current focus is to implement reactive applications using Scala and Akka. He is a Software Engineer at PayPal’s Infrastructure team where he helps teams build highly scalable, low latency applications. Anil is a big advocate for Scala and...
Read moreFind Anil Gursel at:
Location
Whittle, 3rd flr.
Track
Stream Processing in the Modern Age
Topics
Stream ProcessingScalePerformanceResilient SystemsPayPalSilicon ValleyJava 11AkkaActor ModelShare
From the same track
Next Steps in Stateful Streaming with Apache Flink
Come learn how Apache Flink is making stateful stream processing even more expressive and flexible to support applications in streaming that were previously not considered streamable. Over the last years, data stream processing has redefined how many of us build data pipelines. Apache Flink is...
Stephan Ewen
Committer @ApacheFlink, CTO @dataArtisans
Drivetribe: A Social Network on Streams
Drivetribe is the world's biggest motoring destination, as envisioned by Jeremy Clarkson, Richard Hammond, and James May. Built on top of the Event Sourcing/CQRS pattern, the Drivetribe platform uses Apache Kafka as its source of truth and Apache Flink as its processing backbone. This talk aims...
Aris Koliopoulos
CTO @Drivetribe
Hamish Dickson
Backend engineer @Drivetribe
Lessons From a ~Yearly Re-Write of a Data Pipeline
Every year, we’ve set ourselves a goal of dramatically improving the performance and efficiency of our core data pipelines. We’ve done this by re-writing, effectively from scratch, the streaming pipelines that are responsible for processing over 120,000 events per second to deliver realtime...
Jibran Saithi
Lead Architect @Qubit
Streaming SQL Foundations: Why I ❤ Streams+Tables
What does it mean to execute robust streaming queries in SQL? What is the relationship of streaming queries to classic relational queries? Are streams and tables the same thing conceptually, or different? And how does all of this relate to the programmatic frameworks like we’re all familiar...
Tyler Akidau
Engineer @Google & Founder/Committer on Apache Beam