SESSION + Live Q&A

Lambda Architectures: a Snapshot, a Stream, & a Bunch of Deltas

We all got so excited about breaking apart our monoliths and liberating our microservices. At HBC Tech, our work on luxury e-commerce experiences across gilt.com, saks.com, lordandtaylor.com, thebay.com and saksoff5th.com shows us that unconstrained, organic growth of microservice architectures can lead to a system with high numbers of inter-service dependencies (some of them hidden!), and deep call stacks. We asked ourselves the question: “how can we architect, build and run our services resiliently and at scale so that they can respond to requests without any immediate downstream dependencies?” Our approach is to leverage event-sourced architectures that allow core services to reliably share their information with other services asynchronously. At the heart of each solution is the snapshot, the stream, and a bunch of deltas. 
In this talk I’ll give examples of these architectures in practice in our product, pricing, inventory and search services, the technology choices that have stuck: AWS Kinesis, AWS S3, AWS Lambda, Elasticache, and  Calatrava. I’ll discuss how we’re making our way towards adopting Kafka as our backbone streaming implementation. And, I’ll show how we’ve begun to apply the techniques not just internally but also with external third-party vendors to keep our runtime dependencies low. 

Speaker

Adrian Trenaman

SVP Engineering @HBC, Gilt & Committer Apache Karaf

As SVP Engineering, HBC Digital, Ade leads the engineering and infrastructure teams for Gilt in New York and Dublin. He is an experienced, outspoken software engineer, communicator and leader with over 20 years of experience working with teams throughout Europe, US and Asia in diverse industries...

Read more

Speaker

Adrian Trenaman
Adrian Trenaman

SVP Engineering @HBC, Gilt & Committer Apache Karaf

Location

Fleming, 3rd flr.

Track

Architectures You've Always Wondered About

Topics

ArchitectureDistributed SystemsEvent Driven Architectureevent sourcingasynchronousLambda Architecture

Share

Share Share

From the same track

SESSION + Live Q&A Architecture

Microservices: API Re-platforming @Expedia

Expedia Affiliate Network is one of the business unit's that make up Expedia. Their APIs power the global travel industry and generate more than $5 billion a year in sales. They are currently in the process of rolling out a completely new API moving from an on-prem monolith to a cloud-based...

Mariano Albera

VP/CTO, Expedia Affiliate Network

SESSION + Live Q&A Cloud Computing

Logistics as a Service: Building the Ocado Smart Platform

Selling groceries online at a profit is considered by many to be the Holy Grail of retail. The Ocado Smart Platform is the result of 15 years of learning through the application of technology to this domain, from control protocols for an army of 1000 warehouse robots, through optimising...

Paul Sweetman

Head of Software Architecture @Ocado

Alex Harvey

Head of Robotics and Autonomous Systems @Ocado

SESSION + Live Q&A Event Driven Architecture

Actors or Not: Async Event Architectures

With more and more companies adopting microservices and service-oriented architectures, it becomes clear that the HTTP/RPC synchronous communication (while great) is not always the best option for every use case. In this presentation, I discuss two approaches to an asynchronous event-based...

Yaroslav Tkachenko

Sr Software Engineer @Demonware building Activision's Call of Duty

SESSION + Live Q&A Autonomous Vehicles

Inside a Self-Driving Uber

Over the course of three years, Uber’s self-driving vehicles have driven over 2 million miles and have completed over 50,000 passenger trips in Pittsburgh and Phoenix. Many of you might be curious as to how we built a fleet of self-driving vehicles capable of driving autonomously in varying...

Matt Ranney

Sr. Staff Engineer @UberATG

UNCONFERENCE + Live Q&A

Architectures Open Space

View full Schedule