Due to circumstances beyond our control, this session is canceled.


[CANCELLED] [Cancelled] Maze Runner: Navigate Reinforcement Learning w/ Java

Lost and alone, our abandoned Java robot is forced to find its way through a series of rooms that all look the same. How can we help it? What algorithms can we use?


Reinforcement learning can help us, using one easy* algorithm and a lot of repetition. This talk will focus on getting the robot to learn how to find it's way out of any maze, and look at what else we can do with reinforcement learning: the shy, less popular cousin of deep learning.




Katharine Beaumont

Software developer

  Katharine is a software developer who has embarked on postgraduate studies in Machine Learning and AI. Having worked on medical software, Big Data and complex event processing, web development and machine learning, she has given a number of conference talks on her experiences in the...

Read more
Find Katharine Beaumont at:


Windsor, 5th flr.


Leading Edge Backend Languages


Machine LearningAutonomous VehiclesDeep Learning*-lang


From the same track

SESSION + Live Q&A Real Time

C++ for Real Time Communications in the Cloud

Using C++ in real time communication platforms introduces new set of challenges in optimizing for performance. This talk will cover what we have learned over the years from running a complete C++ stack in our backend service - starting from selecting the right data structures from STLs to...

Thiya Ramalingam

Head of Platforms, Product Integrations, Private Cloud and Partnerships @Zoom

SESSION + Live Q&A Rust

Rust 2018: An Epoch Release!

This year is going to see the most important release since Rust 1.0. In this talk, Steve will talk about where Rust is now, what new features are coming down the pipeline, how it's all being managed, and how this affects Rust's development in the future - and why this is all very exciting!

Stephen Klabnik

Rust Core Team

SESSION + Live Q&A Rust

From Rocks to Rust: Our C to Rust Paradigm Shift

A leader in cloud native communications software, Metaswitch has recently chosen Rust as its preferred language. Fine and dandy on the face of it, but what has that actually been like for a developer working ‘on the coal face’? I studied the history of geology prior to working for...

Esther Momcilovic

Software Engineer at Metaswitch Networks

SESSION + Live Q&A OCaml

Fast, Flexible and Functional Programming With OCaml

OCaml is a fast, natively compiled programming language with imperative, object-oriented and functional features. It is over two decades old now, and is often used in niche but safety-critical areas such as formal verification (in Coq, Compcert). In recent years however, it has emerged as a...

Anil Madhavapeddy

University Lecturer @Cambridge_CL (Cambridge Computer Laboratory)

Gemma Gordon

Operations Director at OCaml Labs, University of Cambridge Computer Laboratory

UNCONFERENCE + Live Q&A Open Space

Languages Open Space


Building a Reliable Cloud Based Bank in Java

How does a start-up build a mobile only bank in the cloud that is reliable, scalable, and has a rapidly growing number of features using Java? This talk will focus on the server side implementation of Starling Bank and will show how, even though Java is over two decades old, it can still be used...

Jason Maude

Lead Engineer @StarlingBank

View full Schedule