Adventures in High Performance Logging

TALK LEVEL: BEGINNER / INTERMEDIATE / ADVANCED

What do you do when you need to write to a log in your Elixir app?

Use Logger, of course!

But what happens when you reach its limits?

This talk uses a real-world example to explore what happens when your system scales past the tools that come with the BEAM. We'll build our way from Logger, to disk_log, to a custom GenStage pipeline, all the while striving for the highest performance solution.

THIS TALK IN THREE WORDS

Massive

Log

Throughput

OBJECTIVES

  • Educate the audience about one of the core internal Elixir tools: Logger
  • Provide a case study of what happens when you rapidly outgrow the tooling in the BEAM
  • Introduce some new libraries that provide an abstraction over high throughput logging

TARGET AUDIENCE

From beginners through to experienced Alchemists, the talk builds up from simple example so no-one should get lost.