Building a Database from Scratch

Benoit Chesneau
web and database craftsman

Last year I presented a preliminary version of Barrel, 7 months later the first stable version was available for all. Barrel is a modern document-oriented database with master-master replication targeting micro-services with a RESTful API written in Erlang. 

This talk will describe the different challenges we faced in writing a database, from binding C code in Erlang, to write a complete document storage engine with its SQL Engine. This talk will also describe the different patterns used for Reads and Writes concurrency but also continuous automated indexation of the documents.

Talk objectives:

  • This talk will show how we built a database in Erlang. People will also see how to write a parser in Erlang, bind C code and discover different concurrency patterns we needed to achieve a lot of concurrent Reads and Writes.

Target audience:

  • Anyone interested in databases

Benoît Chesneau is a internet craftsman, living near Paris. He has years of experience in building small and big-scale database backend websites. He is the founder of a company building innovative web services and open-source applications. Benoît Chesneau is also the founder of the Barrel projects, the author of Gunicorn and multiple other opensource projects in Python and Erlang.

GitHub: benoitc

Twitter: @benoitc

Back to conference page