Machine Learning in Elixir

Using Transformers with Bumblebee

To really appreciate the power of transformers, you’ll put a few into practice using the Bumblebee library. Bumblebee is a library that contains implementations of popular deep learning architectures in Axon. Bumblebee interacts directly with the HuggingFace hub and is even capable of loading parameters directly from pre-trained PyTorch checkpoints. Bumblebee allows you to rapidly use some of the most powerful open-source models in existence with a few lines of Elixir. To demonstrate the power of transformers and the simplicity of Bumblebee, you’ll use Bumblebee to solve three different kinds of problems.

Installing Dependencies

To get started, fire up a Livebook and add the following dependencies:

Mix.install([ ...