Welcome to the 🧲 docs

DIV

Packages & useful classes

DIV

magnet

don’t forget to check out the helpful 💻 examples

the small distributed language model toolkit

NET

⚡️ fine-tune state-of-the-art LLMs anywhere, rapidly ⚡️

🧬 Installation

DIV

pip install llm-magnet

or

python3 setup.py install

🔮 features

DIV

  • ⚡️ It’s Fast

    • fast on consumer hardware

    • very fast on Apple Silicon

    • extremely fast on ROCm/CUDA

  • 🫵 Automatic or your way

    • rely on established transformer patterns to let magnet do the work

    • keep your existing data processing functions, bring them to magnet!

  • 🛰️ 100% Distributed

    • processing, embedding, storage, retrieval, querying, or inference from anywhere

    • as much or as little compute as you need

  • 🧮 Choose Inference Method

    • HuggingFace

    • vLLM node

    • GPU

    • mlx

  • 🌎 Huge Volumes

    • handle gigantic amounts of data inexpensively

    • fault-tolerant by design

    • decentralized workloads

  • 🔐 Secure

    • JWT

    • Basic

  • 🪵 World-Class Comprehension

    • magnet optionally logs its own code as it’s executed (yes, really)

    • build a self-aware system and allow it to learn from itself

    • emojis are the future

learn more about how Prismadic uses 🧲

subscribe to our substack

A1 A2

Indices and tables

DIV