Welcome to the 🧲 docs

Packages & useful classes

• magnet.ic package
  • Submodules
  • magnet.ic.field module
• magnet.ize package
  • Submodules
  • magnet.ize.filings module
  • magnet.ize.memory module
• magnet.ron package
  • Submodules
  • magnet.ron.llm module
    • LLM
• magnet.utils package
  • Subpackages
    • magnet.utils.mlx package
  • Submodules
  • magnet.utils.data_classes module
    • AcquireParams
    • AskParameters
    • EmbeddingPayload
    • FilePayload
    • GeneratedPayload
    • IndexConfig
    • InferenceParams
    • Job
    • JobParams
    • MagnetConfig
    • MistralArgs
    • Payload
    • ProcessParams
    • Run
    • Status
    • TrainParams
  • magnet.utils.globals module
    • Utils
    • break_into_chunks()
    • reversal()
  • magnet.utils.huggingface module
  • magnet.utils.local module
  • magnet.utils.markdown module
  • magnet.utils.milvus module
  • magnet.utils.prompts module

magnet

don’t forget to check out the helpful 💻 examples

the small distributed language model toolkit

⚡️ fine-tune state-of-the-art LLMs anywhere, rapidly ⚡️

🧬 Installation

pip install llm-magnet

or

python3 setup.py install

🔮 features

• ⚡️ It’s Fast

  • fast on consumer hardware

  • very fast on Apple Silicon

  • extremely fast on ROCm/CUDA

• 🫵 Automatic or your way

  • rely on established transformer patterns to let magnet do the work

  • keep your existing data processing functions, bring them to magnet!

• 🛰️ 100% Distributed

  • processing, embedding, storage, retrieval, querying, or inference from anywhere

  • as much or as little compute as you need

• 🧮 Choose Inference Method

  • HuggingFace

  • vLLM node

  • GPU

  • mlx

• 🌎 Huge Volumes

  • handle gigantic amounts of data inexpensively

  • fault-tolerant by design

  • decentralized workloads

• 🔐 Secure

  • JWT

  • Basic

• 🪵 World-Class Comprehension

  • magnet optionally logs its own code as it’s executed (yes, really)

  • build a self-aware system and allow it to learn from itself

  • emojis are the future

learn more about how Prismadic uses 🧲

subscribe to our substack

Indices and tables

• Index

• Module Index

• Search Page