Installation

Requirements

• Python 3.8 or higher
• PyTorch 2.0 or higher
• CUDA-capable GPU (optional but recommended)

Basic Installation

Install LEGIONHETO from PyPI:

pip install legionheto

With Optional Dependencies

Flash Attention 2

For faster training with Flash Attention:

pip install legionheto[flash-attn]

Note: Flash Attention requires CUDA 11.6 or higher.

Development Tools

For development and testing:

pip install legionheto[dev]

Documentation Tools

To build documentation locally:

pip install legionheto[docs]

Verify Installation

import legionheto
print(legionheto.__version__)

GPU Support

LEGIONHETO automatically detects CUDA availability. For optimal performance:

• NVIDIA GPU with 8GB+ VRAM for 7B models
• NVIDIA GPU with 16GB+ VRAM for 13B models
• NVIDIA GPU with 24GB+ VRAM for 30B+ models

CPU-only training is supported but significantly slower.