Ctrlk
For the complete documentation index, see llms.txt. This page is also available as Markdown.

Quick Start Guide

Welcome to the Cortensor Quick Start Guide! As we move forward with the development of our platform, here are some essential notes to help you get started:

Operating System Requirements

  • Cross-Platform Support: Cortensor is now fully supported on Linux, Windows, and macOS.

  • Python and Docker: You'll need Python and Docker installed on your system to run Cortensor. These tools are essential for managing dependencies and containerizing the Cortensor environment.

Model Support

  • Quantized & Non-Quantized Models: Cortensor now supports both quantized and non-quantized models, ensuring broader compatibility across various hardware configurations.

  • Expanding Model Support: We will continue expanding support for additional model types as development progresses.

Hardware Requirements

  • CPU/GPU Compatibility: Cortensor now supports both CPUs and GPUs across all platforms (Linux, Windows, and macOS).

  • Broader CPU Support: Unlike earlier versions, AVX instruction sets (AVX, AVX2, AVX512) are no longer required. Lower-end CPUs without AVX instructions are now supported.

  • Quantization Levels: Initial inference will support 4-bit quantization, ensuring efficient processing on a variety of CPUs. Additional quantization options and non-quantized models will be introduced over time.

These are just the first steps—stay tuned for detailed setup instructions and updates as we continue improving the platform!

Disclaimer: This page and the associated documents are currently a work in progress. The information provided may not be up to date and is subject to change at any time.

PreviousGetting StartedNextSystem Requirements

Last updated