Quick Start Guide
Welcome to the Cortensor Quick Start Guide! As we move forward with the development of our platform, here are some essential notes to help you get started:
Operating System Requirements
Cross-Platform Support: Cortensor is now fully supported on Linux, Windows, and macOS.
Python and Docker: You'll need Python and Docker installed on your system to run Cortensor. These tools are essential for managing dependencies and containerizing the Cortensor environment.
Model Support
Quantized & Non-Quantized Models: Cortensor now supports both quantized and non-quantized models, ensuring broader compatibility across various hardware configurations.
Expanding Model Support: We will continue expanding support for additional model types as development progresses.
Hardware Requirements
CPU/GPU Compatibility: Cortensor now supports both CPUs and GPUs across all platforms (Linux, Windows, and macOS).
Broader CPU Support: Unlike earlier versions, AVX instruction sets (AVX, AVX2, AVX512) are no longer required. Lower-end CPUs without AVX instructions are now supported.
Quantization Levels: Initial inference will support 4-bit quantization, ensuring efficient processing on a variety of CPUs. Additional quantization options and non-quantized models will be introduced over time.
These are just the first steps—stay tuned for detailed setup instructions and updates as we continue improving the platform!
Disclaimer: This page and the associated documents are currently a work in progress. The information provided may not be up to date and is subject to change at any time.
Last updated