Getting Started

As we prepare for the launch of our closed alpha testing, here are some essential notes to help you get started:

System Requirements:

• Operating Systems:

  • Linux: Currently supported. We plan to expand support to Windows and macOS after the closed alpha testing phase.

• Software Dependencies:

  • Python and Docker: Required for running Cortensor, managing dependencies, and ensuring consistent performance.

• Hardware Requirements:

  • CPUs: Must support AVX, AVX2, or AVX512 (for x86 architectures).

  • Models: Initially, only 4-bit quantized models will be supported, enabling broad hardware compatibility. Over time, we'll introduce higher bit options and support non-quantized models.

Model Support:

• LLaMA Models: Cortensor will initially support LLaMA models, with plans to gradually include additional open-source models as the platform evolves.

Alpha Phase Overview:

• Quantized Models: Focus on quantized models to ensure wide device compatibility during the alpha phase.

• Development: The alpha phase will focus on testing and refining the platform. Your participation is key to shaping Cortensor’s future.

Next Steps:

• Detailed installation and setup instructions will be provided as we progress. Prepare your environment according to the requirements above and stay tuned for updates.

---

Disclaimer: This page and the associated documents are currently a work in progress. The information provided may not be up to date and is subject to change at any time.