Data Management

Cortensor employs a sophisticated multi-layered blockchain architecture to efficiently manage coordination, quality assurance, and user services. This approach ensures robust, scalable operations while maintaining data integrity and optimizing costs.

Multi-Layer Blockchain Structure

1. Registration and Onboarding Layer

   • Technology: Ethereum or Layer 2 solutions (Arbitrum, Base, Optimism)

   • Purpose: Handles the secure registration and onboarding of miners and users

   • Benefits: Ensures a trustworthy foundation for network participation

2. Health and Capability Verification Layer

   • Technology: Layer 2 chains

   • Purpose: Monitors miner health and capabilities through Proof of Inference (PoI) and Proof of Useful Work (PoUW) mechanisms

   • Key Features:

     • Real-time performance monitoring

     • Dynamic capability assessment

     • Ensures miners meet and maintain required standards

3. User Interaction and Service Layer

   • Technology: Layer 2 or Layer 3 chains

   • Purpose: Facilitates dApp interactions and access to Cortensor's inference and oracle services

   • Current Offering: API layer for inference services

   • Future Plans: Advanced SDKs and libraries for specialized tasks (e.g., classification, data generation)

Data Storage and Communication Strategy

Off-Chain Data Management

• Technology: IPFS (InterPlanetary File System)

• Purpose: Decentralized storage of prompts, requests, completions, and results

• Benefits:

  • Cost-effective storage solution

  • Maintains data integrity and accessibility

  • Reduces blockchain bloat

Router Node Communication

• Capabilities:

  • Handles Web2 traffic seamlessly

  • Interfaces with Layer 2 and Layer 3 blockchain layers

• Function: Ensures secure, efficient data transmission between users and the network

Data Encryption

• Purpose: Protects user data privacy by encrypting communications between node types

• Flexibility: Encryption can be tailored based on user preferences to balance security and performance

User Data Integration

• Current Feature: On-demand data persistence to external databases

• Future Development:

  • Integration of user databases, documents, vectors, and embeddings into inference requests

  • Enhanced support for smarter application integration

Key Components and Future Roadmap

Blockchain Layer Utilization

• Ethereum/Layer 2 for Onboarding

  • Secure, transparent registration process

  • Foundation for trust in the network

• Layer 2 for Health Checks

  • Continuous monitoring and assessment of miner capabilities

  • Ensures network reliability and performance standards

• Layer 2/Layer 3 for Services

  • Scalable infrastructure for dApps and user services

  • Facilitates efficient access to inference and oracle functionalities

Off-Chain Storage Innovation

• IPFS Integration:

  • Decentralized, resilient data storage

  • Cost-effective solution for handling large volumes of inference data

  • Data Integrity: Ensures immutability and accessibility of stored information

Future Enhancements

• Advanced Data Integration:

  • Support for client-side data hosting

  • Seamless integration of user databases and data sources into Cortensor's inference services

• Enhanced SDK Development:

  • Specialized tools for complex AI tasks

  • Simplified integration process for developers