AI Startups Collaborate on Distributed Language Model Development

According to Foresight News, AI startups Flower AI and Vana have jointly launched a distributed large language model named Collective-1. This model operates on GPUs across multiple global locations, bypassing traditional data center dependencies, and incorporates private user data from platforms like X, Reddit, and Telegram. Currently, Collective-1 has 7 billion parameters, which is significantly smaller than leading models like ChatGPT and Claude. However, Flower AI is preparing to train a model with 30 billion parameters and plans to release a version with nearly 100 billion parameters within the year. Flower AI has also collaborated with universities in China and the UK to develop the Photon tool, aimed at enhancing the efficiency of distributed training. This approach is expected to empower small and medium-sized enterprises and resource-limited countries to participate in foundational model development. Vana provides users with data authorization tools, allowing them to independently decide on data usage and benefit from associated rights. Experts believe this model could drive the AI industry towards a more open and decentralized direction.