ColossalChat

ColossalChat is a free open source alternative to the ChatGPT chatbot launched by Colossal AI, and its GitHub project has won a 26K star rating.
As a leading open-source large-scale artificial intelligence model solution today, Colossal AI is the first company to use the LLaMA pre training model to open source a complete RLHF mechanism, which includes supervised data collection, supervised fine-tuning, reward model training, and reinforcement learning fine-tuning, and shares ColossalChat – an open-source project very similar to the original ChatGPT technology solution.
This open source project includes the following content:
Demo demonstration: An interactive demonstration that can be tried online without registering or joining a waiting list
Training code: Open source complete RLHF training code, including models worth 7 billion and 13 billion.
Dataset: Open source 104K bilingual dataset in Chinese and English.
Inference: Only 4GB of GPU memory is needed to perform 4-bit quantitative inference for a 7 billion parameter model.
Model weight: Fast replication can be achieved on a single server with minimal computational power.