AI TRENDS | Non-Profit Releases Talkie-1930 Model with Historical Text Training

A non-profit organization has unveiled Talkie-1930, a 13 billion parameter open-weight model trained on 260 billion tokens of text published before January 1, 1931. According to NS3.AI, the team has released both base and instruction-tuned checkpoints under the Apache 2.0 license. The initiative aims to develop a GPT-3-level vintage model by the summer of 2026.