• Menu
  • Skip to right header navigation
  • Skip to main content
  • Skip to primary sidebar

DigiBanker

Bringing you cutting-edge new technologies and disruptive financial innovations.

  • Home
  • Pricing
  • Features
    • Overview Of Features
    • Search
    • Favorites
  • Share!
  • Log In
  • Home
  • Pricing
  • Features
    • Overview Of Features
    • Search
    • Favorites
  • Share!
  • Log In

Non-profit EleutherAI releases massive AI training dataset of licensed and open domain text created in consultation with legal experts and claims performing on par with models developed using unlicensed, copyrighted data

June 10, 2025 //  by Finnovate

EleutherAI, an AI research organization, has released what it claims is one of the largest collections of licensed and open-domain text for training AI models called the Common Pile v0.1. Weighing in at 8 terabytes in size, the Common Pile v0.1 was used to train two new AI models from EleutherAI, Comma v0.1-1T and Comma v0.1-2T, that EleutherAI claims perform on par with models developed using unlicensed, copyrighted data. The Common Pile v0.1, which can be downloaded from Hugging Face’s AI dev platform and GitHub, was created in consultation with legal experts, and it draws on sources, including 300,000 public domain books digitized by the Library of Congress and the Internet Archive. EleutherAI also used Whisper, OpenAI’s open source speech-to-text model, to transcribe audio content. EleutherAI claims Comma v0.1-1T and Comma v0.1-2T are evidence that the Common Pile v0.1 was curated carefully enough Non-profit alternatives. According to EleutherAI, the models, both of which are 7 billion parameters in size and were trained on only a fraction of the Common Pile v0.1, rival models like Meta’s first Llama AI model on benchmarks for coding, image understanding, and math.

Read Article

Category: AI & Machine Economy, Innovation Topics

Previous Post: « Amperity vibe coding AI agent connects directly to the customer’s Databricks environment via native compute and LLM endpoints to quickly execute complex tasks such as identity resolution
Next Post: allpay becomes the first signatory of Enfuce’s Fortitude Pledge, a compliance and security standard designed to eliminate 100% of financial crime risks across all card transactions »

Copyright © 2025 Finnovate Research · All Rights Reserved · Privacy Policy
Finnovate Research · Knyvett House · Watermans Business Park · The Causeway Staines · TW18 3BA · United Kingdom · About · Contact Us · Tel: +44-20-3070-0188

We use cookies to provide the best website experience for you. If you continue to use this site we will assume that you are happy with it.