-1
Local coding LLMs without copyleft?
(programming.dev)
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Follow the wormhole through a path of communities !webdev@programming.dev
Olmo might be the closest you can get
https://allenai.org/olmo (website straight up crashes my phone)
https://huggingface.co/allenai/OLMo-7B
Olmo is trained on the Dolma dataset, “a diverse mixture of web content, scientific papers, code, public-domain books, social media, and encyclopedic materials”, so this might be a more ethical source, but I’m not sure if it’s copyleft free.
https://huggingface.co/papers/2402.00159
You could rent a cluster of GPUs and remove copyleft material and retrain
Dolma uses starcoder https://huggingface.co/blog/starcoder, which
so this might do. Thanks.
Only correct answer so far. Here's the licenses included in the dataset.