A small model at the beginning of big changes.
Finally code + data + weight.
Although to access dolma, one needs form agreement. Nice one!
Super excited for this! I love how OLMo and AI2 are a showcase of open source, open models, and transparency!
Thanks! Of course we are too :). It's just getting started
What's the open model released by together? Presumably it's trained on RedPajamas?
I think so. I actually hadn’t found it when I looked, but I tend to trust Stella. I think something like this. https://huggingface.co/togethercomputer/RedPajama-INCITE-Base-3B-v1
Congrats!!
Finally code + data + weight.
Although to access dolma, one needs form agreement. Nice one!
Super excited for this! I love how OLMo and AI2 are a showcase of open source, open models, and transparency!
Thanks! Of course we are too :). It's just getting started
What's the open model released by together? Presumably it's trained on RedPajamas?
I think so. I actually hadn’t found it when I looked, but I tend to trust Stella. I think something like this. https://huggingface.co/togethercomputer/RedPajama-INCITE-Base-3B-v1
Congrats!!