And yes, I hate consortia too.
"If we don’t find what’s after the transformer, there may not be enough benefit to AI models."
- How so? Transformers are too expensive?
Honestly I dumped a half baked thought into a footnote. Should’ve trimmed it.
Mostly the point was going to be on how fully open models impact the ecosystem in a very different way than open weights.
Very fair. I forgot the golden rule: "For an essay, read the text and skip the footnotes.
For an academic book, read the footnotes and skip the text.
For a business book, skip both text and footnotes." - Nassim Nicholas Taleb 😂
"If we don’t find what’s after the transformer, there may not be enough benefit to AI models."
- How so? Transformers are too expensive?
Honestly I dumped a half baked thought into a footnote. Should’ve trimmed it.
Mostly the point was going to be on how fully open models impact the ecosystem in a very different way than open weights.
Very fair. I forgot the golden rule: "For an essay, read the text and skip the footnotes.
For an academic book, read the footnotes and skip the text.
For a business book, skip both text and footnotes." - Nassim Nicholas Taleb 😂