The Meta leak that changes everything. This is a must read article (no affiliation).
https://www.semianalysis.com/p/google-we-have-no-moat-and-neither
Which one is the open source one? Llama?
Wild that it’s mentioned multiple times in here how the large data sets aren’t really an advantage. Reminds me of Nate Silver’s The Signal and the Noise. Sounds like Google and OpenAI have a lot of noise right now.
Wow this is eye opening I had no idea the open source stuff was so good.
It’s not, this method of analysis is terrible, they’re just asking gpt4 to grade the responses, not actually testing anything beyond that.
That doesn’t necessarily invalidate the point they’re making. Other forms of analysis, strikingly, provide pretty much completely equivalent results.
I’ll need evidence of that.
