So... What does this actually test? The ability of various models to answer the question 'what is the best x'? What is the purpose and the value of this data?
Fair question. It tests one narrow thing: when one AI search tool answers a "best X 2026" buying question, which web pages does it cite as its sources? It doesn't grade whether the answer is any good, and it doesn't compare models. It's one engine, with each query run once.
The point is that these answers increasingly sit in front of the click, so the pages they cite are the ones that get the traffic and the credibility. In this small sample, brands' own sites were never cited on the consumer queries (0 of 60), while publishers like Forbes and NYT were. On the B2B and SaaS queries, half the citations (60 of 120) were vendor pages. If you write, research, or market in those categories, that shows which kinds of pages one answer engine leans on.
It's 48 queries, so treat it as a snapshot rather than a finding. The CSVs are there for anyone who wants to check or extend it.
Technology
This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed