Linking an HN comment raising similar concerns with additional examples:
https://news.ycombinator.com/item?id=44520841

Ah thanks for that. I was too tired last night to be more comprehensive, but I can confirm that I saw a similar extent of issues as in that comment.

This "did you know" panel is straight up wrong, as per Agarwal's LinkedIn

Just doing quick search
https://news.instant-gaming.com/en/articles/13642-a-former-naughty-dog-game-director-will-open-his-own-studio

In general, in Kite all sections are sourced from material provided. Not sure which one is true here, but there is evidence on the web confirming this date.

Nobody said the date was wrong. "straight out of Carnegie Mellon University's Entertainment Technology Center" is wrong. He didn't even go to Carnegie Mellon, and he didn't join Naughty Dog straight out of college. What was the source for this claim?

I see this critically as well. I really like the idea behind Kite, but it still needs quite a bit of work and a clear content curation process, either by Kagi itself or the community.

It should also be clearly communicated below each story or at the top of the page that these are AI-generated summaries, which may contain errors or hallucinations.

We've rolled out improvements to reduce hallucinations. Please continue reporting any instances of made-up information in summaries, either here or on Discord if you see them :)

Thanks Giorgio, I'm glad you're working on this. Since it's an extremely difficult problem that has not been solved by anyone on the planet yet, I would recommend adding a disclaimer to the intro page that appears when you first open Kite. Right now there is no indication that LLMs or AI of any kind is used, or that the reader needs to fact check what they see. That's probably obvious to those of us that work in this area but I don't think it will be obvious to everyone.

I've just opened Kite to check out the improvements. Here are all the hallucinations I see in the first item ("Trump sets EU-funded Patriot missile sale to Ukraine"):

• "from U.S. stockpiles" is not supported by the sources and is an important point, because other reporting has claimed that the US stockpile of Patriot missiles is very low. This seems to be a deal for Ukraine/NATO to purchase new missiles produced by American companies.
• That image is not from the japantoday.com article
• The caption is wrong, that's not Keith Kellogg and they aren't in Kyiv

• This is a real quote but it does not appear in the linked article

• Photo is not from the linked article
• "battery" is not the right term to use here, a battery is a full system that consists of more than just the launcher pictured here

Overall this one is not terrible but still not great, and it's still easy to find serious issues like fake quotes in other stories. Here's one:

This is not a real quote, it's a bad paraphrase of what he actually said.

This one is really bad, it's completely fabricated and nothing like it appears in any of the sources (or anywhere else). And the lead author's name is given in the source. If I were you I would remove the quote feature entirely until you can fully address this, fake quotes are a serious ethical issue.

Image attributions and captions are essentially always wrong, I would remove them as well because it seems like a copyright violation if you can't correctly cite where the image comes from, and another ethical issue if you can't label the people and events correctly.

Locations often appear random, for example the story "Study links East Asian aerosol cleanup to faster warming" is tagged as Riverside, CA, USA, even though it's about a Norwegian study of East Asia.

Thanks for the detailed comment :)

"from U.S. stockpiles" is not supported by the sources and is an important point, because other reporting has claimed that the US stockpile of Patriot missiles is very low. This seems to be a deal for Ukraine/NATO to purchase new missiles produced by American companies.

This is supported by the politico source here, in the subheader: The president said European allies will pay for the systems, which will come from American stockpiles.

About images, they are indeed unfortunately being attributed to the wrong article sometimes - the good news is that it's a technical limitation on our side and not an LLM hallucination - we'll fix it asap. This should also fix the image descriptions not matching the actual image. In the meantime I have hidden those from the Kite UI.

As for quotes, this is meanwhile an LLM hallucination problem - just pushed some tweaks which should improve the situation, but in the meantime I have also hidden these.

Same thing for location, but since the 'harm' that can be inflicted by that field is way lower - I have kept it visible for now.

Thanks again 🙂