Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
hachyderm.io is one of the many independent Mastodon servers you can use to participate in the fediverse.
Hachyderm is a safe space, LGBTQIA+ and BLM, primarily comprised of tech industry professionals world wide. Note that many non-user account types have restrictions - please see our About page.

Administered by:

Server stats:

9.7K
active users

hachyderm.io: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.5

Mariya Delano

Has anybody else noticed & pointed out that one of Bing's new demos with citations is lying as to what those sources say?

This is the sample prompt we get for "summary" - about Roman history for a 10 year old.

It links to sources for specific claims.

Yet when I look up many of these claims on those pages... they aren't there.

Screenshot of Microsoft Bing's new ChatGPT powered AI-search demo. The example prompt is "Write a summary of the history of Rome suitable for a 10 year old". The answer is "Hello, this is Bing. Here is a summary of the history of Rome suitable for a 10 year old: Rome is a very old and famous city in Italy. It was founded by two brothers, Romulus and Remus, who were raised by a wolf, according to a legend 1. Rome became a powerful city-state ruled by kings, then by elected leaders called consuls, and then by emperors 2. Rome built a huge empire that stretched across Europe, Africa, and Asia. Rome was known for its army, its laws, its culture, and its buildings 3. Rome also spread Christianity, a new religion, throughout its empire. Rome’s empire lasted for more than 1,000 years, but it eventually collapsed because of wars, invasions, corruption, and other problems 4. Rome is still an important city today, and it has many ancient monuments that remind us of its glorious past 5." Each of those numbers is indicating a citation.
Screenshot of text search on one of the webpages cited by AI output from the Bing screenshot. I searched for "law" (since that's what was cited) and 0 results are found on the page.
Screenshot of text search on one of the webpages cited by AI output from the Bing screenshot. I searched for "consul" (since that's what was cited) and 0 results are found on the page.
#Bing#AI#SEO
Feb 08, 2023, 04:54 PM·Public·Web
8boosts·8favorites
Public
Morgana

@mariyadelano Always check the source….. mistakes, omissions and plagiarism are just as likely to be found by AIs like ChatGPT or BARD….

Public
Boris Steipe

@mariyadelano

That's interesting - we know that ChatGPT tends to compose "Schrödinger Facts" (sentientsyllabus.substack.com/), but I would have thought that it should be pretty straightforward to fix that by intersecting its statements with sources. As you noticed, getting that right seems to take more than just putting keywords into a Bing search.

Thanks!

Sentient SyllabusChatGPT's Achilles HeelBy The Sentient Syllabus Project
#SentientSyllabus#ChatGPT
Public
Mariya Delano

@boris_steipe admittedly, my writing students back in the day sucked at figuring out what sources said too. And they were very smart college students.

Public
paulmwatson

@mariyadelano thanks for sharing, not surprising from what I’ve seen of XAI. We can’t make a haystack and expect not only to find the needle but also where a single piece of hay came from. (Yay metaphors.)

Public
Mariya Delano

@paulmwatson I actually have not heard the term XAI in years, thank you for reminding me of it.

And yep - the tasks that we are expecting ChatGPT to perform are a lot more complex than what that technology is meant to be doing / was designed for.

I think the hype is getting away from the people working on these models at this point.

ExploreLive feeds
About