Software

AI + ML

Google's AI search bot Bard makes $120b error on day one

'This highlights the importance of a rigorous testing process' says Choc Fact. No sh%t...


About 10 percent of Alphabet's market value – some $120 billion – was wiped out this week after Google proudly presented Bard, its answer to Microsoft's next-gen AI offerings, and the system bungled a simple question.

In a promotional video to show off Bard, a web search assistant to compete against Microsoft's ChatGPT-enhanced Bing, the software answered a science question incorrectly, sending Alphabet's share price down amid an overall lackluster launch by the Chocolate Factory.

Microsoft's integration of OpenAI's super-hyped language models into the Bing search engine and Edge web browser has ignited an arms race. Microsoft wants to eat into Google's web search monopoly by offering a better search engine that uses OpenAI's ChatGPT to answer queries in a conversational way with natural language rather than simple lists of links to relevant webpages.

The idea being that the bot is trained on fresh snapshots of the web, and netizens' web search requests are answered automatically by the bot with summaries of info scraped from the internet.

That's a bit of a Bard start, isn't it?

The Chocolate Factory is not about to give up any of its territory without a fight, though it stumbled at the first hurdle with its launch of ChatGPT rival Bard on Wednesday.

In an example query-response offered by Google's spinners, Bard was asked to explain discoveries made by NASA's James Webb Space Telescope (JWST) at a level a nine-year-old would understand. Some of the text generated by the model, however, was wrong. 

Bard claimed "JWST took the very first pictures of a planet outside of our own solar system," yet the first image of just such an exoplanet, 2M1207b, was actually captured by the European Southern Observatory's Very Large Telescope in 2004, according to NASA. 

Whoops ... Bard's sample output, as pushed by Google PR. Click to enlarge

Although language models can generate text that is initially coherent and grammatically correct, they tend to also confidently spew false information. The above error somehow made it past Google's various engineering, legal, PR, and marketing depts, and found its way into a demo of Bard, right when issues of accuracy and trust are at the top of everyone's minds.

"This highlights the importance of a rigorous testing process, something that we're kicking off this week with our Trusted Tester program," a spokesperson from Google told The Register in a statement.

"We'll combine external feedback with our own internal testing to make sure Bard's responses meet a high bar for quality, safety and groundedness in real-world information." 

If Microsoft and Google are to use AI chatbots as the new user interface for web search, they better make sure their technology generates factual up-to-date information if they want people to use it.

Google announced Bard at the turn of the week, and presented an event geared towards new AI-powered search abilities in its apps on Wednesday. The presentation, led by Prabhakar Raghavan, Google SVP for search, Assistant, however, revealed little more on Bard, and instead, focused on other features like machine translation abilities for its visual app Lens and 3D mapping for Google Maps.

Meanwhile, Microsoft on Tuesday teased a preview version of its OpenAI-boosted Bing that people can eventually use, fingers crossed, and announced features coming to its Chromium-based Edge browser. Google plans to integrate Bard into its own search engine, though it's not clear when it'll be generally available yet. ®

Send us news
50 Comments

Google claims Big Sleep 'first' AI to spot freshly committed security bug that fuzzing missed

You snooze, you lose, er, win

Google reportedly developing an AI agent that can control your browser

Project Jarvis will apparently conduct research, purchase products, and even book a flight on your behalf

Alphabet posts big revenue and profit growth, just 1,100 job losses

Google Cloud grows fast thanks to AI, which now writes a quarter of all G-code

Want advice from UK government website about tax 'n' stuff? Talk to the chatbot

Need to know how to set up a business? There's an (experimental) AI for that

US Army should ditch tanks for AI drones, says Eric Schmidt

And what do you know, Google's former CEO just so happens to have a commercial solution

AI firms and civil society groups plead for passage of federal AI law ASAP

Congress urged to act before year's end to support US competitiveness

Sorry, but the ROI on enterprise AI is abysmal

Appen points to, among other problems, a lack of high-quality training data labeled by humans

The troublesome economics of CPU-only AI

At the end of the day, it all boils down to tokens per dollar

Killer app for AI is still years away, says industry analyst

IT spend set to rise nonetheless and it's not all about wundertech

Single-platform approach may fall short for AI data management

Data platform vendors can't meet all your needs, warns Gartner

Meta gives nod to weaponizing Llama – but only for the good guys

Change of mind follows discovery China was playing with it uninvited?

Linus Torvalds: 90% of AI marketing is hype

Linux kernel creator says let's see which workloads use GenAI in five years