How ChatGPT Could Take Microsoft's Search Engine Bing Into the Future – CNET
How ChatGPT Could Take Microsoft's Search Engine Bing Into the Future - CNET
Have you ever found yourself trawling through endless pages of results on a search engine to find the answer to a complex question? Say you want to find out if a vegetarian diet is suitable for your dog. Your research journey might begin by hopping onto Google and typing “is a veg diet good for dogs” into the search box and then having to make sense of the legion of generated links. By the time you find an answer, you’ve sunk way more time than you’d budgeted into poring through articles, reports and their sources.
In the not-so-distant future, finding the answer to a complex question might not be such a tedious, mind-numbing process. Microsoft is reportedly integrating the AI tech that underlies ChatGPT into its Bing search engine in a move that could transform search as we know it. More specifically, Bing might have the potential to serve up a search experience that’s superior to Google, according to AI researchers, and potentially usurp the search giant’s decades-long dominance.
“ChatGPT is the first new technology in more than a decade that may really transform search and that could, at least in principle, upend Google’s market dominance,” said Anton Korinek, an AI researcher and professor of economics, at the University of Virginia. “What the technology does is that it allows consumers to interact with their computer in a much more natural and conversational form than traditional search.”
Read More: Why ChatGPT Will Be Everywhere in 2023
At this point, we don’t know what Bing’s AI-driven search results might look like exactly. Microsoft declined to comment for this story. However, AI researchers expect a meaningful departure from the status quo in terms of how a search engine presents an answer and how users interact with it. After all, ChatGPT is not designed to browse the internet for information (like a search engine). Instead, the chatbot uses information studied from vast swaths of training data to generate a response.
“ChatGPT can answer its users with a single clear response compared to the myriads of links of traditional search engines. It also has capabilities that are far beyond traditional search engines, like [the ability] to generate new text, explain concepts, have a back-and-forth conversation between the user and the system, and so on,” said Korinek. “People still find emergent capabilities that even the creators of ChatGPT were not aware that the system had.”
This week, Microsoft announced plans to invest more resources into OpenAI, the creator of ChatGPT, to the tune of $10 billion. The deal would help keep both companies at the cutting edge of what’s known as generative AI, a tech used in ChatGPT that can learn from copious amounts of data to create virtually any content format (text, images, music and so on) simply from a text prompt.
Search is just one in a suite of consumer-facing products in Microsoft’s stable that could potentially change meaningfully for customers in the coming years. According to a report by The Information, the Seattle-based tech giant also has plans to integrate ChatGPT’s AI tech into long-established products like Word, PowerPoint and Outlook in an endeavor that could change how more than a billion people work and accomplish daily tasks. For instance, integrating it into Outlook could mean simply prompting the email application to write a message about a specific topic.
“Microsoft will deploy OpenAI’s models across our consumer and enterprise products and introduce new categories of digital experiences built on OpenAI’s technology,” the company said in a press release announcing the expanded partnership.
Conversational search
For its part, Google and its cutting-edge subunit DeepMind have been working on similar systems for years. The search giant chose not to release them to the public, though, in part over concerns about unethical behavior and how chat systems sometimes break social norms. For instance, in 2016 Microsoft created a chatbot called Tay that it was forced to take offline after it spewed out hate speech. Even ChatGPT, which has rules to create positive and friendly content, can be manipulated into producing upsetting responses using the right prompts.
However, DeepMind CEO Demis Hassabis said in an interview with Time this month that his company is considering its own chatbot, called Sparrow, for a “private beta” sometime in 2023. Google also plans to demonstrate a version of its search engine with chatbot features as early as this year, according to a New York Times report citing sources familiar with the matter.
It’s no secret that Google search has become more conversational in general over the years. The company has made progress in this area with the Google assistant and with knowledge panels in search, and for years has pitched conversation as the future of search, demoing its AI systems LaMDA and MUM at its 2021 I/O developer conference.
Leveraging OpenAI’s artificial intelligence seems to be how Microsoft is attempting to edge out Google at its own game. In the wake of ChatGPT’s release, Google management issued a “code red,” according to The New York Times. The report said internal teams had been reassigned to kickstart work on AI between now and an expected company conference in May.
Still, Google’s search engine today remains the undisputed market leader as it has for decades, commanding 84% of global search market share, compared to Bing’s 9% (although it has grown in recent years) in 2022, according to Statista.
Google didn’t immediately respond to a request for comment on this story.
Read More: Microsoft’s New Tools Use AI to Generate Any Image You Imagine
How smart is ChatGPT?
As you’ve probably heard by now, ChatGPT is a sophisticated chatbot that went viral globally after its consumer release in late November as a free online tool accessible to anyone with an internet connection. The AI-powered chatbot made headlines thanks in part to its ability to churn out delightful poetry, generate meal plans and provide authoritative answers to complex questions within seconds after being prompted. The tech underlying it isn’t exactly brand new, but no chatbot had yet managed to capture mainstream fascination in the way that ChatGPT did. That’s largely because OpenAI built a snazzy user experience around the GPT-3.5 language model, and that’s the phenomenon we know as ChatGPT.
GPT-3.5 is an improved version of GPT-3, which debuted in 2020 and which learned from vast tracts of data and code to help it achieve its abilities. According to researchers at Stanford University, GPT-3 was trained on 570 gigabytes of text and has 175 billion parameters. (Google’s Dale Markowitz, meanwhile, put it at 45 terabytes of text data, “including almost all of the public web.”) For comparison, its predecessor, GPT-2, was over 100 times smaller, at 1.5 billion parameters.
“This increase in scale drastically changes the behavior of the model — GPT-3 is able to perform tasks it was not explicitly trained on, like translating sentences from English to French, with few to no training examples. This behavior was mostly absent in GPT-2,” researchers from Stanford‘s Institute for Human-Centered Artificial Intelligence wrote in a 2021 post.
“The current version of ChatGPT probably already knows more about the world than any individual human, and it can present that knowledge in digestible form,” said Korinek.
For all the promise ChatGPT holds, there are nearly as many limitations. Critics of ChatGPT say it’s not always clear where the chatbot is pulling information from, which can make it difficult for people to trust the results. Skeptics also point out that ChatGPT will always remain undermined by the imperfect nature of the data it was trained on, including biased information or misinformation.
OpenAI has acknowledged the chatbot’s weaknesses in its current form. CEO Sam Altman said in a December post on Twitter that the product struggles with “robustness and truthfulness” and that it would be “a mistake to be relying on it for anything important right now.”
But don’t look for the AI bandwagon to slow down.
“There will be a number of new systems like ChatGPT that will enter the market in 2023, and the main implication of the resulting competition is that consumers will have more choice and, hopefully, better products for consumers,” added Korinek.
GPT-4, which is under development, is reported to have 100 trillion parameters. But a release is not expected to take place until OpenAI is “confident we can [release] it safely and responsibly,” Altman said in an interview with StrictlyVC in early January.
Altman also attempted to manage expectations of that fourth iteration of GPT, the sophisticated language model that underpins ChatGPT, saying “we don’t have AGI.” AGI stands for artificial general intelligence, or a technology with its own emergent intelligence as opposed to relying on the deep learning models currently used by OpenAI. It’s the kind of intelligence that has been dramatized in science fiction stories for more than a century and was popularized in recent years by the award-winning dystopian show Westworld.
“I think [AGI] is sort of what is expected of us,” Altman said in the same interview, adding that GPT-4 is “going to disappoint” people who hold out that hope.
Editors’ note: CNET is using an AI engine to create some personal finance explainers that are edited and fact-checked by our editors. For more, see this post.