The more that text generated by large-language models gets published on the Web, the more the Web becomes a blurrier version of itself.
2, designed for use with black-and-white images. To save space, the copier identifies similar-looking regions in the image and stores a single copy for all of them; when the file is decompressed, it uses that copy repeatedly to reconstruct the image. It turned out that the photocopier had judged the labels specifying the area of the rooms to be similar enough that it needed to store only one of them—14.13—and it reused that one for all three rooms when printing the floor plan.
Now, losing your Internet access isn’t quite so terrible; you’ve got all the information on the Web stored on your server. The only catch is that, because the text has been so highly compressed, you can’t look for information by searching for an exact quote; you’ll never get an exact match, because the words aren’t what’s being stored.
Given that large-language models like ChatGPT are often extolled as the cutting edge of artificial intelligence, it may sound dismissive—or at least deflating—to describe them as lossy text-compression algorithms. I do think that this perspective offers a useful corrective to the tendency to anthropomorphize large-language models, but there is another aspect to the compression analogy that is worth considering. Since 2006, an A.I.
Let’s go back to the example of arithmetic. If you ask GPT-3 to add or subtract a pair of numbers, it almost always responds with the correct answer when the numbers have only two digits. But its accuracy worsens significantly with larger numbers, falling to ten per cent when the numbers have five digits. Most of the correct answers that GPT-3 gives are not found on the Web—there aren’t many Web pages that contain the text “245 + 821,” for example—so it’s not engaged in simple memorization.
Even if it is possible to restrict large-language models from engaging in fabrication, should we use them to generate Web content? This would make sense only if our goal is to repackage information that’s already available on the Web. Some companies exist to do just that—we usually call them content mills. Perhaps the blurriness of large-language models will be useful to them, as a way of avoiding copyright infringement.
Can large-language models help humans with the creation of original writing? To answer that, we need to be specific about what we mean by that question. There is a genre of art known as Xerox art, or photocopy art, in which artists use the distinctive properties of photocopiers as creative tools. Something along those lines is surely possible with the photocopier that is ChatGPT, so, in that sense, the answer is yes.
Canada Latest News, Canada Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Web browser Opera is planning to incorporate ChatGPTNiche web browser Opera is planning to integrate ChatGPT into its products, Opera's parent Kunlun Tech announced Wednesday.
Read more »
Microsoft set to discuss OpenAI's ChatGPT at big event: Live updatesMicrosoft's expected to discuss how it will embed OpenAI's ChatGPT in its products at an event in Redmond, Washington.
Read more »
Baidu stock jumps 15% as the tech giant readies its answer to ChatGPTBaidu stock jumps 15% as the Chinese internet giant says it's readying its answer to ChatGPT
Read more »
Google and Microsoft's AI arms race could have 'unintended consequences,' an AI ethicist warns | CNN Business'The rapid emergence of the technology has also raised serious ethical questions, especially since it is being taken to market at a breakneck speed,' writes Oliver Darcy | Analysis
Read more »
Google hopes 'Bard' will outsmart ChatGPT, Microsoft in AIGoogle is girding for a battle of wits in the field of artificial intelligence with “Bard,' a conversational service apparently aimed at countering the popularity of the ChatGPT tool backed by Microsoft.
Read more »
Chinese tech giant launches ChatGPT-style tool, sending shares soaringBaidu, one of the world's biggest AI and internet firms, announces ERNIE which could be China's most notable entry in the race to create lifelike AI bots.
Read more »