×
Are bad incentives to blame for AI hallucinations? | TechCrunch

Are bad incentives to blame for AI hallucinations? | TechCrunch

A new research paper from OpenAI asks why large language models like GPT-5 and chatbots like ChatGPT still hallucinate, and whether anything can be done to reduce those hallucinations.

In a blog post summarizing the paper, OpenAI defines hallucinations as “plausible but false statements generated by language models,” and it acknowledges that despite improvements, hallucinations “remain a fundamental challenge for all large language models” — one that will never be completely eliminated.

To illustrate the point, researchers say that when they asked “a widely used chatbot” about the title of Adam Tauman Kalai’s Ph.D. dissertation, they got three different answers, all of them wrong. (Kalai is one of the paper’s authors.) They then asked about his birthday and received three different dates. Once again, all of them were wrong.

How can a chatbot be so wrong — and sound so confident in its wrongness? The researchers suggest that hallucinations arise, in part, because of a pretraining process that focuses on getting models to correctly predict the next word, without true or false labels attached to the training statements: “The model sees only positive examples of fluent language and must approximate the overall distribution.”

“Spelling and parentheses follow consistent patterns, so errors there disappear with scale,” they write. “But arbitrary low-frequency facts, like a pet’s birthday, cannot be predicted from patterns alone and hence lead to hallucinations.”

The paper’s proposed solution, however, focuses less on the initial pretraining process and more on how large language models are evaluated. It argues that the current evaluation models don’t cause hallucinations themselves, but they “set the wrong incentives.”

The researchers compare these evaluations to the kind of multiple choice tests random guessing makes sense, because “you might get lucky and be right,” while leaving the answer blank “guarantees a zero.” 

Techcrunch event

San Francisco
|
October 27-29, 2025

“In the same way, when models are graded only on accuracy, the percentage of questions they get exactly right, they are encouraged to guess rather than say ‘I don’t know,’” they say.

The proposed solution, then, is similar to tests (like the SAT) that include “negative [scoring] for wrong answers or partial credit for leaving questions blank to discourage blind guessing.” Similarly, OpenAI says model evaluations need to “penalize confident errors more than you penalize uncertainty, and give partial credit for appropriate expressions of uncertainty.”

And the researchers argue that it’s not enough to introduce “a few new uncertainty-aware tests on the side.” Instead, “the widely used, accuracy-based evals need to be updated so that their scoring discourages guessing.”

“If the main scoreboards keep rewarding lucky guesses, models will keep learning to guess,” the researchers say.

Source link
#bad #incentives #blame #hallucinations #TechCrunch

BTS member j-hope may be the face of Samsung’s newest Galaxy campaign, but fans hoping to see him at the company’s Unpacked event in London on Wednesday were left waiting.

j-hope did not appear in person during the presentation, where Samsung unveiled its latest generation of foldable devices. Instead, the rapper and dancer popped up on screen in a new advertisement introducing the Galaxy Z Fold 8 Wide, Samsung’s redesigned, wider foldable phone.

His absence from London was not entirely surprising. j-hope arrived in Seoul, South Korea, on Tuesday after BTS co-headlined the first-ever FIFA World Cup Final Halftime Show at New York-New Jersey MetLife Stadium on Sunday. The group performed their English-language hit “Dynamite” during the 11-minute production, which also featured Madonna, Shakira, Justin Bieber, Burna Boy, and several other performers.

But j-hope may have been promoting Samsung’s new device before the company officially announced it.

Photos and videos of the BTS member arriving at Incheon International Airport circulated among fans online, with eagle-eyed ARMY members noticing the unusually wide — and lavender! — foldable phone he was holding. It was the same phone he was spotted holding last week during soundcheck footage at a BTS World Tour stop in Paris. The device appeared to be the then-unreleased Galaxy Z Fold 8, prompting speculation that j-hope had given fans an early look at Samsung’s new design and color.

Samsung confirmed the phone during its July 22 Unpacked event in London. The company introduced the Galaxy Z Fold 8 with a shorter, wider design intended to make the foldable easier to hold and use. Samsung also unveiled the more traditionally shaped Galaxy Z Fold 8 Ultra and the Galaxy Z Flip 8.

Although some fans had hoped j-hope’s starring role in Samsung’s Unpacked promotional campaign meant he would attend the London launch, his involvement ultimately came through the advertisement that debuted during the event.

In hindsight, however, his airport appearance may have been the more fitting introduction. While Samsung waited until Unpacked to officially reveal the Galaxy Z Fold 8, j-hope had seemingly already unfolded it for the fans paying close attention.

#BTS #member #jhope #Samsung #Unpacked #Heres #fans #didnt">Where was BTS member j-hope at Samsung Unpacked? Here’s why fans didn’t see him.
                                                            BTS member j-hope may be the face of Samsung’s newest Galaxy campaign, but fans hoping to see him at the company’s Unpacked event in London on Wednesday were left waiting.j-hope did not appear in person during the presentation, where Samsung unveiled its latest generation of foldable devices. Instead, the rapper and dancer popped up on screen in a new advertisement introducing the Galaxy Z Fold 8 Wide, Samsung’s redesigned, wider foldable phone.
    

His absence from London was not entirely surprising. j-hope arrived in Seoul, South Korea, on Tuesday after BTS co-headlined the first-ever FIFA World Cup Final Halftime Show at New York-New Jersey MetLife Stadium on Sunday. The group performed their English-language hit “Dynamite” during the 11-minute production, which also featured Madonna, Shakira, Justin Bieber, Burna Boy, and several other performers.

    
        This Tweet is currently unavailable. It might be loading or has been removed.
    


But j-hope may have been promoting Samsung’s new device before the company officially announced it.
        
            Mashable Trend Report
        
        
    
Photos and videos of the BTS member arriving at Incheon International Airport circulated among fans online, with eagle-eyed ARMY members noticing the unusually wide — and lavender! — foldable phone he was holding. It was the same phone he was spotted holding last week during soundcheck footage at a BTS World Tour stop in Paris. The device appeared to be the then-unreleased Galaxy Z Fold 8, prompting speculation that j-hope had given fans an early look at Samsung’s new design and color.
    
        This Tweet is currently unavailable. It might be loading or has been removed.
    



    
        This Tweet is currently unavailable. It might be loading or has been removed.
    


Samsung confirmed the phone during its July 22 Unpacked event in London. The company introduced the Galaxy Z Fold 8 with a shorter, wider design intended to make the foldable easier to hold and use. Samsung also unveiled the more traditionally shaped Galaxy Z Fold 8 Ultra and the Galaxy Z Flip 8.
Although some fans had hoped j-hope’s starring role in Samsung’s Unpacked promotional campaign meant he would attend the London launch, his involvement ultimately came through the advertisement that debuted during the event.In hindsight, however, his airport appearance may have been the more fitting introduction. While Samsung waited until Unpacked to officially reveal the Galaxy Z Fold 8, j-hope had seemingly already unfolded it for the fans paying close attention.

                    
                                            
                            
                        
                                    #BTS #member #jhope #Samsung #Unpacked #Heres #fans #didnt

face of Samsung’s newest Galaxy campaign, but fans hoping to see him at the company’s Unpacked event in London on Wednesday were left waiting.

j-hope did not appear in person during the presentation, where Samsung unveiled its latest generation of foldable devices. Instead, the rapper and dancer popped up on screen in a new advertisement introducing the Galaxy Z Fold 8 Wide, Samsung’s redesigned, wider foldable phone.

His absence from London was not entirely surprising. j-hope arrived in Seoul, South Korea, on Tuesday after BTS co-headlined the first-ever FIFA World Cup Final Halftime Show at New York-New Jersey MetLife Stadium on Sunday. The group performed their English-language hit “Dynamite” during the 11-minute production, which also featured Madonna, Shakira, Justin Bieber, Burna Boy, and several other performers.

But j-hope may have been promoting Samsung’s new device before the company officially announced it.

Photos and videos of the BTS member arriving at Incheon International Airport circulated among fans online, with eagle-eyed ARMY members noticing the unusually wide — and lavender! — foldable phone he was holding. It was the same phone he was spotted holding last week during soundcheck footage at a BTS World Tour stop in Paris. The device appeared to be the then-unreleased Galaxy Z Fold 8, prompting speculation that j-hope had given fans an early look at Samsung’s new design and color.

Samsung confirmed the phone during its July 22 Unpacked event in London. The company introduced the Galaxy Z Fold 8 with a shorter, wider design intended to make the foldable easier to hold and use. Samsung also unveiled the more traditionally shaped Galaxy Z Fold 8 Ultra and the Galaxy Z Flip 8.

Although some fans had hoped j-hope’s starring role in Samsung’s Unpacked promotional campaign meant he would attend the London launch, his involvement ultimately came through the advertisement that debuted during the event.

In hindsight, however, his airport appearance may have been the more fitting introduction. While Samsung waited until Unpacked to officially reveal the Galaxy Z Fold 8, j-hope had seemingly already unfolded it for the fans paying close attention.

#BTS #member #jhope #Samsung #Unpacked #Heres #fans #didnt">Where was BTS member j-hope at Samsung Unpacked? Here’s why fans didn’t see him.

BTS member j-hope may be the face of Samsung’s newest Galaxy campaign, but fans hoping to see him at the company’s Unpacked event in London on Wednesday were left waiting.

j-hope did not appear in person during the presentation, where Samsung unveiled its latest generation of foldable devices. Instead, the rapper and dancer popped up on screen in a new advertisement introducing the Galaxy Z Fold 8 Wide, Samsung’s redesigned, wider foldable phone.

His absence from London was not entirely surprising. j-hope arrived in Seoul, South Korea, on Tuesday after BTS co-headlined the first-ever FIFA World Cup Final Halftime Show at New York-New Jersey MetLife Stadium on Sunday. The group performed their English-language hit “Dynamite” during the 11-minute production, which also featured Madonna, Shakira, Justin Bieber, Burna Boy, and several other performers.

But j-hope may have been promoting Samsung’s new device before the company officially announced it.

Photos and videos of the BTS member arriving at Incheon International Airport circulated among fans online, with eagle-eyed ARMY members noticing the unusually wide — and lavender! — foldable phone he was holding. It was the same phone he was spotted holding last week during soundcheck footage at a BTS World Tour stop in Paris. The device appeared to be the then-unreleased Galaxy Z Fold 8, prompting speculation that j-hope had given fans an early look at Samsung’s new design and color.

Samsung confirmed the phone during its July 22 Unpacked event in London. The company introduced the Galaxy Z Fold 8 with a shorter, wider design intended to make the foldable easier to hold and use. Samsung also unveiled the more traditionally shaped Galaxy Z Fold 8 Ultra and the Galaxy Z Flip 8.

Although some fans had hoped j-hope’s starring role in Samsung’s Unpacked promotional campaign meant he would attend the London launch, his involvement ultimately came through the advertisement that debuted during the event.

In hindsight, however, his airport appearance may have been the more fitting introduction. While Samsung waited until Unpacked to officially reveal the Galaxy Z Fold 8, j-hope had seemingly already unfolded it for the fans paying close attention.

#BTS #member #jhope #Samsung #Unpacked #Heres #fans #didnt

Post Comment