×
Apple’s upgraded AI models underwhelm on performance

Apple’s upgraded AI models underwhelm on performance

Apple has announced updates to the AI models that power its suite of Apple Intelligence features across iOS, macOS, and more. But according to the company’s own benchmarks, the models underperform older models from rival tech firms, including OpenAI.

Apple said in a blog post Monday that human testers rated the quality of text generated by its newest “Apple On-Device” model — which runs offline on products including the iPhone — “comparably” to, but not better than, text from similarly-sized Google and Alibaba models. Meanwhile, those same testers rated Apple’s more capable new model, which is called “Apple Server” and designed to run in the company’s data centers, behind OpenAI’s year-old GPT-4o.

In a separate test evaluating the ability of Apple’s models to analyze images, human raters preferred Meta’s Llama 4 Scout model over Apple Server, according to Apple. That’s a bit surprising. On a number of tests, Llama 4 Scout performs worse than leading models from AI labs like Google, Anthropic, and OpenAI.

The benchmark results add credence to reports suggesting Apple’s AI research division has struggled to catch up to competitors in the cutthroat AI race. Apple’s AI capabilities in recent years have underwhelmed, and a promised Siri upgrade has been delayed indefinitely. Some customers have sued Apple, accusing the firm of marketing AI features for its products that it hasn’t yet delivered.

In addition to generating text, Apple On-Device, which is roughly 3 billion parameters in size, drives features like summarization and text analysis. (Parameters roughly correspond to a model’s problem-solving skills, and models with more parameters generally perform better than those with fewer parameters.) As of Monday, third-party developers can tap into it via Apple’s Foundation Models framework.

Apple says both Apple On-Device and Apple Server boast improved tool-use and efficiency compared to their predecessors, and can understand around 15 languages. That’s thanks in part to an expanded training dataset that includes image data, PDFs, documents, manuscripts, infographics, tables, and charts.

Source link
#Apples #upgraded #models #underwhelm #performance

White House officials are exploring official government oversight of new AI models, according to the New York Times.

U.S. officials, speaking on the condition of anonymity, told the publication that the Trump administration is forming an AI working group composed of tech leaders and government representatives. The group will be tasked with outlining potential oversight procedures for new models launching to market, including formal review processes, the Times reported.

The proposed plans were discussed at a White House meeting last week with representatives from Anthropic, Google, and OpenAI.

Potentially influenced by regulatory processes announced by UK regulators, which relegate AI oversight to relevant government bodies, the working group would also determine which U.S. agencies would be tasked with oversight. Some officials have suggested the National Security Agency (NSA), the White House Office of the National Cyber Director, and the director of national intelligence take the lead, while others have even suggested revitalizing the Biden-era Center for A.I. Standards and Innovation, according to the Times.

The administration has reversed its stance on AI regulation in recent months, despite announcing a federal AI action plan that pulled back on regulation of tech companies and threatened to reduce federal funding for states that impeded AI infrastructure efforts through regulation. Trump’s One Big Beautiful Bill also included limits on state governments’ AI regulation, originally proposing a 10-year moratorium on state action in favor of federal oversight.

Trump appointee and FCC chairman Brendan Carr has also advocated for a light-touch approach to AI regulation.

#Trump #federal #model #oversight">Trump considering federal AI model oversight
                                                            White House officials are exploring official government oversight of new AI models, according to the New York Times. U.S. officials, speaking on the condition of anonymity, told the publication that the Trump administration is forming an AI working group composed of tech leaders and government representatives. The group will be tasked with outlining potential oversight procedures for new models launching to market, including formal review processes, the Times reported. 
        SEE ALSO:
        
            Student sues matchmaking app for allegedly stealing her likeness for an ad
            
        
    
The proposed plans were discussed at a White House meeting last week with representatives from Anthropic, Google, and OpenAI. 
        
            Mashable Light Speed
        
        
    

Potentially influenced by regulatory processes announced by UK regulators, which relegate AI oversight to relevant government bodies, the working group would also determine which U.S. agencies would be tasked with oversight. Some officials have suggested the National Security Agency (NSA), the White House Office of the National Cyber Director, and the director of national intelligence take the lead, while others have even suggested revitalizing the Biden-era Center for A.I. Standards and Innovation, according to the Times. The administration has reversed its stance on AI regulation in recent months, despite announcing a federal AI action plan that pulled back on regulation of tech companies and threatened to reduce federal funding for states that impeded AI infrastructure efforts through regulation. Trump’s One Big Beautiful Bill also included limits on state governments’ AI regulation, originally proposing a 10-year moratorium on state action in favor of federal oversight. 
Trump appointee and FCC chairman Brendan Carr has also advocated for a light-touch approach to AI regulation. 

                    
                                            
                            
                        
                                    #Trump #federal #model #oversight

government oversight of new AI models, according to the New York Times.

U.S. officials, speaking on the condition of anonymity, told the publication that the Trump administration is forming an AI working group composed of tech leaders and government representatives. The group will be tasked with outlining potential oversight procedures for new models launching to market, including formal review processes, the Times reported.

The proposed plans were discussed at a White House meeting last week with representatives from Anthropic, Google, and OpenAI.

Potentially influenced by regulatory processes announced by UK regulators, which relegate AI oversight to relevant government bodies, the working group would also determine which U.S. agencies would be tasked with oversight. Some officials have suggested the National Security Agency (NSA), the White House Office of the National Cyber Director, and the director of national intelligence take the lead, while others have even suggested revitalizing the Biden-era Center for A.I. Standards and Innovation, according to the Times.

The administration has reversed its stance on AI regulation in recent months, despite announcing a federal AI action plan that pulled back on regulation of tech companies and threatened to reduce federal funding for states that impeded AI infrastructure efforts through regulation. Trump’s One Big Beautiful Bill also included limits on state governments’ AI regulation, originally proposing a 10-year moratorium on state action in favor of federal oversight.

Trump appointee and FCC chairman Brendan Carr has also advocated for a light-touch approach to AI regulation.

#Trump #federal #model #oversight">Trump considering federal AI model oversight

White House officials are exploring official government oversight of new AI models, according to the New York Times.

U.S. officials, speaking on the condition of anonymity, told the publication that the Trump administration is forming an AI working group composed of tech leaders and government representatives. The group will be tasked with outlining potential oversight procedures for new models launching to market, including formal review processes, the Times reported.

The proposed plans were discussed at a White House meeting last week with representatives from Anthropic, Google, and OpenAI.

Potentially influenced by regulatory processes announced by UK regulators, which relegate AI oversight to relevant government bodies, the working group would also determine which U.S. agencies would be tasked with oversight. Some officials have suggested the National Security Agency (NSA), the White House Office of the National Cyber Director, and the director of national intelligence take the lead, while others have even suggested revitalizing the Biden-era Center for A.I. Standards and Innovation, according to the Times.

The administration has reversed its stance on AI regulation in recent months, despite announcing a federal AI action plan that pulled back on regulation of tech companies and threatened to reduce federal funding for states that impeded AI infrastructure efforts through regulation. Trump’s One Big Beautiful Bill also included limits on state governments’ AI regulation, originally proposing a 10-year moratorium on state action in favor of federal oversight.

Trump appointee and FCC chairman Brendan Carr has also advocated for a light-touch approach to AI regulation.

#Trump #federal #model #oversight

On May 4, 2026, the U.S. Securities and Exchange Commission filed an amended complaint to add the Elon Musk Revocable Trust dated July 22, 2003 (the “Revocable Trust”) as a defendant to this action. The amended complaint alleges that the defendants failed to timely file a beneficial ownership report with the Commission after the Revocable Trust acquired beneficial ownership of more than five percent of the outstanding shares of Twitter, Inc. common stock, in violation of the beneficial ownership reporting requirements under the Securities Exchange Act of 1934 (“Exchange Act”).

The SEC simultaneously moved for entry of a consent final judgment as to the Revocable Trust. Without admitting or denying the allegations of the complaint as to the Revocable Trust, the Revocable Trust consented to entry of a final judgment, subject to court approval, that would permanently enjoin it from violating Section 13(d) of the Exchange Act and Rule 13d-1 thereunder and order it to pay a civil penalty of $1.5 million.

As explained in the consent motion, if the court enters the proposed final judgment as to the Revocable Trust as proposed by the Revocable Trust and the SEC, the SEC will file a stipulated dismissal of Elon Musk in his personal capacity, which will resolve this case in its entirety.

#Elon #Musk #settle #feds #Twitter #lawsuit #pocket #changeElon Musk,Law,News,Policy,Tech,Twitter – X">Elon Musk will settle the feds’ Twitter lawsuit with pocket changeOn May 4, 2026, the U.S. Securities and Exchange Commission filed an amended complaint to add the Elon Musk Revocable Trust dated July 22, 2003 (the “Revocable Trust”) as a defendant to this action. The amended complaint alleges that the defendants failed to timely file a beneficial ownership report with the Commission after the Revocable Trust acquired beneficial ownership of more than five percent of the outstanding shares of Twitter, Inc. common stock, in violation of the beneficial ownership reporting requirements under the Securities Exchange Act of 1934 (“Exchange Act”).The SEC simultaneously moved for entry of a consent final judgment as to the Revocable Trust. Without admitting or denying the allegations of the complaint as to the Revocable Trust, the Revocable Trust consented to entry of a final judgment, subject to court approval, that would permanently enjoin it from violating Section 13(d) of the Exchange Act and Rule 13d-1 thereunder and order it to pay a civil penalty of .5 million.As explained in the consent motion, if the court enters the proposed final judgment as to the Revocable Trust as proposed by the Revocable Trust and the SEC, the SEC will file a stipulated dismissal of Elon Musk in his personal capacity, which will resolve this case in its entirety.#Elon #Musk #settle #feds #Twitter #lawsuit #pocket #changeElon Musk,Law,News,Policy,Tech,Twitter – X

Post Comment