×
Apple’s upgraded AI models underwhelm on performance

Apple’s upgraded AI models underwhelm on performance

Tech-news

Apple has announced updates to the AI models that power its suite of Apple Intelligence features across iOS, macOS, and more. But according to the company’s own benchmarks, the models underperform older models from rival tech firms, including OpenAI.

Apple said in a blog post Monday that human testers rated the quality of text generated by its newest “Apple On-Device” model — which runs offline on products including the iPhone — “comparably” to, but not better than, text from similarly-sized Google and Alibaba models. Meanwhile, those same testers rated Apple’s more capable new model, which is called “Apple Server” and designed to run in the company’s data centers, behind OpenAI’s year-old GPT-4o.

In a separate test evaluating the ability of Apple’s models to analyze images, human raters preferred Meta’s Llama 4 Scout model over Apple Server, according to Apple. That’s a bit surprising. On a number of tests, Llama 4 Scout performs worse than leading models from AI labs like Google, Anthropic, and OpenAI.

The benchmark results add credence to reports suggesting Apple’s AI research division has struggled to catch up to competitors in the cutthroat AI race. Apple’s AI capabilities in recent years have underwhelmed, and a promised Siri upgrade has been delayed indefinitely. Some customers have sued Apple, accusing the firm of marketing AI features for its products that it hasn’t yet delivered.

In addition to generating text, Apple On-Device, which is roughly 3 billion parameters in size, drives features like summarization and text analysis. (Parameters roughly correspond to a model’s problem-solving skills, and models with more parameters generally perform better than those with fewer parameters.) As of Monday, third-party developers can tap into it via Apple’s Foundation Models framework.

Apple says both Apple On-Device and Apple Server boast improved tool-use and efficiency compared to their predecessors, and can understand around 15 languages. That’s thanks in part to an expanded training dataset that includes image data, PDFs, documents, manuscripts, infographics, tables, and charts.

Source link
#Apples #upgraded #models #underwhelm #performance

Related Posts

range of accessories, but my favorite is the dual battery system. This $850 system isn’t cheap, but it adds another battery to the frame, which ups the range by another 40 miles. If you’re not taking this bike on long rides, it may not be worth the expense, but I appreciated the chance to maximize its range.

The rest of the accessory line focuses on storage. These include a cool in-frame rack, front and rear racks and boxes, and, for the beach bums, a very cool surfboard rack that mounts your board on the side of the bike.

Rough Ride

Image may contain Machine Wheel Spoke Computer Hardware Electronics Hardware Monitor Screen and Escooter

Photograph: Billy Brown

The H/T comes with five levels of pedal assist, but I mostly used the throttle, partly because I’m lazy and partly because the pedal-assist response could be wildly inconsistent. For levels 1 through 3, the pedal assist was smooth; it just felt like a little boost to my pedaling. On levels 4 and 5, however, the bike seemed to jerk forward every time I pressed down on the pedal. It felt more like my bike was leaping forward rather than assisting, to the point that I almost wobbled off the bike the first time I tried level 5. If you’re a chronic pedaler who’s looking for a more traditional cycling experience, this may not be the bike for you.

#Finally #Ebike #Doesnt #Dorkyreviews,review,outdoors,bicycles,shopping,electric bikes,commuter bikes">I Finally Found an Ebike That Doesn’t Look DorkyThe handling at that top speed was excellent. Thanks to the comfortable upright position and frame geometry, cruising along at 28 miles per hour felt smooth and comfortable. Turning at speed and quickly adjusting to avoid a pothole was also easy and smooth, even when I was gunning the throttle. The thrill of riding fast on the H/T comes from the exhilaration of speed, not the fear of losing control.I appreciate that there’s no app to go along with the H/T. It makes hopping on the bike and going for a ride feel much more natural than it does with the app-controlled bikes I’ve tested. The handlebar-mounted screen is also very intuitive and easy to use, and it has a personal passcode for added security. There’s also a USB-C charging port if you decide to get a handlebar mount for your phone. The bike has a front daytime running light that automatically brightens when the sun goes down, two front and rear turn signal lights, and a brake light. The front and rear hydraulic disc brakes are responsive and have excellent stopping power.Add OnsIt’s easy to customize the bike and add utility. Pedal offers a range of accessories, but my favorite is the dual battery system. This 0 system isn’t cheap, but it adds another battery to the frame, which ups the range by another 40 miles. If you’re not taking this bike on long rides, it may not be worth the expense, but I appreciated the chance to maximize its range.The rest of the accessory line focuses on storage. These include a cool in-frame rack, front and rear racks and boxes, and, for the beach bums, a very cool surfboard rack that mounts your board on the side of the bike.Rough RidePhotograph: Billy BrownThe H/T comes with five levels of pedal assist, but I mostly used the throttle, partly because I’m lazy and partly because the pedal-assist response could be wildly inconsistent. For levels 1 through 3, the pedal assist was smooth; it just felt like a little boost to my pedaling. On levels 4 and 5, however, the bike seemed to jerk forward every time I pressed down on the pedal. It felt more like my bike was leaping forward rather than assisting, to the point that I almost wobbled off the bike the first time I tried level 5. If you’re a chronic pedaler who’s looking for a more traditional cycling experience, this may not be the bike for you.#Finally #Ebike #Doesnt #Dorkyreviews,review,outdoors,bicycles,shopping,electric bikes,commuter bikes

, but my favorite is the dual battery system. This $850 system isn’t cheap, but it adds another battery to the frame, which ups the range by another 40 miles. If you’re not taking this bike on long rides, it may not be worth the expense, but I appreciated the chance to maximize its range.

The rest of the accessory line focuses on storage. These include a cool in-frame rack, front and rear racks and boxes, and, for the beach bums, a very cool surfboard rack that mounts your board on the side of the bike.

Rough Ride

Image may contain Machine Wheel Spoke Computer Hardware Electronics Hardware Monitor Screen and Escooter

Photograph: Billy Brown

The H/T comes with five levels of pedal assist, but I mostly used the throttle, partly because I’m lazy and partly because the pedal-assist response could be wildly inconsistent. For levels 1 through 3, the pedal assist was smooth; it just felt like a little boost to my pedaling. On levels 4 and 5, however, the bike seemed to jerk forward every time I pressed down on the pedal. It felt more like my bike was leaping forward rather than assisting, to the point that I almost wobbled off the bike the first time I tried level 5. If you’re a chronic pedaler who’s looking for a more traditional cycling experience, this may not be the bike for you.

#Finally #Ebike #Doesnt #Dorkyreviews,review,outdoors,bicycles,shopping,electric bikes,commuter bikes">I Finally Found an Ebike That Doesn’t Look Dorky

The handling at that top speed was excellent. Thanks to the comfortable upright position and frame geometry, cruising along at 28 miles per hour felt smooth and comfortable. Turning at speed and quickly adjusting to avoid a pothole was also easy and smooth, even when I was gunning the throttle. The thrill of riding fast on the H/T comes from the exhilaration of speed, not the fear of losing control.

I appreciate that there’s no app to go along with the H/T. It makes hopping on the bike and going for a ride feel much more natural than it does with the app-controlled bikes I’ve tested. The handlebar-mounted screen is also very intuitive and easy to use, and it has a personal passcode for added security. There’s also a USB-C charging port if you decide to get a handlebar mount for your phone. The bike has a front daytime running light that automatically brightens when the sun goes down, two front and rear turn signal lights, and a brake light. The front and rear hydraulic disc brakes are responsive and have excellent stopping power.

Add Ons

It’s easy to customize the bike and add utility. Pedal offers a range of accessories, but my favorite is the dual battery system. This $850 system isn’t cheap, but it adds another battery to the frame, which ups the range by another 40 miles. If you’re not taking this bike on long rides, it may not be worth the expense, but I appreciated the chance to maximize its range.

The rest of the accessory line focuses on storage. These include a cool in-frame rack, front and rear racks and boxes, and, for the beach bums, a very cool surfboard rack that mounts your board on the side of the bike.

Rough Ride

Image may contain Machine Wheel Spoke Computer Hardware Electronics Hardware Monitor Screen and Escooter

Photograph: Billy Brown

The H/T comes with five levels of pedal assist, but I mostly used the throttle, partly because I’m lazy and partly because the pedal-assist response could be wildly inconsistent. For levels 1 through 3, the pedal assist was smooth; it just felt like a little boost to my pedaling. On levels 4 and 5, however, the bike seemed to jerk forward every time I pressed down on the pedal. It felt more like my bike was leaping forward rather than assisting, to the point that I almost wobbled off the bike the first time I tried level 5. If you’re a chronic pedaler who’s looking for a more traditional cycling experience, this may not be the bike for you.

#Finally #Ebike #Doesnt #Dorkyreviews,review,outdoors,bicycles,shopping,electric bikes,commuter bikes

Apple co-founder Steve Jobs once famously said a touchscreen MacBook was never going to happen, but that was a long time ago, and things are changing.

A leaker known as Instant Digital, known for some eerily accurate Apple-related predictions, seemed certain about it in a recent Weibo post (via MacRumors).

“It’s 100% confirmed that the MacBook screen will be touch-enabled,” he wrote.

The leaker did not add any other details, so we don’t know which version of the MacBook is getting the touchscreen, nor when this is supposed to happen. But the post builds on previous reports from Bloomberg’s Mark Gurman and Apple analyst Ming-Chi Kuo, with both previously stating that Apple is working on a touchscreen variant of the MacBook.

Rumors about such a device have circulated for years, though, and nothing ever came to fruition. Gurman’s report dates February 2026, and back then he said the initial batch of touch-enabled Macs are coming “this fall.” Gurman said the company would be pretty lax about the touchscreen, allowing the users to use it as much or as little they’d like, instead of positioning the Mac as a better version of the iPad.

SEE ALSO: Apple’s WWDC 2026 recap: What did Apple announce?

Apple is also rumored to launch a high-end “MacBook Ultra” later this year; this top-of-the-line device should come with Apple’s most powerful chips, an OLED display, and it might be the first one to be touch-enabled.

#Apples #touchscreen #MacBook #happening #report #claims">Apple’s touchscreen MacBook is definitely happening, report claims Apple co-founder Steve Jobs once famously said a touchscreen MacBook was never going to happen, but that was a long time ago, and things are changing. A leaker known as Instant Digital, known for some eerily accurate Apple-related predictions, seemed certain about it in a recent Weibo post (via MacRumors). “It’s 100% confirmed that the MacBook screen will be touch-enabled,” he wrote. Mashable Light Speed The leaker did not add any other details, so we don’t know which version of the MacBook is getting the touchscreen, nor when this is supposed to happen. But the post builds on previous reports from Bloomberg’s Mark Gurman and Apple analyst Ming-Chi Kuo, with both previously stating that Apple is working on a touchscreen variant of the MacBook. Rumors about such a device have circulated for years, though, and nothing ever came to fruition. Gurman’s report dates February 2026, and back then he said the initial batch of touch-enabled Macs are coming “this fall.” Gurman said the company would be pretty lax about the touchscreen, allowing the users to use it as much or as little they’d like, instead of positioning the Mac as a better version of the iPad. SEE ALSO: Apple’s WWDC 2026 recap: What did Apple announce? Apple is also rumored to launch a high-end “MacBook Ultra” later this year; this top-of-the-line device should come with Apple’s most powerful chips, an OLED display, and it might be the first one to be touch-enabled. #Apples #touchscreen #MacBook #happening #report #claims

Apple co-founder Steve Jobs once famously said a touchscreen MacBook was never going to happen, but that was a long time ago, and things are changing.

A leaker known as Instant Digital, known for some eerily accurate Apple-related predictions, seemed certain about it in a recent Weibo post (via MacRumors).

“It’s 100% confirmed that the MacBook screen will be touch-enabled,” he wrote.

The leaker did not add any other details, so we don’t know which version of the MacBook is getting the touchscreen, nor when this is supposed to happen. But the post builds on previous reports from Bloomberg’s Mark Gurman and Apple analyst Ming-Chi Kuo, with both previously stating that Apple is working on a touchscreen variant of the MacBook.

Rumors about such a device have circulated for years, though, and nothing ever came to fruition. Gurman’s report dates February 2026, and back then he said the initial batch of touch-enabled Macs are coming “this fall.” Gurman said the company would be pretty lax about the touchscreen, allowing the users to use it as much or as little they’d like, instead of positioning the Mac as a better version of the iPad.

SEE ALSO: Apple’s WWDC 2026 recap: What did Apple announce?

Apple is also rumored to launch a high-end “MacBook Ultra” later this year; this top-of-the-line device should come with Apple’s most powerful chips, an OLED display, and it might be the first one to be touch-enabled.

#Apples #touchscreen #MacBook #happening #report #claims">Apple’s touchscreen MacBook is definitely happening, report claims

Apple co-founder Steve Jobs once famously said a touchscreen MacBook was never going to happen, but that was a long time ago, and things are changing.

A leaker known as Instant Digital, known for some eerily accurate Apple-related predictions, seemed certain about it in a recent Weibo post (via MacRumors).

“It’s 100% confirmed that the MacBook screen will be touch-enabled,” he wrote.

The leaker did not add any other details, so we don’t know which version of the MacBook is getting the touchscreen, nor when this is supposed to happen. But the post builds on previous reports from Bloomberg’s Mark Gurman and Apple analyst Ming-Chi Kuo, with both previously stating that Apple is working on a touchscreen variant of the MacBook.

Rumors about such a device have circulated for years, though, and nothing ever came to fruition. Gurman’s report dates February 2026, and back then he said the initial batch of touch-enabled Macs are coming “this fall.” Gurman said the company would be pretty lax about the touchscreen, allowing the users to use it as much or as little they’d like, instead of positioning the Mac as a better version of the iPad.

SEE ALSO: Apple’s WWDC 2026 recap: What did Apple announce?

Apple is also rumored to launch a high-end “MacBook Ultra” later this year; this top-of-the-line device should come with Apple’s most powerful chips, an OLED display, and it might be the first one to be touch-enabled.

#Apples #touchscreen #MacBook #happening #report #claims

Amazon’s rolling out a free software update for Echo Hub devices that gives the home screen a much-needed update to the interface it launched with in 2024. It had already added Alex Plus AI support, but the new interface has a cleaner, fully customizable layout that fits more smart home info and controls on the screen than the previous version.

A small touchscreen tablet on a counter next to some flowers.

The Echo Hub is also getting access to Ring AI’s Video Search feature that lets you use natural language to search through your smart home camera footage, as well as Alexa Plus summaries of detected camera events.

These are the five new features Amazon highlighted for the Echo Hub:

Organize by r …

Read the full story at The Verge.

#Amazons #Echo #Hub #customizable #Rings #featuresAmazon,Amazon Alexa,News,Smart Home,Tech">Amazon’s Echo Hub gets a customizable new look and Ring’s AI features Amazon’s rolling out a free software update for Echo Hub devices that gives the home screen a much-needed update to the interface it launched with in 2024. It had already added Alex Plus AI support, but the new interface has a cleaner, fully customizable layout that fits more smart home info and controls on the screen than the previous version. The Echo Hub is also getting access to Ring AI’s Video Search feature that lets you use natural language to search through your smart home camera footage, as well as Alexa Plus summaries of detected camera events. These are the five new features Amazon highlighted for the Echo Hub: Organize by r … Read the full story at The Verge.#Amazons #Echo #Hub #customizable #Rings #featuresAmazon,Amazon Alexa,News,Smart Home,Tech

it launched with in 2024. It had already added Alex Plus AI support, but the new interface has a cleaner, fully customizable layout that fits more smart home info and controls on the screen than the previous version.

A small touchscreen tablet on a counter next to some flowers.

The Echo Hub is also getting access to Ring AI’s Video Search feature that lets you use natural language to search through your smart home camera footage, as well as Alexa Plus summaries of detected camera events.

These are the five new features Amazon highlighted for the Echo Hub:

Organize by r …

Read the full story at The Verge.

#Amazons #Echo #Hub #customizable #Rings #featuresAmazon,Amazon Alexa,News,Smart Home,Tech">Amazon’s Echo Hub gets a customizable new look and Ring’s AI features
Amazon’s Echo Hub gets a customizable new look and Ring’s AI features Amazon’s rolling out a free software update for Echo Hub devices that gives the home screen a much-needed update to the interface it launched with in 2024. It had already added Alex Plus AI support, but the new interface has a cleaner, fully customizable layout that fits more smart home info and controls on the screen than the previous version. The Echo Hub is also getting access to Ring AI’s Video Search feature that lets you use natural language to search through your smart home camera footage, as well as Alexa Plus summaries of detected camera events. These are the five new features Amazon highlighted for the Echo Hub: Organize by r … Read the full story at The Verge.#Amazons #Echo #Hub #customizable #Rings #featuresAmazon,Amazon Alexa,News,Smart Home,Tech

Amazon’s rolling out a free software update for Echo Hub devices that gives the home screen a much-needed update to the interface it launched with in 2024. It had already added Alex Plus AI support, but the new interface has a cleaner, fully customizable layout that fits more smart home info and controls on the screen than the previous version.

A small touchscreen tablet on a counter next to some flowers.

The Echo Hub is also getting access to Ring AI’s Video Search feature that lets you use natural language to search through your smart home camera footage, as well as Alexa Plus summaries of detected camera events.

These are the five new features Amazon highlighted for the Echo Hub:

Organize by r …

Read the full story at The Verge.

#Amazons #Echo #Hub #customizable #Rings #featuresAmazon,Amazon Alexa,News,Smart Home,Tech

Post Comment