×
A new AI coding challenge just published its first results – and they aren’t pretty | TechCrunch

A new AI coding challenge just published its first results – and they aren’t pretty | TechCrunch

A new AI coding challenge has revealed its first winner — and set a new bar for AI-powered software engineers. 

On Wednesday at 5pm PST, the nonprofit Laude Institute announced the first winner of the K Prize, a multi-round AI coding challenge launched by Databricks and Perplexity co-founder Andy Konwinski. The winner was a Brazilian prompt engineer named Eduardo Rocha de Andrade, who will receive $50,000 for the prize. But more surprising than the win was his final score: he won with correct answers to just 7.5% of the questions on the test.

“We’re glad we built a benchmark that is actually hard,” said Konwinski. “Benchmarks should be hard if they’re going to matter,” he continued, adding: “Scores would be different if the big labs had entered with their biggest models. But that’s kind of the point. K Prize runs offline with limited compute, so it favors smaller and open models. I love that. It levels the playing field.”

Konwinski has pledged $1 million to the first open-source model that can score higher than 90% on the test.

Similar to the well-known SWE-Bench system, the K Prize tests models against flagged issues from GitHub as a test of how well models can deal with real-world programming problems. But while SWE-Bench is based on a fixed set of problems that models can train against, the K Prize is designed as a “contamination-free version of SWE-Bench,” using a timed entry system to guard against any benchmark-specific training. For round one, models were due by March 12th. The K Prize organizers then built the test using only GitHub issues flagged after that date.

The 7.5% top score stands in marked contrast to SWE-Bench itself, which currently shows a 75% top score on its easier ‘Verified’ test and 34% on its harder ‘Full’ test. Konwinski still isn’t sure whether the disparity is due to contamination on SWE-Bench or just the challenge of collecting new issues from GitHub, but he expects the K Prize project to answer the question soon.

“As we get more runs of the thing, we’ll have a better sense,” he told TechCrunch, “because we expect people to adapt to the dynamics of competing on this every few months.”

Techcrunch event

San Francisco
|
October 27-29, 2025

It might seem like an odd place to fall short, given the wide range of AI coding tools already publicly available – but with benchmarks becoming too easy, many critics see projects like the K Prize as a necessary step toward solving AI’s growing evaluation problem.

“I’m quite bullish about building new tests for existing benchmarks,” says Princeton researcher Sayash Kapoor, who put forward a similar idea in a recent paper. “Without such experiments, we can’t actually tell if the issue is contamination, or even just targeting the SWE-Bench leaderboard with a human in the loop.”

For Konwinski, it’s not just a better benchmark, but an open challenge to the rest of the industry. “If you listen to the hype, it’s like we should be seeing AI doctors and AI lawyers and AI software engineers, and that’s just not true,” he says. “If we can’t even get more than 10% on a contamination free SWE-Bench, that’s the reality check for me.”

Source link
#coding #challenge #published #results #arent #pretty #TechCrunch


Not so long ago, the name Midjourney was synonymous with AI imagery. (Remember that brief period when everyone you knew was using an AI-generated selfie on social media?) Now the company is attempting to rebrand itself as a wellness brand.

In a blog post published Wednesday, titled “A New Era for Midjourney,” the company described its plans for a new project, which it said is “a little weird and a little crazy, but also spectacular and filled with hope.” For starters, it’s working on a body scanner technology, which it says will be faster, cheaper, and less invasive than an MRI. The experience they have in mind sounds like a blend between Han Solo being lowered into the pit at Jabba’s Palace before getting blasted with carbonite and an ayahuasca trip report. Here’s how Midjourney describes it in their blog post:

It starts by stepping into a shallow pool of golden light. You then begin to descend into the water. Your body passes through a ring of underwater sensors, each acting like a dolphin, using its echolocation. The sensors send ultrasonic sound waves through your body from every angle. With enough waves, and enough angles, we form an image of what’s happening inside your body.

All of this should take no more than a minute, the blog post added.

Midjourney envisions a ring of half a million sensors within the scanner, each about the size of a grain of sand, blasting ultrasonic waves at your body and using the reverberations to create a detailed 3-D map of what’s happening inside. “Envisions” is the key word, there: The announcement didn’t make clear what stage of R&D the scanner is currently in, but it did admit that the company still needs to figure out a “major computational task,” namely, how to transform all those noisy waves into static images.

The process will reportedly harvest “terabytes of data each second,” based on the idea that the more information you collect about your body, the clearer and more complete a picture you can build of your individual health profile.

“You want as much data as you can get about your health as quickly and as cheaply as possible,” the company wrote. “In other words, you want a technology optimized for getting as many megabytes per second per dollar of information about your body.”

Midjourney is going to great lengths to contrast its body scanner with MRIs, which—as anyone who’s had to go into one will already know—aren’t particularly comfortable. In fact, the company is going so far as to make its scanning technology the centerpiece of a new spa, which it plans to open in downtown San Francisco before the end of next year.

It’s here that the “a little weird” part starts to feel like a pretty monumental understatement. The Midjourney Spa, as it’s being called, will have the typical accouterments of a high-end spa, like hot tubs and cold plunges, along with “cozy rooms with pools of golden light which softly scan your body.” Midjourney says the spa will be open 24/7 and will be so comfortable, so inviting, as to make guests almost completely forget about the fact that their insides are being scanned by millions of tiny, ultrasonic sensors.

“The scans are a side-effect,” the company wrote. “You barely think of them when going to the spa. But suddenly, you have a huge library of data about your health.”

The announcement added that Midjourney aims to open additional spas in more cities beginning in 2028, and that the company’s next step will be to submit early test results from its body-scanning device to the FDA in the hopes of getting regulatory clearance to build devices with “increased capabilities.”

#Remember #Midjourney #Building #Medical #Scanning #Device #Cheaper #MRIAI,AI images,Health,Midjourney,San Francisco">Remember Midjourney? It’s Building a Medical Scanning Device That It Says Is Cheaper Than an MRI
                Not so long ago, the name Midjourney was synonymous with AI imagery. (Remember that brief period when everyone you knew was using an AI-generated selfie on social media?) Now the company is attempting to rebrand itself as a wellness brand. In a blog post published Wednesday, titled “A New Era for Midjourney,” the company described its plans for a new project, which it said is “a little weird and a little crazy, but also spectacular and filled with hope.” For starters, it’s working on a body scanner technology, which it says will be faster, cheaper, and less invasive than an MRI. The experience they have in mind sounds like a blend between Han Solo being lowered into the pit at Jabba’s Palace before getting blasted with carbonite and an ayahuasca trip report. Here’s how Midjourney describes it in their blog post: It starts by stepping into a shallow pool of golden light. You then begin to descend into the water. Your body passes through a ring of underwater sensors, each acting like a dolphin, using its echolocation. The sensors send ultrasonic sound waves through your body from every angle. With enough waves, and enough angles, we form an image of what’s happening inside your body. All of this should take no more than a minute, the blog post added. Midjourney envisions a ring of half a million sensors within the scanner, each about the size of a grain of sand, blasting ultrasonic waves at your body and using the reverberations to create a detailed 3-D map of what’s happening inside. “Envisions” is the key word, there: The announcement didn’t make clear what stage of R&D the scanner is currently in, but it did admit that the company still needs to figure out a “major computational task,” namely, how to transform all those noisy waves into static images. The process will reportedly harvest “terabytes of data each second,” based on the idea that the more information you collect about your body, the clearer and more complete a picture you can build of your individual health profile.

 “You want as much data as you can get about your health as quickly and as cheaply as possible,” the company wrote. “In other words, you want a technology optimized for getting as many megabytes per second per dollar of information about your body.”

 Midjourney is going to great lengths to contrast its body scanner with MRIs, which—as anyone who’s had to go into one will already know—aren’t particularly comfortable. In fact, the company is going so far as to make its scanning technology the centerpiece of a new spa, which it plans to open in downtown San Francisco before the end of next year. It’s here that the “a little weird” part starts to feel like a pretty monumental understatement. The Midjourney Spa, as it’s being called, will have the typical accouterments of a high-end spa, like hot tubs and cold plunges, along with “cozy rooms with pools of golden light which softly scan your body.” Midjourney says the spa will be open 24/7 and will be so comfortable, so inviting, as to make guests almost completely forget about the fact that their insides are being scanned by millions of tiny, ultrasonic sensors.

 “The scans are a side-effect,” the company wrote. “You barely think of them when going to the spa. But suddenly, you have a huge library of data about your health.” The announcement added that Midjourney aims to open additional spas in more cities beginning in 2028, and that the company’s next step will be to submit early test results from its body-scanning device to the FDA in the hopes of getting regulatory clearance to build devices with “increased capabilities.”      #Remember #Midjourney #Building #Medical #Scanning #Device #Cheaper #MRIAI,AI images,Health,Midjourney,San Francisco

blog post published Wednesday, titled “A New Era for Midjourney,” the company described its plans for a new project, which it said is “a little weird and a little crazy, but also spectacular and filled with hope.” For starters, it’s working on a body scanner technology, which it says will be faster, cheaper, and less invasive than an MRI. The experience they have in mind sounds like a blend between Han Solo being lowered into the pit at Jabba’s Palace before getting blasted with carbonite and an ayahuasca trip report. Here’s how Midjourney describes it in their blog post:

It starts by stepping into a shallow pool of golden light. You then begin to descend into the water. Your body passes through a ring of underwater sensors, each acting like a dolphin, using its echolocation. The sensors send ultrasonic sound waves through your body from every angle. With enough waves, and enough angles, we form an image of what’s happening inside your body.

All of this should take no more than a minute, the blog post added.

Midjourney envisions a ring of half a million sensors within the scanner, each about the size of a grain of sand, blasting ultrasonic waves at your body and using the reverberations to create a detailed 3-D map of what’s happening inside. “Envisions” is the key word, there: The announcement didn’t make clear what stage of R&D the scanner is currently in, but it did admit that the company still needs to figure out a “major computational task,” namely, how to transform all those noisy waves into static images.

The process will reportedly harvest “terabytes of data each second,” based on the idea that the more information you collect about your body, the clearer and more complete a picture you can build of your individual health profile.

“You want as much data as you can get about your health as quickly and as cheaply as possible,” the company wrote. “In other words, you want a technology optimized for getting as many megabytes per second per dollar of information about your body.”

Midjourney is going to great lengths to contrast its body scanner with MRIs, which—as anyone who’s had to go into one will already know—aren’t particularly comfortable. In fact, the company is going so far as to make its scanning technology the centerpiece of a new spa, which it plans to open in downtown San Francisco before the end of next year.

It’s here that the “a little weird” part starts to feel like a pretty monumental understatement. The Midjourney Spa, as it’s being called, will have the typical accouterments of a high-end spa, like hot tubs and cold plunges, along with “cozy rooms with pools of golden light which softly scan your body.” Midjourney says the spa will be open 24/7 and will be so comfortable, so inviting, as to make guests almost completely forget about the fact that their insides are being scanned by millions of tiny, ultrasonic sensors.

“The scans are a side-effect,” the company wrote. “You barely think of them when going to the spa. But suddenly, you have a huge library of data about your health.”

The announcement added that Midjourney aims to open additional spas in more cities beginning in 2028, and that the company’s next step will be to submit early test results from its body-scanning device to the FDA in the hopes of getting regulatory clearance to build devices with “increased capabilities.”

#Remember #Midjourney #Building #Medical #Scanning #Device #Cheaper #MRIAI,AI images,Health,Midjourney,San Francisco">Remember Midjourney? It’s Building a Medical Scanning Device That It Says Is Cheaper Than an MRIRemember Midjourney? It’s Building a Medical Scanning Device That It Says Is Cheaper Than an MRI
                Not so long ago, the name Midjourney was synonymous with AI imagery. (Remember that brief period when everyone you knew was using an AI-generated selfie on social media?) Now the company is attempting to rebrand itself as a wellness brand. In a blog post published Wednesday, titled “A New Era for Midjourney,” the company described its plans for a new project, which it said is “a little weird and a little crazy, but also spectacular and filled with hope.” For starters, it’s working on a body scanner technology, which it says will be faster, cheaper, and less invasive than an MRI. The experience they have in mind sounds like a blend between Han Solo being lowered into the pit at Jabba’s Palace before getting blasted with carbonite and an ayahuasca trip report. Here’s how Midjourney describes it in their blog post: It starts by stepping into a shallow pool of golden light. You then begin to descend into the water. Your body passes through a ring of underwater sensors, each acting like a dolphin, using its echolocation. The sensors send ultrasonic sound waves through your body from every angle. With enough waves, and enough angles, we form an image of what’s happening inside your body. All of this should take no more than a minute, the blog post added. Midjourney envisions a ring of half a million sensors within the scanner, each about the size of a grain of sand, blasting ultrasonic waves at your body and using the reverberations to create a detailed 3-D map of what’s happening inside. “Envisions” is the key word, there: The announcement didn’t make clear what stage of R&D the scanner is currently in, but it did admit that the company still needs to figure out a “major computational task,” namely, how to transform all those noisy waves into static images. The process will reportedly harvest “terabytes of data each second,” based on the idea that the more information you collect about your body, the clearer and more complete a picture you can build of your individual health profile.

 “You want as much data as you can get about your health as quickly and as cheaply as possible,” the company wrote. “In other words, you want a technology optimized for getting as many megabytes per second per dollar of information about your body.”

 Midjourney is going to great lengths to contrast its body scanner with MRIs, which—as anyone who’s had to go into one will already know—aren’t particularly comfortable. In fact, the company is going so far as to make its scanning technology the centerpiece of a new spa, which it plans to open in downtown San Francisco before the end of next year. It’s here that the “a little weird” part starts to feel like a pretty monumental understatement. The Midjourney Spa, as it’s being called, will have the typical accouterments of a high-end spa, like hot tubs and cold plunges, along with “cozy rooms with pools of golden light which softly scan your body.” Midjourney says the spa will be open 24/7 and will be so comfortable, so inviting, as to make guests almost completely forget about the fact that their insides are being scanned by millions of tiny, ultrasonic sensors.

 “The scans are a side-effect,” the company wrote. “You barely think of them when going to the spa. But suddenly, you have a huge library of data about your health.” The announcement added that Midjourney aims to open additional spas in more cities beginning in 2028, and that the company’s next step will be to submit early test results from its body-scanning device to the FDA in the hopes of getting regulatory clearance to build devices with “increased capabilities.”      #Remember #Midjourney #Building #Medical #Scanning #Device #Cheaper #MRIAI,AI images,Health,Midjourney,San Francisco

Not so long ago, the name Midjourney was synonymous with AI imagery. (Remember that brief period when everyone you knew was using an AI-generated selfie on social media?) Now the company is attempting to rebrand itself as a wellness brand.

In a blog post published Wednesday, titled “A New Era for Midjourney,” the company described its plans for a new project, which it said is “a little weird and a little crazy, but also spectacular and filled with hope.” For starters, it’s working on a body scanner technology, which it says will be faster, cheaper, and less invasive than an MRI. The experience they have in mind sounds like a blend between Han Solo being lowered into the pit at Jabba’s Palace before getting blasted with carbonite and an ayahuasca trip report. Here’s how Midjourney describes it in their blog post:

It starts by stepping into a shallow pool of golden light. You then begin to descend into the water. Your body passes through a ring of underwater sensors, each acting like a dolphin, using its echolocation. The sensors send ultrasonic sound waves through your body from every angle. With enough waves, and enough angles, we form an image of what’s happening inside your body.

All of this should take no more than a minute, the blog post added.

Midjourney envisions a ring of half a million sensors within the scanner, each about the size of a grain of sand, blasting ultrasonic waves at your body and using the reverberations to create a detailed 3-D map of what’s happening inside. “Envisions” is the key word, there: The announcement didn’t make clear what stage of R&D the scanner is currently in, but it did admit that the company still needs to figure out a “major computational task,” namely, how to transform all those noisy waves into static images.

The process will reportedly harvest “terabytes of data each second,” based on the idea that the more information you collect about your body, the clearer and more complete a picture you can build of your individual health profile.

“You want as much data as you can get about your health as quickly and as cheaply as possible,” the company wrote. “In other words, you want a technology optimized for getting as many megabytes per second per dollar of information about your body.”

Midjourney is going to great lengths to contrast its body scanner with MRIs, which—as anyone who’s had to go into one will already know—aren’t particularly comfortable. In fact, the company is going so far as to make its scanning technology the centerpiece of a new spa, which it plans to open in downtown San Francisco before the end of next year.

It’s here that the “a little weird” part starts to feel like a pretty monumental understatement. The Midjourney Spa, as it’s being called, will have the typical accouterments of a high-end spa, like hot tubs and cold plunges, along with “cozy rooms with pools of golden light which softly scan your body.” Midjourney says the spa will be open 24/7 and will be so comfortable, so inviting, as to make guests almost completely forget about the fact that their insides are being scanned by millions of tiny, ultrasonic sensors.

“The scans are a side-effect,” the company wrote. “You barely think of them when going to the spa. But suddenly, you have a huge library of data about your health.”

The announcement added that Midjourney aims to open additional spas in more cities beginning in 2028, and that the company’s next step will be to submit early test results from its body-scanning device to the FDA in the hopes of getting regulatory clearance to build devices with “increased capabilities.”

#Remember #Midjourney #Building #Medical #Scanning #Device #Cheaper #MRIAI,AI images,Health,Midjourney,San Francisco

Samsung The Frame Pro 2026: The Best Art Television You Can BuyOn the Netflix show Legends, AI processing was used to enhance a dimly lit office scene to bring up the contrast. I had a similar experience watching scenes from Awake on Netflix, which takes place mostly at night. I could still see the main characters even in darker areas of the scene. YouTube videos of WIRED interviews looked clear and colorful as well. In comparison, low-cost televisions seem more like a computer display with stark bright colors playing the same clips.Samsung also leveraged AI to improve sound quality. In time for the World Cup, Samsung’s new AI audio feature helps enhance the volume of the broadcaster voices while lowering distracting crowd noises when watching soccer matches. For movies, the AI Sound Controller Pro sliders can help boost voices and reduce the volume of background music, but the experience is still buggy. While I could adjust the sliders, they’d always revert back to the default settings. Still, with Dolby Atmos support, I found myself immersed in the experience as audio emanated from around the room when watching Unbroken.There were also several glitches I’ve noticed in testing. AirPlay worked fine, but when trying to use Google Cast to stream Alien: Romulus on HBO Max from my Android phone, an error occurred. Cloud gaming on GeForce NOW also presented with a bug that prevented me from authenticating with the service. Samsung reps are looking into these issues.Despite the bugs, I’m convinced that The Frame Pro is a capable gaming display. Gamers looking to connect a console or gaming PC can use the Mini HDMI port on the rear of the television or the Wireless One Connect box. Both support refresh rates up to 240 Hz. I’m not a competitive gamer, so I stuck with the breakout box to connect my PC. I was amazed at Crimson Desert’s stutter-free performance. Everything looked rich and vibrant—there were also no delays using an Xbox controller.I also tested the Aphelion using the Xbox Cloud Gaming app for console-free gaming. Other than slight stuttering due to lag, it all worked fine. Senua’s Saga: Hellblade II, a game that typically looks washed out on some competing TVs and projectors, appears vibrant on the screen.The Frame Pro 2026 is an exceptional art television, and it’s among the best I’ve tested. Improvements to the Tizen OS, matte finish with anti-glare coating, and AI enhancements make it even more appealing. My only slight pause is the price. The Amazon Ember Artline also looks stunning and costs about 0 less. But The Frame Pro is the one you want for absolute realism and vivid colors.#Samsung #Frame #Pro #Art #Television #Buysamsung,review,televisions,tv,shopping

Post Comment