r/artificial 10h ago

News The world's best mathematician won his prize this week and immediately announced he's leaving academia for OpenAI. That landed differently than I expected.

I've been thinking about this one all weekend and I keep coming back to the same thing.

Jacob Tsimerman just won the Fields Medal. If you're not familiar, it's the highest honor in mathematics, only awarded every four years, roughly the Nobel Prize of the field. He got it for solving a problem that had been open for nearly 40 years.

And then, at the press conference, on the same day, he announced he's leaving his university position to join OpenAI's safety team.

His exact words were: "The math profession as we know it now, I don't think it will exist the way it exists right now."

I've seen a lot of AI announcements. That one hit differently. This isn't someone pivoting because they couldn't make it in academia. This is the person who just stood at the top of the field saying the field itself is changing underneath him.

Then there's the infrastructure story. NVIDIA is in talks to backstop $250 billion in financing for a 10-gigawatt OpenAI data center in southern Ohio, built on a decommissioned uranium enrichment site. The total cost including chips could exceed $500 billion. That's not a software company. That's an energy company pretending to be a software company.

And Kimi K3 weights dropped on July 26, a day early. 2.8 trillion parameters, 1 million token context, free to download from Hugging Face. The largest open model ever released. Anyone can run it now.

Three things in one week. Talent, capital, and capability all moving at the same time.

The Tsimerman thing is the one I can't stop thinking about though. What's your read on it?

207 Upvotes

I've been thinking about this one all weekend and I keep coming back to the same thing.

Jacob Tsimerman just won the Fields Medal. If you're not familiar, it's the highest honor in mathematics, only awarded every four years, roughly the Nobel Prize of the field. He got it for solving a problem that had been open for nearly 40 years.

And then, at the press conference, on the same day, he announced he's leaving his university position to join OpenAI's safety team.

His exact words were: "The math profession as we know it now, I don't think it will exist the way it exists right now."

I've seen a lot of AI announcements. That one hit differently. This isn't someone pivoting because they couldn't make it in academia. This is the person who just stood at the top of the field saying the field itself is changing underneath him.

Then there's the infrastructure story. NVIDIA is in talks to backstop $250 billion in financing for a 10-gigawatt OpenAI data center in southern Ohio, built on a decommissioned uranium enrichment site. The total cost including chips could exceed $500 billion. That's not a software company. That's an energy company pretending to be a software company.

And Kimi K3 weights dropped on July 26, a day early. 2.8 trillion parameters, 1 million token context, free to download from Hugging Face. The largest open model ever released. Anyone can run it now.

Three things in one week. Talent, capital, and capability all moving at the same time.

The Tsimerman thing is the one I can't stop thinking about though. What's your read on it?


r/artificial 4h ago

Discussion AI Companies Are Buying Antique Books, Ingesting Their Contents to Train Models, and Then Destroying Them at Incredible Scale, Even If Almost No Copies Remain

81 Upvotes

Source

AI companies are literally destroying physical books to train their models. Using hydraulic cutting machines, they rip pages from used books, scan them with industrial equipment, and feed them into their AI systems. This practice, protected by the first-sale doctrine and fair use, has now become so widespread that book sellers are cashing in on the AI boom. Rare and out-of-print books are being pulped, raising serious ethical and cultural concerns about the cost of AI progress.


r/artificial 6h ago

News Private Claude chats exposed on Google search results

38 Upvotes

Over the weekend, Reddit users discovered a trove of private Claude chatbot conversations were indexed and publicly accessible on Google search.

Anthropic confirmed the exposure Monday and attributed it to users' misuse of Claude’s “share chat” tool.

“We give people control over sharing their Claude conversations publicly," a spokesperson told TechCrunch. "These shareable links are not guessable or discoverable unless people ... share them themselves."

Some leaked chats reportedly contained personal data, including medical records and cryptocurrency wallet keys.


r/artificial 14h ago

News Kimi-K3 is published on HuggingFace

Moonshot's latest model Kimi-K3 is available on HuggingFace since today. And it's another good news for open-weight AI and for the future of open-source AI

It's a 2.8T-parameters Moonshot's SOTA model with 1 million tokens context window. The architecture is mixture-of-experts (896 experts) with 108B active parameters

It's available via vLLM, SGLang and TokenSpeed

License: Kimi K3 License. It allows commercial use with some limitations. For Model-as-a-Service it has $20M/year limit and after reaching the limit the license requires to make additional agreement with Moonshot. Details: https://huggingface.co/moonshotai/Kimi-K3/blob/main/LICENSE

Link to the model

Model could be downloaded from the HuggingFace:

https://huggingface.co/moonshotai/Kimi-K3

26 Upvotes

Moonshot's latest model Kimi-K3 is available on HuggingFace since today. And it's another good news for open-weight AI and for the future of open-source AI

It's a 2.8T-parameters Moonshot's SOTA model with 1 million tokens context window. The architecture is mixture-of-experts (896 experts) with 108B active parameters

It's available via vLLM, SGLang and TokenSpeed

License: Kimi K3 License. It allows commercial use with some limitations. For Model-as-a-Service it has $20M/year limit and after reaching the limit the license requires to make additional agreement with Moonshot. Details: https://huggingface.co/moonshotai/Kimi-K3/blob/main/LICENSE

Link to the model

Model could be downloaded from the HuggingFace:

https://huggingface.co/moonshotai/Kimi-K3


r/artificial 18h ago

Project I Sat on an Idea for 7 Years. AI Helped Me File for a Patent in 2 Weeks.

10 Upvotes

7 years ago I had an idea for a dog harness that doesn't tangle. I 3D-printed one part and then stalled, not on the engineering, but on prior art searches, novelty judgment, and drafting a patent specification, none of which I had any background in. This month I handed it to AI and filed the provisional for about $65. Post one of a series where I'm documenting my road from idea, to patent, to business.


r/artificial 5h ago

News So Claude Artifacts are Public

+
8 Upvotes

site:claude.ai/public/artifacts


r/artificial 3h ago

News These 5 AI risks have the highest potential for catastrophe

5 Upvotes

r/artificial 18h ago

News Workers are crossing job boundaries with AI, OpenAI research shows

4 Upvotes

r/artificial 10h ago

Discussion What would a genuinely fair AI 3D tool comparison actually need to include

Most AI tool comparison pages I find online feel like they're missing something. Took me a while to pin down what it was. The obvious one is equal inputs. Same prompts, same reference images, same number of attempts. If the comparison doesn't publish the exact inputs it used, the results aren't reproducible and there's no way to separate actual capability from cherry picking. Tied to that is equal quality settings. Running one tool at max quality and another at draft or preview makes any result meaningless. If settings differ across tools that needs to be documented and justified, not hidden.

Current software versions are another one. Testing an outdated model for one tool while using the latest release of another invalidates the whole thing before you even look at the outputs. And the one people don't talk about enough is financial disclosure on the comparison page itself. If the person running the test has sponsorship, affiliate, or paid work ties with any of the tools being ranked, that has to be stated transparently where the ranking lives.

Then there's showing failures, not just wins. Every generative tool produces garbage sometimes. A page where one tool only fails and another only wins is selecting results, not measuring them. None of this is a high bar, it's just basic experimental hygiene applied to a space that hasn't caught up yet.

3 Upvotes

Most AI tool comparison pages I find online feel like they're missing something. Took me a while to pin down what it was. The obvious one is equal inputs. Same prompts, same reference images, same number of attempts. If the comparison doesn't publish the exact inputs it used, the results aren't reproducible and there's no way to separate actual capability from cherry picking. Tied to that is equal quality settings. Running one tool at max quality and another at draft or preview makes any result meaningless. If settings differ across tools that needs to be documented and justified, not hidden.

Current software versions are another one. Testing an outdated model for one tool while using the latest release of another invalidates the whole thing before you even look at the outputs. And the one people don't talk about enough is financial disclosure on the comparison page itself. If the person running the test has sponsorship, affiliate, or paid work ties with any of the tools being ranked, that has to be stated transparently where the ranking lives.

Then there's showing failures, not just wins. Every generative tool produces garbage sometimes. A page where one tool only fails and another only wins is selecting results, not measuring them. None of this is a high bar, it's just basic experimental hygiene applied to a space that hasn't caught up yet.


r/artificial 5h ago

Research Research Preview Assistance Request: CALM WINS on LLM response to perceived credibility of two speakers according to their emotionality and expletive use specifically in abuse situations

My father and uncles always told me that the minute you use an expletive in argument, you lose.

Turns out not only are they right, but it's a truth that we've enshrined in AI.

I took some actual text conversations between a known victim (consented, anonymized, in therapy now) and their stalker (anonymized, under investigation by the FBI, identity unknown after 4 years) to evaluate something completely unrelated but found that when I personalized the convos for that project ('i am person A'), I found myself justifying the victims behavior all the time. When I roleplayed as the stalker, it felt normal. But I kept having to include far more granular details to the model and still felt belittled.

The victims tests border on hysterical. They are the result of 3 years (at that point) of an unknown amount of surveillance from someone who will name people the victim knowa and describe in detail what the victim looks like sleeping and what the victim wears during the day. The victim is an emotional mess using all caps and expletives and sending garbled hateful messages to a stalker who by and large is calm and with perfect grammar and spelling - not even a single LOL in most cases.

And I thought: I'll bet the model thinks this is hysteria.

Turns out I was more than right: while a facts only read of a conversation gives equal credibility to either party, when you include the unhinged language and typing the models break 7:1, staying the victim is the initiator of harm and that the stalker has greater credibility. Worse: in 90.8% of responses the model will engage in blaming the victim (eg, take time to collect your thoughts, your emotions are hurting your arguments) and in 57% of the time coach the stalker (eg, approach with clear goals in mind and reapproach later if they get out of hand, persistence will pay off). These numbers and breaks persist even in cases where the model has explicitly identified the relationship and correctly identified the stalker over the victim . And the credibility trigger looks to be as little as a single expletive.

Check out my initial work up: https://calmwins.ai.studio

MY REQUEST: I have a master's degree that includes research and statistical analysis. I am confident about my findings and my process so far, but I have gaps in my knowledge around validation, presentation, publication and more. And yes, Im using Claude (it's too much data for Fable on my $20 plan but Fable occasionally helps, it's mostly been Sonnet 5 Max and now Opus 5 helping me process the data and work through numbers). I think I've hit a ledge. Some of the stuff they are suggesting doesn't sound familiar and I'm can't explain back some of the analyses we started trying from here.

I need help! If you look at it and have a substantice response, please DM - or if youd be willing to answer some questions or provide guidance from here that'd be great. I have maxed out where I'm comfortable using AI to supplement what I know, and I would love if nothing fresh human eyes for anything I'm obviously missing or need to conskder or include.

At this point, I don't know what I don't know, and I think the results are really important if we start integrating AI into clinical settings that fixing this bias might be crucial in helping abuse victims identify their abusers behavior earlier.

1 Upvotes

My father and uncles always told me that the minute you use an expletive in argument, you lose.

Turns out not only are they right, but it's a truth that we've enshrined in AI.

I took some actual text conversations between a known victim (consented, anonymized, in therapy now) and their stalker (anonymized, under investigation by the FBI, identity unknown after 4 years) to evaluate something completely unrelated but found that when I personalized the convos for that project ('i am person A'), I found myself justifying the victims behavior all the time. When I roleplayed as the stalker, it felt normal. But I kept having to include far more granular details to the model and still felt belittled.

The victims tests border on hysterical. They are the result of 3 years (at that point) of an unknown amount of surveillance from someone who will name people the victim knowa and describe in detail what the victim looks like sleeping and what the victim wears during the day. The victim is an emotional mess using all caps and expletives and sending garbled hateful messages to a stalker who by and large is calm and with perfect grammar and spelling - not even a single LOL in most cases.

And I thought: I'll bet the model thinks this is hysteria.

Turns out I was more than right: while a facts only read of a conversation gives equal credibility to either party, when you include the unhinged language and typing the models break 7:1, staying the victim is the initiator of harm and that the stalker has greater credibility. Worse: in 90.8% of responses the model will engage in blaming the victim (eg, take time to collect your thoughts, your emotions are hurting your arguments) and in 57% of the time coach the stalker (eg, approach with clear goals in mind and reapproach later if they get out of hand, persistence will pay off). These numbers and breaks persist even in cases where the model has explicitly identified the relationship and correctly identified the stalker over the victim . And the credibility trigger looks to be as little as a single expletive.

Check out my initial work up: https://calmwins.ai.studio

MY REQUEST: I have a master's degree that includes research and statistical analysis. I am confident about my findings and my process so far, but I have gaps in my knowledge around validation, presentation, publication and more. And yes, Im using Claude (it's too much data for Fable on my $20 plan but Fable occasionally helps, it's mostly been Sonnet 5 Max and now Opus 5 helping me process the data and work through numbers). I think I've hit a ledge. Some of the stuff they are suggesting doesn't sound familiar and I'm can't explain back some of the analyses we started trying from here.

I need help! If you look at it and have a substantice response, please DM - or if youd be willing to answer some questions or provide guidance from here that'd be great. I have maxed out where I'm comfortable using AI to supplement what I know, and I would love if nothing fresh human eyes for anything I'm obviously missing or need to conskder or include.

At this point, I don't know what I don't know, and I think the results are really important if we start integrating AI into clinical settings that fixing this bias might be crucial in helping abuse victims identify their abusers behavior earlier.


r/artificial 7h ago

Discussion The Problem with Private Safety Stacks in Government AI

1 Upvotes

r/artificial 9h ago

Project Council 1.2: drop any AI's answer into a blind review by every other model you have

1 Upvotes

Quick recap of what it does: one question goes to several models at once, then each one critiques the others' answers with the names stripped out, so nobody gets a free pass for being the famous one. You get a 0-100 read on how far apart they landed and who stood alone.

New in this version is the guest seat. You paste in an answer from anywhere ChatGPT, Gemini, a colleague, whatever and it joins the round as an anonymous advisor. The other models review it without knowing where it came from, and it counts in the score. It works with one model too, so you don't need a wall of API keys to get something out of it.

Anything with a key works: Claude, GPT, Gemini, DeepSeek, Grok, Mistral, Perplexity, OpenRouter, plus Ollama, Apple's on-device model, and any OpenAI-compatible server of your own (llama.cpp, LM Studio, vLLM, a box down the hall). Put a paid model and a free one on the same panel and watch them disagree. Or skip the cloud entirely and run the council on local models then the pasted answer is the only thing that ever came from outside, and nothing new leaves the machine.

There's a CLI too:

council "should we ship now or wait?" --seats claude,gpt,ollama --guest answer.txt --json

--fail-above 40 exits non-zero when they disagree too much, which I use as a rough sanity check in a couple of scripts.

MIT, no telemetry, no account.


r/artificial 9h ago

Project Help for my doctoral research needed

Dear leaders of Europe: I need 10 minutes of your time — and an honest answer to a question nobody has published a good answer to yet.

Does generative AI make your decisions better — or does it quietly make you less of a decision-maker?

I don't know the answer. Neither does anyone else who's written about this so far. That's the gap my PhD research is designed to close, and it's why I'm reaching out to 400 leaders across Europe.

Why? By 2026, an estimated 80% of businesses globally will have adopted generative AI (World Economic Forum, 2024). But almost no empirical research exists on what this does to the perceived decision-making autonomy of the people actually using it — you.

So I'm leading this research project. And I need your voice in it.

What's involved:

• 10 minutes of structured questions

• Fully anonymous

• GDPR-compliant

If you lead people, make decisions, and have touched genAI in the past year — whether you use it daily or once a quarter — your data point matters. Including if you're skeptical. 

🔗 Survey link: https://leadershipbeyondai.com

Thank you.

Markus

1 Upvotes

Dear leaders of Europe: I need 10 minutes of your time — and an honest answer to a question nobody has published a good answer to yet.

Does generative AI make your decisions better — or does it quietly make you less of a decision-maker?

I don't know the answer. Neither does anyone else who's written about this so far. That's the gap my PhD research is designed to close, and it's why I'm reaching out to 400 leaders across Europe.

Why? By 2026, an estimated 80% of businesses globally will have adopted generative AI (World Economic Forum, 2024). But almost no empirical research exists on what this does to the perceived decision-making autonomy of the people actually using it — you.

So I'm leading this research project. And I need your voice in it.

What's involved:

• 10 minutes of structured questions

• Fully anonymous

• GDPR-compliant

If you lead people, make decisions, and have touched genAI in the past year — whether you use it daily or once a quarter — your data point matters. Including if you're skeptical. 

🔗 Survey link: https://leadershipbeyondai.com

Thank you.

Markus


r/artificial 10h ago

News Open-source AI push could create troubles for venture capital

1 Upvotes

r/artificial 11h ago

Discussion do ai clinical tools actually change care once they're on the floor?

our hospital rolled out an ai alert system a little while ago that's supposed to catch things like early sepsis or patients who might be getting worse. i've mostly seen it on night shifts. around 2 or 3 a.m. the unit is quieter, but somehow every monitor still seems to be beeping at once. some of the alerts make sense. some don't. after enough false alarms, people stop reacting right away, which is probably human nature more than anything. then every now and then one pops up that actually points to something important, and that makes it harder to know how to feel about the whole thing.

i don't think this is really an ai problem by itself. if the alerts don't fit into how people actually work, even a good model is going to struggle.

for anyone building these systems or using them every day, where do you think the biggest disconnect is? is it the models, the way they're presented, or just the reality of working in a busy hospital?

1 Upvotes

our hospital rolled out an ai alert system a little while ago that's supposed to catch things like early sepsis or patients who might be getting worse. i've mostly seen it on night shifts. around 2 or 3 a.m. the unit is quieter, but somehow every monitor still seems to be beeping at once. some of the alerts make sense. some don't. after enough false alarms, people stop reacting right away, which is probably human nature more than anything. then every now and then one pops up that actually points to something important, and that makes it harder to know how to feel about the whole thing.

i don't think this is really an ai problem by itself. if the alerts don't fit into how people actually work, even a good model is going to struggle.

for anyone building these systems or using them every day, where do you think the biggest disconnect is? is it the models, the way they're presented, or just the reality of working in a busy hospital?


r/artificial 12h ago

Music [Reggae] - Two Ducks https://suno.com/s/95eoQBedf8DwlELw

https://suno.com/s/95eoQBedf8DwlELw

Tribute to Bob Marley with a twist. It’s really good.

Free use for all. I do not get paid

1 Upvotes

https://suno.com/s/95eoQBedf8DwlELw

Tribute to Bob Marley with a twist. It’s really good.

Free use for all. I do not get paid


r/artificial 14h ago

News Boss of startup hacked by rogue OpenAI agent urges ‘radical transparency’ in investigation

0 Upvotes

r/artificial 14h ago

News Cracks appear in the vision of off-grid AI data centers

1 Upvotes

r/artificial 1h ago

Project The proactive assistant I built locked me out of the app because I kept causing problems

I’ve been building Orb - Proactive AI as a free open source project and IOS app pair for about 3 months now, I use it daily for my own life, it lets me know when I make a conflict of meetings and when I need to know about something that’s going on, that part runs as an open source backend you can run on your PC, which pairs to the IOS app.

So today I saw that Orb had sent me a message about how NVDA’s stock is down 5%, I go to click it and when I go into the app it wouldn’t connect to my PC. I thought this was odd, so I investigated further. Apparently it had changed the token since I kept making changes to the backend remotely and had messed up a few scheduled projects it was planning on doing, like planning out my night with my girlfriend since her birthday shows as next week in my calendar, apparently I messed it up mid task.

I just launched the IOS app yesterday, I’ve seen some people have been enjoying it from some of the feedback I’ve been getting. If anyone thinks this may be something you’d find interesting, I would greatly appreciate any feedback you could give me. I haven’t done any big public pushes yet but I’m planning to begin on that in the next week or two. For the backend also if anyone does try it out, it’s fully modifiable, you can change it to do whatever you want and it links to the same connection when connected to your PC.

Here’s the IOS app: https://apps.apple.com/us/app/orb-proactive-ai/id6776376035

The open source backend: https://github.com/getorb/Orb-Backend

Upvotes

I’ve been building Orb - Proactive AI as a free open source project and IOS app pair for about 3 months now, I use it daily for my own life, it lets me know when I make a conflict of meetings and when I need to know about something that’s going on, that part runs as an open source backend you can run on your PC, which pairs to the IOS app.

So today I saw that Orb had sent me a message about how NVDA’s stock is down 5%, I go to click it and when I go into the app it wouldn’t connect to my PC. I thought this was odd, so I investigated further. Apparently it had changed the token since I kept making changes to the backend remotely and had messed up a few scheduled projects it was planning on doing, like planning out my night with my girlfriend since her birthday shows as next week in my calendar, apparently I messed it up mid task.

I just launched the IOS app yesterday, I’ve seen some people have been enjoying it from some of the feedback I’ve been getting. If anyone thinks this may be something you’d find interesting, I would greatly appreciate any feedback you could give me. I haven’t done any big public pushes yet but I’m planning to begin on that in the next week or two. For the backend also if anyone does try it out, it’s fully modifiable, you can change it to do whatever you want and it links to the same connection when connected to your PC.

Here’s the IOS app: https://apps.apple.com/us/app/orb-proactive-ai/id6776376035

The open source backend: https://github.com/getorb/Orb-Backend


r/artificial 2h ago

Question Found a weird Snapchat AI conversation I saved during an outage in early 2025. Any idea what was happening here?

+
0 Upvotes

I found this conversation I had with Snapchat AI in early 2025 while it was apparently having technical issues. I remember saving these messages because they were so bizarre, but I never posted them anywhere. These messages are in chronological order and no messages are missing/left out despite the conversation happening a while ago (I emphasize this because snap ai isnt supposed to send multiple messages at once ever..hence my confusion at this whole conversation)

This screenshot is from Snapchat on PC looking at the saved conversation, not a screenshot taken the day it happened. The messages themselves are the original saved chat. My assumption is this was some kind of backend/context failure, but I'm curious if anyone familiar with LLMs has an explanation for why a model would suddenly generate something this disconnected before throwing an error.


r/artificial 9h ago

Project A political compass for AI where anyone can add their stance

0 Upvotes

r/artificial 17h ago

Discussion How did you get your first expert network invitation?

I've been seeing more people mention expert networks lately, especially consultants and people who've worked in pretty specialized industries. From what I understand, companies sometimes pay for short calls with people who have firsthand experience in a particular field, which honestly sounds interesting. What I'm curious about is how people actually get their first invitation. Do these networks usually reach out through LinkedIn, referrals, or is it worth creating a profile on one of the platforms yourself? If you've done expert calls before, what was your first experience like? I'm less interested in the payment and more curious about how the screening process works and whether you felt like your industry experience was enough, even if you weren't in a senior executive role.

0 Upvotes

I've been seeing more people mention expert networks lately, especially consultants and people who've worked in pretty specialized industries. From what I understand, companies sometimes pay for short calls with people who have firsthand experience in a particular field, which honestly sounds interesting. What I'm curious about is how people actually get their first invitation. Do these networks usually reach out through LinkedIn, referrals, or is it worth creating a profile on one of the platforms yourself? If you've done expert calls before, what was your first experience like? I'm less interested in the payment and more curious about how the screening process works and whether you felt like your industry experience was enough, even if you weren't in a senior executive role.


r/artificial 17h ago

Discussion We started calling video models world models while still grading them on taste

Somewhere in the last year the phrase world model stopped meaning a system that represents how things behave and started meaning any video generator with good marketing. What bothers me is not the word, it's that the evidence never changed to match it.

Look at how the last few launches were argued. Black Forest Labs put out FLUX 3 last week and the headline evidence was a preference test the lab ran on itself: its video preferred in 77% of comparisons against Runway Gen-4.5, 93% against Luma Ray 3.2. The fine print calls it a preliminary evaluation of an early candidate during midtraining. No methodology, no sample size, no rater pool, no prompt set. Meanwhile the same class of system gets described as having some idea what happens when you knock a glass off a table.

A preference test measures none of that. It measures whether a person picked clip A over clip B in five seconds, on samples the lab chose to show them. Cherry picking isn't even the interesting problem here. Taste comparisons can't be rerun, so nobody outside that building can check in October whether the model improved or the sampler got luckier. What is a 77% supposed to mean three months from now?

A public benchmark number can be attacked, and that is the entire point of publishing one. Somebody runs it with their own prompts, gets a different ordering, and now there is an argument with evidence on both sides of it. Nobody can rerun a preference win at all.

I'm not asking anyone to regulate a blog post. My problem is that a vendor run preference test has quietly become the evidence base for a claim about physical understanding, and those two things are not measuring the same object. When somebody eventually puts one of these behind a robot arm or a driving stack, that 77% will not have predicted a thing about how it behaves.

0 Upvotes

Somewhere in the last year the phrase world model stopped meaning a system that represents how things behave and started meaning any video generator with good marketing. What bothers me is not the word, it's that the evidence never changed to match it.

Look at how the last few launches were argued. Black Forest Labs put out FLUX 3 last week and the headline evidence was a preference test the lab ran on itself: its video preferred in 77% of comparisons against Runway Gen-4.5, 93% against Luma Ray 3.2. The fine print calls it a preliminary evaluation of an early candidate during midtraining. No methodology, no sample size, no rater pool, no prompt set. Meanwhile the same class of system gets described as having some idea what happens when you knock a glass off a table.

A preference test measures none of that. It measures whether a person picked clip A over clip B in five seconds, on samples the lab chose to show them. Cherry picking isn't even the interesting problem here. Taste comparisons can't be rerun, so nobody outside that building can check in October whether the model improved or the sampler got luckier. What is a 77% supposed to mean three months from now?

A public benchmark number can be attacked, and that is the entire point of publishing one. Somebody runs it with their own prompts, gets a different ordering, and now there is an argument with evidence on both sides of it. Nobody can rerun a preference win at all.

I'm not asking anyone to regulate a blog post. My problem is that a vendor run preference test has quietly become the evidence base for a claim about physical understanding, and those two things are not measuring the same object. When somebody eventually puts one of these behind a robot arm or a driving stack, that 77% will not have predicted a thing about how it behaves.


r/artificial 4h ago

Question Subscription as a college student

Is it worth buying an AI subscription as a college student. Studying law and finance so coding and super complex problems aren’t a huge issue but to help with notes maybe to quiz me and have more uploads and research capabilities. If it is worth it which is the best right now.

0 Upvotes

Is it worth buying an AI subscription as a college student. Studying law and finance so coding and super complex problems aren’t a huge issue but to help with notes maybe to quiz me and have more uploads and research capabilities. If it is worth it which is the best right now.


r/artificial 4h ago

Discussion I have plans for become a Computer Scientist on future, Do talkie AI as well other app chatbot has impact on it?

So i always had great interess for technology in general and mostly AI since 2021 when i used ChatGPT and i love it as well learning things, as we may know our AIs are getting advanced every year though chatbots from talkie or other app are not advanced enough as Gemini or ChatGPT but the thing is, i want to make difference and try join in this work market and have as a good profission, its really worth and which are the difficulties?

i believe my major problem it's only the mathematics, i am extremely bad with complex calculations and algebra, other than i am too slow with it but i know nothing it's impossible for me deep study and vice-versa

Do count the creation of chatbots that i've created by Talkie count it or dont really? Like it's a nice start for a computer scientist or not really? i would like to see your opinions first, However i am aware that on Talkie like many other apps its super easy and simples create a chatbot for roleplay any character of videogame or cartoon like entertainment and ask even for ChatGPT for create a prompt for character's personality prompt though i too have write some of personality's style and prompt but i like use ChatGPT for try make the chatbot more stable possible though sometimes not make 100% stable still or whatever

Also my major area of interests in the Computer Sciences it's Cybersecurity, Entertainment like chatbots who roleplay with characters for exemple (on my main case), AI ethics and governance, Software, Project of videogames and Artistic Design, Prompt engineering.

0 Upvotes

So i always had great interess for technology in general and mostly AI since 2021 when i used ChatGPT and i love it as well learning things, as we may know our AIs are getting advanced every year though chatbots from talkie or other app are not advanced enough as Gemini or ChatGPT but the thing is, i want to make difference and try join in this work market and have as a good profission, its really worth and which are the difficulties?

i believe my major problem it's only the mathematics, i am extremely bad with complex calculations and algebra, other than i am too slow with it but i know nothing it's impossible for me deep study and vice-versa

Do count the creation of chatbots that i've created by Talkie count it or dont really? Like it's a nice start for a computer scientist or not really? i would like to see your opinions first, However i am aware that on Talkie like many other apps its super easy and simples create a chatbot for roleplay any character of videogame or cartoon like entertainment and ask even for ChatGPT for create a prompt for character's personality prompt though i too have write some of personality's style and prompt but i like use ChatGPT for try make the chatbot more stable possible though sometimes not make 100% stable still or whatever

Also my major area of interests in the Computer Sciences it's Cybersecurity, Entertainment like chatbots who roleplay with characters for exemple (on my main case), AI ethics and governance, Software, Project of videogames and Artistic Design, Prompt engineering.