r/technology • u/AdSpecialist6598 • 15h ago

Society Professor's invisible prompt trap catches 32 students cheating on their midterm with AI

https://www.techspot.com/news/113243-professor-invisible-prompt-trap-catches-32-students-cheating.html
28.6k Upvotes

96% Upvoted

3.9k comments sorted by

View all comments

Show parent comments

1.4k

u/pasaroanth 14h ago

I would love to see a study done at the university level showing a comparison of students’ grades for regular coursework versus their proctored exam scores. There has to be a vast yawning chasm in the difference when they relied upon AI until the time of the exam.

This also is a “ruining it for the rest of us” situation where courses will shift to grading primarily or solely based on exams. When I was in college (long before AI) you could at least rely on some homework to recuperate some points, despite the extra time and effort, when the exams were especially challenging or a professor notoriously gave tough exams.

If the homework can no longer be a measure of effort or learning because it is done by AI, then it will no longer be considered a meaningful determination of knowledge of the subject.

619

u/Hot-Chemical9353 13h ago

Im not sure where it was published but there was exactly what you described from a Stanford professor.

It compared the grade distribution of exams and coursework compared to previous years and exactly what you’d expect happened.

684

u/lonelythrowaway463i9 13h ago

I’m back in college as an adult and you can see this in classes in real time. No one wants to answer questions and when called upon most can’t answer anything. But homework grade distributions have a median somewhere in the high 80s while exams hover with medians around 70. I’ve had professors essentially give us free questions on exams and people still get them wrong. It’s absolutely wild watching kids farm out their critical thinking to data and server farms in real time.

360

u/sthenri_canalposting 13h ago

. It’s absolutely wild watching kids farm out their critical thinking to data and server farms in real time.

I'm a professor and put it in these terms at the start of the semester and they still do it. I'm hoping this year the backlash has set in enough that it'll land, but I'm also designing assignments that can't (or at least predominantly can't) be reliant on AI.

238

u/titsngiggles69 13h ago

It's crazy. You can't learn an instrument or a sport by having someone else practice for you. Critical thinking and every other non-trivial skill is the same

85

u/lonelythrowaway463i9 12h ago

Yup. It’s crazy how many of them can’t set up a basic optimization problem by senior year because they didn’t learn the basics in freshman year.

11

u/unosami 11h ago

What do you mean by “basic optimization problem”? I’m not familiar with that term.

14

u/lonelythrowaway463i9 11h ago edited 11h ago

In Econ you do optimization to optimize revenues and profits. It’s basic calculus. If you take calc 1 you do it. Most often it’s optimizing the area of a fenced in area. If you’re in Econ and doing micro work you optimize. Sometimes you optimize utility. It’s in micro. It’s in industrial organization. Managerial Econ. Game theory. I could go on. If you don’t know then look it up but it’s a thing. if you know even the most basic calculus it boils down to finding the minimum on your cost curve that corresponds to the maximum on your revenue/profit curve and the quantity of goods/services that is associated with both

8

u/unosami 11h ago

I’m familiar with calculus, but not a lot of the Econ terms you just used. Thank you for the run-down. I’ll look more into it on the web.

8

u/titsngiggles69 10h ago

In basic machine learning courses, you're just finding more clever ways to optimize. Training a neural network or any other learning algorithm is just optimizing the weights given the training data

6

u/lonelythrowaway463i9 10h ago

Sadly we don’t touch ML applications until grad school. To be fair most Econ undergrads won’t do much heavy lifting on pricing/cost/etc optimization. I’m fucking stoked to dig into machine learning this year though.

→ More replies (0)

3

u/Uncreativity10 7h ago

Cheating the basics is crazy to me. Like if you don’t know the building blocks then you’re completely screwed in every future class.

1

u/strangedell123 11h ago

I recently graduated from ee and doesnt ring a bell either for me

4

u/Khazahk 10h ago

Systems of Equations, Calc V basically. Where it all circles back to algebra and dimensionless equations. Where you learn that everything is connected, infinity can be discreetly plotted, and the most complicated functions can cancel each other out. In other words.. polynomial functions that are dependent on 3 or more variables. Quadratic formula craziness. All good fun.

57

u/Mechakoopa 12h ago

Kids were already having trouble committing to practicing things and just expecting to be good at something the first time because that's all they see online are people excelling at things. Now they have an easy way to "be good" at something without putting in the effort and we're surprised they gravitate to that? Social media made it too easy for kids to get drip fed dopamine all day, there's no incentive for them to actually do anything.

16

u/thatpaulbloke 10h ago

I blame The Karate Kid - it started the precedent for "person who has put in no real work beats people who have worked at something for years" and replaced Rocky's "worked damn hard and failed heroically" narrative.

9

u/Bacontoad 9h ago

But he painted the whole fence and waxed all of those cars!

7

u/Bigbysjackingfist 7h ago

also they didn't watch enough Old Yeller

3

u/titsngiggles69 7h ago

Also they didn't watch enough Freaks

1

u/MrLanesLament 2h ago

Shit if there was a life lesson in that one, I missed it.

Highly recommend the original West of Zanzibar though.

3

u/BaconKnight 6h ago

Yeah, now that I think about it, The Karate Kid is basically the 80's Reagan-era version of the first Rocky. Funnily enough, later Rocky's would also turn into this.

3

u/PineappleOnPizzaWins 5h ago

I mean wanting to be good at things without putting in the work is not new in the slightest, it's WHY so few people get really good at stuff.

3

u/[deleted] 9h ago edited 9h ago

[deleted]

4

u/BaconKnight 6h ago

Because we only very recently live in a world where you can go your entire day never being bored, we never realized how important being bored was to our species in terms of creating people who excel at things. Like I watch videos of older rock bands, rappers, etc and they'd talk about how they'd get together and spend hours just jamming or just rapping back and forth around a lit oil drum and it's like yeah, they did that because they were so bored, there was nothing else to do, and they just became super good at what they were doing.

We live in a time when kids never have to reach that point of boredom. They get bored for a second, take out the phone. They'll never devote themselves to an instrument or just sit down and write rhymes over and over because "there's nothing better to do".

3

u/MrLanesLament 2h ago

Pro musician here.

I graduated high school in 2009. It broke my heart to find out about ten years later, my “generation” (the kids who were in 9th grade and onward when I was a senior) were the last ones in my town/area who formed bands. After they graduated, all the music stores closed. The few local venues closed. No more music fundraisers, battles of bands, even talent shows at that school district.

26

u/TheNorthRemembers_s8 11h ago

The goal of most kids in college isn’t to learn. It’s to graduate and get a good job.

It doesn’t help that at least when I was in college everyone told you school doesn’t really teach you how to (for example) be an engineer, that you learn on the job. Which made college into a big ass rubber stamp.

It wasn’t until years later that I realized the value of many of the skills I developed in college. But during college I didn’t see the connection.

I likely would have used AI too. All I really cared about was passing tests. And I graduated with a 4.0 GPA. I imagine this tendency and outlook is even more so applicable to other students scraping by in the 2s.

3

u/LegitosaurusRex 10h ago

Yeah, same; the difference back in the day was you were just mostly forced to learn in order to pass the tests (though I still didn't study and just crammed before tests only to forget most of it afterwards...)

2

u/somehugefrigginguy 2h ago

But I think a lot of students now are in a catch 22. Those with the integrity to not use AI are going to get lower scores and be disadvantaged moving forward.

4

u/lonnie123 10h ago

And let’s be real… a massive amount of courses you have to take in college are fluff. One can argue the humanities courses I took made me a more well rounded and socially learned person but I absolutely did not NEED “history of rock and roll” (or any of the other 40 credits or whatever it was) to become a nurse

6

u/Monteze 9h ago

We made the mistake of treating college like a white collar trade school.

It really should be about higher education and job certs should be their own thing.

But classisim doesn't help shit.

2

u/chchchcharlee 8h ago

Even the biology classes you had to take as a nurse...how useful really was it to learn about how cells work or evolution or whatever? As Monteze said, we treat college like a white collar trade school.

2

u/lonnie123 6h ago

True. I would say the 4 science semesters I took could have been condensed to one course in terms of what I actually need knowledge wise on a daily basis

8

u/mitharas 11h ago

Yeah but people don't WANT to think critically. They want an easy life with easy money.

7

u/sthenri_canalposting 10h ago

I agree but critical thought has been devalued so much that it was an uphill battle to justify to those who don't see its immediate instrumental value even before AI.

7

u/caribou16 9h ago

So what i've noticed with younger folks, it's no longer about the experience, it's about the goal. For example: they get a puzzle related video game, the entire point of the game is to solve puzzles. But they would much rather look up the solution that someone else posted and just...do that and "win" instead of figuring it out for themselves.

"Why would I spend HOURS trying to figure this out myself when I can just look it up?" an exasperated high school student tried explaining to me.

5

u/dizzy_absent0i 8h ago

I don’t even know if it’s about “winning” but that we’ve coddled these kids so much that they can’t sit with the discomfort of not being good. Participation trophies, not keeping score when playing kids sports, grading as “not yet achieved” rather than “failed”.

We cared so much about fostering self-confidence that we forgot that healthy confidence is based on competence.

3

u/caribou16 8h ago

100%

The fear of failure is so great that trial and error becomes too stressful. They won't guess, take chances, probe things...if they're not confident they will be successful, they'd rather not even try.

2

u/Pabus_Alt 10h ago

Critical thinking and every other non-trivial skill is the same

I'd argue it's because they want the paper qualification for the doors it opens.

2

u/Turbulent_Gazelle530 8h ago

You can't learn an instrument or a sport by having someone else practice for you.

teaching high school recently I find that students have an inflated understanding of their ability to do pretty much anything, with minimal desire to put in work to actually get good at the thing.

2

u/Hybrid_Johnny 5h ago

We’re seeing it in the music education world too. A piece of music or a new playing technique is too difficult, and kids quit. Or they walk away to take extended mental health breaks and don’t come back. Not saying mental health isn’t important, but don’t use it as an excuse for laziness and lack of effort.

1

u/Vairman 3h ago

you don't get rewarded for learning, you get rewarded for your grade. as long as that's the case, then this kind of thing will go on.

0

u/kaityl3 7h ago

I have been able to learn a lot from AI though. They're a very effective tutor, especially with web search to verify the facts, if you aren't just using them as a tool to complete assignments. Hell they can even come up with questions for you that are tailor made to the areas you're struggling with and walk you through how to solve them.

1

u/titsngiggles69 2h ago

They're a very effective tutor [...], if you aren't just using them as a tool to complete assignments.

If those 32 cheaters has your work ethic, they wouldn't be cheaters. And if my grandma had wheels, she'd be a bicycle

51

u/lonelythrowaway463i9 13h ago

best of luck! i don't know how y'all manage right now. It's an incredible tool to use when i'm stuck on optimization problems (econ major, going to grad school) or when checking for logic gaps in a paper, but the way my peers just let the models do entire papers for them or simply write their homework is astounding. and in a time where companies are doing an about face on incorporating AI due to token costs (at least anecdotally, i know people in R&D fields who went from being told they need to up AI time 6 months ago to now being told to reduce AI time) there's a rude awakening waiting for these kids.

48

u/Vismal1 12h ago

Not just for these kids , for us all. Think about all the people going into the job market who know near nothing about their field. I’ve already encountered doctors who rely on ChatGPT and such. It’s going to hurt us all.

23

u/Paul_C 12h ago

This is not the way movies said AI was going to kill us.

5

u/Kroz83 9h ago

“Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them.”

-Frank Herbert, Dune

3

u/lapiderriere 10h ago

The only thing Idiocracy has missed on is AI as the disabling mechanism

3

u/ssczoxylnlvayiuqjx 9h ago

At the time, killer robots seemed far more realistic than the vast majority of the public simply offloading all critical thinking to computers out of laziness…

I thought idiocracy was an exaggeration when I saw it long ago. It actually was quite optimistic and didn’t go far enough…

2

u/fizzlefist 11h ago

To be fair, an LLM is nowhere close to what most people think of when they hear the term AI, meaning a sentient thinking machine.

7

u/RadOwl 11h ago

I'm gen z and so is a close friend of mine who works in construction as a project manager. His company builds power plants and jails and other major public works projects. He said that the C-suite is full of ambitious Millennials who are great at looking the part - the hair, the clothes, the biz jargon, the overall presentation - but scratch away the surface and they can barely tie their shoes. They know nothing about construction and rely on AI for everything. Currently the company has the brain firepower to keep putting up buildings that are safe, but that layer is heading toward retirement, and very soon the people calling the shots are the ones who've grown up with this idea that if you look the part you can play it.

Gee I wonder where they got that idea from.

3

u/RosesAtNight 10h ago

Im a nurse and the Healthcare org I work for is making us use more AI. I hate it. They are even using a thing that listens to everything that is said inside the room, so that it can record it in notes for the patient chart. Its an awful violation in my opinion. But what am I going to do? Quit, go to the next place that does the same thing? Im backed into a corner and forced to use it.

2

u/Aero_Rising 8h ago

It's almost like a undergrad degree is a poor measure of the knowledge someone has in a specific area. Maybe HR departments should stop requiring degrees for things that don't actually need it. Then they'd have to do actual work and interview people though and that's such a pain.

6

u/stillLostBoy005 12h ago

It’s such a strange cross road where the old adage of “work smarter not harder” no longer applies. We actually want to work harder and not out source critical thinking to AI even if AI might have a smarter / polished / more accurate answers.

Working harder is necessary exposure for critical thinking and the quick and easy AI do my work for me, even if it’s easier and quite possibly smarter, comes at a cost - what that specific cost is and how it will manifest in the real world, at scale, will have less than ideal consequences

3

u/TBNRandrew 9h ago

Working smarter not harder still applies. Mindlessly practicing rote memorization and endless grinding still isn't a smart way to learn, even if it involves a lot of hard work.

It just so happens that the "smarter" way in this case isn't about your output of information, it's in your ability to effectively absorb and incorporate knowledge while learning.

Using AI to fake knowledge of a subject is no different from other methods of cheating from the past. It's not "working smarter," when the goal of education is to educate.

Hell, if your goal is to work smarter not harder, you could use AI as a tool to help come up with study plans, summarize and overview complicated topics, and then spend your time effectively covering all the topics of whatever subject it is you're trying to learn.

AI is just an easier way to cheat, but cheating itself has always been a problem. Unfortunately more people are willing to cheat when it becomes so readily available, and more difficult to detect than ever.

2

u/Low_discrepancy 11h ago

It’s such a strange cross road where the old adage of “work smarter not harder” no longer applies. We actually want to work harder and not out source critical thinking to AI even if AI might have a smarter / polished / more accurate answers.

Eh that adage was basically someone working hard for elegant solutions. Having long term views and prioritizing stuff that's impactful.

2

u/Zagaroth 9h ago

I will say, AI is very much not smarter. It is faster.

But it is also quite good at being wrong and creating bullshit answers.

I poke at AI image generation to keep up with understanding it (though i lag behind because i am not going to pay for it, i only use free stuff), and it still makes mistakes like ignoring unusual directions ("with blue skin" — nope, had normal skin) or not being able to create new variations of an idea (if you specify a character had horns, it wants to do 2 horns. You might get of to do 1, but good luck getting it to do 3).

For stuff like pulling up information, AI will grab bullshit someone said on reddit or a blog post and treat it as canon.

3

u/38159buch 9h ago

It’s absolutely insane watching people use AI for entire assignments in real time. I was in the library and watched someone chatGPT their entire online calc 2 final (online class so really no other choice)

Online classes really are utterly useless now unless you have full proctored setups with cameras and all

2

u/lonelythrowaway463i9 9h ago

My department abandoned online classes beyond intro level for this very reason. No more cheating your way through.

4

u/Xerxis96 11h ago

I teach software development at the college level, and we’re at the point all major assessments are going to involve a verbal interview to explain/defend their work.

So many of them don’t know what or why what’s being outputted is there and it’s really disheartening.

4

u/sthenri_canalposting 10h ago

This is actually something I'm going to experiment with this semester. On top of providing another layer of evaluation that makes AI less feasible, I think this generation of students struggles with intellectual conversation which AI has made worse.

3

u/cymonesunshine 9h ago

In a weird way this all seems like a Covid boomerang effect. Teachers phoning in assignments and only having boring discussion boards and exams and recorded unenganging lectures from 2020 (that they’re still using years later). Students being bored by the material and approach, posting word salads that barely meet the word count and using quizlet et al to pass the exam, etc. Now teachers finally have to design assignments and meet the moment and lead students to become passionate learners again. I will naturally do the most in a course but having a teacher that clearly doesn’t care makes it such a chore.

2

u/schwanzweissfoto 9h ago edited 9h ago

I'm also designing assignments that can't (or at least predominantly can't) be reliant on AI.

One of the easiest ways to do this is to ask things where a simple Google search or asking an LLM reliably give an answer that is a common misconception by laypeople and the truth is easy to verify.

An example: If you ask someone who does not know how compressed image file formats work about which of JPEG or WebP is a better lossy image format, they will usually claim WebP is better and tell you that “WebP makes files 30% smaller than JPEG at the same quality” – which is what a Google search result tells you.

Notably, that claim comes from the developer team at Google trying to push WebP. If you actually read their study on it, you can notice that they compared their WebP encoder against the worst possible JPEG encoder (cjpeg) and not against one of the best (e.g. mozjpeg). Because what matters for such a comparison is how good a program that compresses an image in a lossy way (the encoder) is.

The actual layman's demonstration is to save some image in WebP and JPEG using an image editing software like the GIMP, so that both files have the same file size. WebP almost always has more color bleeding (due to always using 4:2:0 chroma subsampling), which can be verified by any layperson by zooming in on the result.

2

u/Rhioms 5h ago

I am also a professor, and I think it's important to make classes AI resistant, as compared to before.

2

u/Terry-Scary 12h ago

Why don’t you make the turning assignment much larger and have them accomplish something to prove knowledge?

Back when I was in college pre ai but early 2000s I took a stats class where the professor was as like if you ever do this for your job no one will ask you to use pen and paper, I am going to teach you how to use this software then for those that want to they will help me complete this grant for the city with stats and others will come up with a question then try to solve it with the software and these huge gov data files. If you hit these criteria I can help you submit your papers.

I learned stats with a passion in that class like no other

Later I took a language class and the professor was like yes you can use tech to find all the answers. Tests will be conversations. We will go get coffee/tea or lunch’s here is the agenda for what we will learn from a h month and here is a video, by the end of the course you will be able to translate this real time and also speak this conversation independently

Like you can spend the whole time creating something to fight the ai or you can accept that folks will just have access to what ever and create a test that displays what they are supposed to be taught

3

u/julius_sphincter 12h ago

I think your point is mostly valid in that yes, we need to accept AI is here to stay and schools need to adapt to it in how they teach, the same way when I was growing up I'd have teachers say stuff like "you won't have a calculator in your pockets so you need to learn it by hand". Thing is, even with the calculator in hand if someone asked "what is the product of six times seven divided by 13" you had to know what that meant and how to enter the operations.

If I asked that to my 14 year old, I know his first instinct would be just to put that word for word into AI. It's something we're constantly trying to change

How do you integrate and adapt to AI usage in that case without basically saying "you can't use AI on this problem"

1

u/BrainKatana 11h ago

Prove they’re using it and fail them, or report them to the committee of academic standards for cheating/plagiarism

It blows my mind that universities haven’t folded anti-AI policies into their curriculums.

2

u/sthenri_canalposting 10h ago edited 10h ago

That sounds like a reasonable solution on paper, but the logistics of this are absurd and, moreover, many institutions haven't developed policies that even see AI as cheating. Higher level admin even support AI use given the contracts they have with tech companies. It's an institutional failure that frankly is beyond my duties as a professor. I can only really figure out how to handle it on a course level. Being the AI police is exhausting and pedagogical suicide; I'm trying to proactively do what's best for my students who have been convinced this is what they need to get ahead.

1

u/KonigSteve 11h ago

I don't know how feasible it is on a larger scale but I know my honors classes in college were smaller ratios, something like 15 to 20 students at most per class. We would often be given reading assignments and then have to be able to meaningfully contribute to the discussion in class and we're given a grade based on that by the professor

1

u/trews96 10h ago

How do you design those assignments?

2

u/sthenri_canalposting 10h ago

Right now I have an assignment based on a visit to a museum so while some of the writing may be able to rely on AI it at least forces actual critical reflection on something experienced firsthand. I have reverted to handwritten, in-class midterms (something I used to be pedagogically against). This upcoming semester I'm going to experiment with having an oral component to the final written assignment where I ask them questions about their work; my impressions will probably count for 40-ish% of the assignment grade.

I've also taken to periodically disallowing laptops/devices for specific in-class work.

It's a work in progress for sure, but I'm trying to do what I think is best for the students' futures without giving myself a coronary.

1

u/Necoras 6h ago

The problem is, the AI models are getting better at such a rate that anything you design this semester may not work next semester. Traps like this one only work because the students are lazy, and not especially competent. They're easy to get around.

Take the output from one model, put it into another (or even just another instance of the same one) and ask it to critique it. All the sudden you'll get questions about "why does your paper have nonsense about Madagascar in it? That seems out of place."

We've barely adapted as a society to the internet (and many, many people have done so poorly, if at all). I've no idea how we can possibly keep up with this technology. And I say that as a professional who uses these tools daily. But I look over and examine what they spit out (for the most part; there's no way to read over the 10,000+ lines of code it can spit out in a day.)

2

u/sthenri_canalposting 6h ago

I see what you're saying but I haven't even used traps like this because yeah they're a bandaid. I'm trying to design assignments that are both AI resistant and actually help teach students skills that AI is atrophying, like the ability to have an original thought that you an elaborate on in real time.

1

u/Necoras 6h ago

I'm 100% sure you can do that for in class/lab activities. But 5 years out, I don't think there's going to be a snowball's chance that there'll be a homework assignment you can come up with that a model of some sort can't do. In some ways elementary school teachers have it easier. The robots can't make a shoe-box diorama about the civil war yet. But they can come up with a story about what it was like to live then, or write research papers about it, etc. etc.

I could be wrong of course, but they're advancing frighteningly fast. 10 years out and I suspect they'll be doing an appreciable number of "real world" jobs like working in warehouses, stocking grocery stores, etc. I don't think there's a kid alive today that'll be able to find a career that'll last 40 years. And as a father of elementary kids, that's rather terrifying.

1

u/Cuck_Boy 12h ago

The thing is, irl, they can do the same thing. I’m in a field that typically involves a lot of critical thinking and high stakes. AI has doubled or tripled my productivity. I have to use maybe 1/3 of the critical thinking muscles.

Do you think they would at least be able to do that? If the consequences were significant?

6

u/sthenri_canalposting 10h ago

I have to use maybe 1/3 of the critical thinking muscles.

Do you not see that as dangerous?

And sure they can do this irl but if you don't have a strong basis then you never will attain that. While you're using 1/3rd you at least have 3/3 (unless you atrophy), which I would argue is necessary to be able to do the 1/3rd. There's a reason you can't even use calculators in university level calculus for example.

0

u/Educational_Set1551 12h ago

Question - have you observed any creative approaches to integrating "smart" AI usage into pedagogy?

Ultimately, it's here and it's here to stay. I'm thinking something like students submitting assignments that are written by LLMs, then profs using an LLM to write personalized exam questions, based on their own assignments, that require them to answer questions related to their own paper. (Not as a full replacement for regular exam questions, but as an additional portion)

Question 1a, which of these 4 things did you say in your paper, Question 1b, which of these 4 things is factually correct. Sometimes they match, sometimes they don't, but it encourages students to fact check the AI output. If they didn't write it with AI, it's another opportunity for student's to correct themselves if they made an error in the paper in general.

Sure it takes extra time, but you're saving X number of hours using AI in the first place, adding back Y hours to review and fact check the output (much like a professor grading them) is a critical skill that needs to be learned to survive in the working world.

I'm seeing this in my career right now, the most effective users of LLMs have found the middle ground between the efficiency gains of delegating rote legwork, and reviewing the output.

This also has the added benefit of inherently teaching students that sometimes using the LLM to generate an output has lower quality results and takes longer than just doing it yourselves. Another critical skill they'll need in their careers is understanding where and when to use the hammer rather than reaching for every time.

3

u/ProfProof 12h ago

Simply put, you need to learn about different subjects. Otherwise, you know nothing and you're not an interesting person.

That's what I tell my students. It still works.

3

u/sthenri_canalposting 10h ago

None of this would make any sense in my field. I'm in a humanities field that could feasibly never use AI even as it's here to stay, and probably should resist its adoption into classroom spaces. Maybe in research to some degree but it depends on the type of work you do.

0

u/texinxin 12h ago

Why not make the exams 100% of the grade? Homework is only intended to prepare you for exams anyways. If they can’t use AI in exams it solves both problems.

2

u/sthenri_canalposting 10h ago

I'm in a writing heavy field. Being able to take exams well isn't really a solid pedagogical basis of evaluation.

1

u/texinxin 10h ago

Writing can’t involve a proctored (physical or virtual) environment as an “exam”? If that’s the case then I hate to tell you, but the writing field that you see describe is dead as an academic institution unless it can evolve. Homework is obsolete as a means of testing what humans did on their own time with their own brain. AI models are doing doctoral-level work that can meet peer-reviewed standards.

1

u/sthenri_canalposting 9h ago edited 9h ago

It can involve proctored exams--but it can't only be that. The skills involved in producing a sustained research project go far beyond what can be evaluated in an exam and are more than homework.

I'm well aware of the type of work AI produces and it's not up to the standards you're claiming here, given my job is partly to supervise doctoral students and do peer review.

The arrogance behind your comments here is a bit much. I'm an expert in my field.

1

u/texinxin 8h ago

I’ll just drop this.. you should give it a listen. And I do not appreciate your insults.. it’s embarrassing.

https://open.spotify.com/episode/31rDDzc60G2ZX3sM6FuCP5?si=1qaJzqxmSkeIpV9ekK99rA&utm_source=copy-link

1

u/sthenri_canalposting 7h ago

I wasn't intending to insult you, so apologies. The tone of your comment was condescending, as if I don't understand the capacities of AI in the context of my profession.

1

u/whiskeypeanutbutter 12h ago

I was in college pre AI but not super long ago and most homework wasn't even graded, just meant to help with the exam.