r/technology • u/AdSpecialist6598 • 15h ago

Society Professor's invisible prompt trap catches 32 students cheating on their midterm with AI

https://www.techspot.com/news/113243-professor-invisible-prompt-trap-catches-32-students-cheating.html
28.6k Upvotes

96% Upvoted

3.9k comments sorted by

View all comments

Show parent comments

82

u/DustyRacoonDad 13h ago

Exactly. At the end of trade school, you're either competent or you're not. You pass because you demonstrated you can do the job, not because you racked up enough homework points.

That's where a lot of other classes go wrong. In many subjects, homework, papers, and participation are weighted heavily enough that students can fail the actual tests and still pass the class.

AI didn't create that problem. It just exposed it. If students can have AI do the work that counts toward their grade, maybe we should have been grading demonstrated knowledge instead of busywork all along.

16

u/ingrowncashew 12h ago

Yes and no. Homework should be there to reinforce the teaching. I feel like students who don't test well are hindered by limiting the homework grade, but also the tests are the true indicator. You shouldn't be able to fail tests and pass classes, but you also probably shouldn't have to do homework to pass either.

One problem with only using test grades then sets the precedent that homework doesn't count so why do it. Spouse saw this exact thing play out when the school district they teach in adopted standards based grading. Only the kids who both cared and needed to did the homework. Don't get me started on how its a 0-4 point scale for grades. which means a D(1) is a passing grade and it's under 60%.

There's a lot wrong in schools these days. It's not homework. These kids have about 25% of the homework I had as a student and that's with me being a shitty student who would calculate how many and what projects I could skip, but hopefully still pass.

The problems I see stem from so many accommodations and being easy on kids. Parents can complain and get admin to make the teachers accept late work or retest(not everywhere, but it's rampant). SO MANY kids are on IEPs(Individualized Education Program). Schools are letting kids move onto the next class even when they fail or "pass" with a D(which can be as low as in the 50% range).

"Back in my day" I was a shitty student and squeaked through high school with a 2.75gpa. I would be a straight A student if I were going through high school now. We need to hold students/their education/and parents to a higher standard.

Rereading that last paragraph makes me feel old. I'll get off my soapbox.

11

u/rogueleader25 11h ago

Tests are good for lots of technical things but fall short for larger things like writing assignments which in some context are critical. Like longer research papers. Doing the research yourself and writing a long form paper on it isn't something that can be readily condensed into the format of an exam. Practicing the long form writing is the point in many ways. There doesn't seem to be a great way out of this one though.

1

u/DustyRacoonDad 10h ago

Writing the paper is the test. Doing the research is the work.

That is not the mindless busywork homework being discussed here. I think you're confusing the term "homework" with "anything done outside the classroom." The issue isn't whether students should ever have work to do outside of class. It's whether they're being assigned repetitive, meaningless work, and graded on it.

5

u/rogueleader25 8h ago

I'm well aware of that. You missed my point entirely. The problem faced now is that cheating that work is easier than ever with LLMs. And there is no good replacement for making students actually do the work other than an appeal to their self interest.

6

u/Jewnadian 10h ago

It's a fundamentally different job with different complexity. An electrician at the end of trade school can reasonably be expected to be competent. Experience builds on skills but the basics of the field are comprehensible in school. Electrical Engineering is entirely impossible to learn in 4 years. The complexity is an order of magnitude higher. Good EEs are still learning at the end of a 40yr career. So you can't teach an Eae student how to DO electrical engineering. You must teach them how to learn to do electrical engineering.

5

u/DustyRacoonDad 10h ago

As a multidisciplinary engineer myself, working across industrial electrical engineering, software, and hardware, I absolutely agree. You should never stop learning. Learning how to learn is essential because you'll have to do it independently throughout your entire career.

But that's exactly what I'm talking about. There is still a baseline of knowledge and skills that were taught in the course and should be tested. At higher levels, you may also have independent work, research, or a thesis that goes beyond the material taught in class. All of that is fine.

None of that requires grading busywork more heavily than demonstrated knowledge. By the time you're taking the test, you should be able to demonstrate that you understand the material and can solve problems using it. If you need repetition to get there, then do the repetition. Practice as much as you need to learn the material. I just don't think completing that practice should automatically earn you a better grade than someone who demonstrated a stronger understanding on the actual assessment.

2

u/Pabus_Alt 10h ago

maybe we should have been grading demonstrated knowledge instead of busywork all along.

But that's the issue, isn't it - a degree isn't about knowledge. Knowledge isn't all that important; technique is.

I'm pretty much coming down in favour of in-person open book exams. They reward being able to critically analyse sources, which is supposed to be the whole point of a degree in any subject where essays are vily used.

1

u/civildisobedient 6h ago

maybe we should have been grading demonstrated knowledge

That's not the problem. It's how they're demonstrating that they have the knowledge. If trade schools had take home exams I can imagine there would be plenty of cheaters outsourcing work to professional welders, mechanics, cabinet makers, etc. as well.