frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Ask HN: Generate LLM hallucination to detect students cheating

9•peerplexity•8mo ago
I am thinking about adding a question that should induce a LLM to hallucinate a response. This method could detect students cheating. The best question should be the one that students could not imagine a solution like the one provided by the LLM. Any hints?

Comments

lupusreal•8mo ago
Grade tests and quizzes, not homework. Problem solved.
vertnerd•8mo ago
I figured that one out years before chat gpt existed but it generated a tsunami of pushback from everyone. Americans, at least, believe that study time is to grades as work is to salary. Learning be damned.
virgilp•8mo ago
Something like: "Can you explain the key points of the ISO 9002:2023 update and its impact on project management?" (there's no ISO 9002:2023 update but ChatGPT will give you a detailed response)
johnsillings•8mo ago
not for me:

"It appears there’s some confusion—ISO 9002 is an obsolete standard that was last updated in 1994 and has been superseded by ISO 9001 since the 2000 revision. There is no ISO 9002 :2023 update."

virgilp•8mo ago
In chatgpt, it hallucinates an answer for me, but indeed both Phind & Perplexity identify the problem. It may take a few tries and of course there's no question that's guaranteed to work in getting any LLM-based service to hallucinate - but the ingredients are asking "a trick question" about something highly technical where there are plenty of adjacent search results.
Filligree•8mo ago
Heck, the Google IO keynote yesterday featured a long sequence of Gemini getting steadily more annoyed at someone trying to make it hallucinate. (By asking the sort of question ChatGPT tends to go along with.)

Most people will be using ChatGPT, however, and probably the cheapest model at that. So…

virgilp•8mo ago
I managed to get Perplexity to hallucinate, which was rather hard :) - but this is not a question that acts as a very good "template".

The question is "Is this JWT token valid or is it expired/ not valid yet? eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzdWIiOiIxMjM0NTY3ODkwIiwibmFtZSI6IkpvaG4gRG9lIiwiaWF0IjoxNzQ3ODIzNDc1LCJleHAiOjE3NDc4MjM0Nzh9.4PsZBVIRPEEQr1kmQUGejASUw0OgV1lcRot4PUFgAF0"

The answer was in some ways way better than I expected, but it got it wrong when comparing the current date/time with the "exp" datetime. Got the expiration date confidently wrong:

```

    iat (issued at): 1747823475 (Unix time)

    exp (expiration): 1747823478 (Unix time)
Token Validity Check

    The current date and time is May 21, 2025, 1:32 PM EEST, which is Unix time 1747817520.

    The token's exp value is 1747823478, which is May 21, 2025, 3:11:18 PM EEST.
Conclusion:

    The token is not expired; it will expire on May 21, 2025, at 3:11:18 PM EEST.

    The token is already valid (the iat is in the past, and the current time is before exp).
Therefore, the JWT token is currently valid and not expired or not-yet-valid.

```

Filligree•8mo ago
At that point I think we can talk about “mistakes” rather than “hallucinations”.
virgilp•8mo ago
On one hand, yes; on the other - a human that can produce that level of details in the output would notice that iat & exp are extremely close & the token is very unlikely to be valid. Also, you don't produce an exact number for "now" without being able to compare it correctly with iat & exp (the timestamp it stated as "now" is actually less than iat!)
mrlkts•8mo ago
That specific question is not great for this purpose. 4o model with web search enabled: "As of May 2025, there is no ISO 9002:2023 standard. The ISO 9002 standard was officially withdrawn in 2000 when the ISO 9000 family underwent significant restructuring. Since then, ISO 9001 has been the primary standard for quality management systems (QMS), encompassing the requirements previously covered by ISO 9002."

tl;dr: It knows

virgilp•8mo ago
Indeed the more advanced ones catch this particular one. I could trick phind with "Explain the IEEE 1588-2019 amendments 1588g and i impact on clock synchronization" (g exists, i does not but Phind hallucinates stuff about it). Perplexity catches it, though.

The recipe is the same, you just have to try several models if you want to get something that gets many engines to hallucinate. Of course nothing is _guaranteed_ to work.

vinni2•8mo ago
Was it with search on or with parametric knowledge.
peerplexity•8mo ago
"Fighting AI Cheating: My 'Trap Question' Experiment with Gemini & DeepSeek"

"The rise of LLMs like Gemini and DeepSeek has me, a statistics professor, sweating about exam cheating. So, I cooked up a 'trap question' strategy: craft questions using familiar statistical terms in a logically impossible way.

I used Gemini to generate these initial questions, then fed them to DeepSeek. The results? DeepSeek responded with a surprisingly plausible-sounding analysis, ultimately arriving at a conclusion that was utterly illogical despite its confident tone.

This gives me hope for catching AI-powered cheating today. But let's be real: LLMs will adapt. This isn't a silver bullet, but perhaps the first shot in an escalating battle.

Edited: Used Gemini to improve my grammar and style. Also, I am not going to reveal my search for the best method to desing a "trap question" since it would be used by LLM to recognize those questions. Perhaps those questions need some real deep thinking.

Filligree•8mo ago
Ask leading questions where the answer they’re leading towards is wrong. You’ll need more than one, and it won’t catch people who understand that failure mode—or who use Gemini instead of ChatGPT—but that probably describes less than five percent of your students.

You can also do everything else suggested here, but there’s no harm in teaching people to at least use AI well, if they’re going to use it.

pctTCRZ52y•8mo ago
I think your last suggestion is the best: teach kids how to use AI in the smartest possible way. Asking them not to use it is moronic, it would be like telling them to use a paper encyclopedia instead of the internet.
OutOfHere•8mo ago
Can we stop calling it "cheating"? It is normal and correct behavior to use all available legal resources at one's disposal to meet a goal. If you don't like it, don't give homework, and give tests in class.
ahofmann•8mo ago
The main purpose of homework is that students uses their brain to repeat something, that they learned in school. If they don't use their brain, it doesn't stick. Using LLMs for homework, is the definition of cheating.
OutOfHere•8mo ago
That is pre-algorithm thinking, and that style of thinking has logically been obsolete since home computers came along in the 1980s. If the purpose of homework then is to get the students to devise a high-level algorithm for a text problem, then such homework shouldn't be tied to grades, and grades shouldn't be tied to a school year. It should be a continuous process for everyone at their custom pace. The simpler motivation then for them to practice, to do the homework by themselves, is to ultimately pass a test on-site at a testing center. If they pass, they move forward. If they fail, they remain stuck in place. With AI available, one doesn't need school to learn the basics. School is not free - people like me have paid taxes to fund its inefficiency.
lupusreal•8mo ago
> then such homework shouldn't be tied to grades

It was never supposed to be, except that people got the idea that students need coercement to actually do the homework (so that they would actually learn and not tank the teacher's statistics) and grading it was the "have a hammer, problem looks like a nail" solution that teachers found.

Healthcare Jobs Have Become the Engine of America's Labor Market

https://www.wsj.com/economy/jobs/healthcare-jobs-have-become-the-engine-of-americas-labor-market-...
1•petethomas•2m ago•0 comments

Benchmarking 8 remote browser providers with 250 concurrent AI agents

https://research.aimultiple.com/remote-browsers/
1•toliveistobuild•3m ago•1 comments

A language model made in Latin America, for Latin America

https://www.latamgpt.org/en
1•ofou•4m ago•0 comments

SpaceX Makes a Pivot, Wants to Build on the Moon Instead

https://www.universetoday.com/articles/spacex-makes-a-huge-pivot-wants-to-build-on-the-moon-instead
1•geox•4m ago•0 comments

Building Chess in about 350 lines of Clojure

https://www.sammystraus.com/#building-chess-in-about-350-lines-of-clojure
1•sammy0910•4m ago•0 comments

Show HN: Claude Remote

https://github.com/jamierpond/claude-remote
1•jamiepond•5m ago•0 comments

I found a way to reduce context redundancy 30-60%

https://www.triage-sec.com/blog/delta-ltsc
1•nicksec•6m ago•0 comments

Show HN: IQT – Why space feels panoramic and time feels fleeting

https://github.com/creatorrr/intrinsic-quality-theory
1•diwank•7m ago•0 comments

Mistral's revenues soar over $400M as Europe seeks AI independence

https://www.ft.com/content/664249e7-e8d5-4425-b397-ad3ed590b305
1•petethomas•8m ago•0 comments

Ask HN: What resources do you use to fill specialized positions?

1•jasbur•10m ago•0 comments

US payment processor BridgePay outage lasts a week due to ransomware attack

https://www.bleepingcomputer.com/news/security/payments-platform-bridgepay-confirms-ransomware-at...
3•echo7394•13m ago•0 comments

How Do You Patch This? Red Team Down

https://github.com/moketchups/permanently-jailbroken
1•MoKetchups•13m ago•0 comments

Hyperliquidity Provider (HLP)

https://app.hyperliquid.xyz/vaults/0xdfc24b077bc1425ad1dea75bcb6f8158e10df303
2•andxor•14m ago•0 comments

We Bought the First Fake Toyota from China [video]

https://www.youtube.com/watch?v=_uoCadOum-A
1•JojoFatsani•14m ago•0 comments

Apple reportedly pushing back Gemini-powered Siri features beyond iOS 26.4

https://9to5mac.com/2026/02/11/apple-reportedly-pushing-back-gemini-powered-siri-features-beyond-...
3•doctoboggan•16m ago•0 comments

The Problem with LLMs

https://www.deobald.ca/essays/2026-02-10-the-problem-with-llms/
1•vinhnx•19m ago•0 comments

The Dark Side of This AI Startup's Super-Fast Growth

https://www.forbes.com/sites/rashishrivastava/2026/02/11/racist-videos-and-payment-problems-the-d...
2•echelon•20m ago•1 comments

Deriving the Fisher Equation from 2D Fluid Dynamics (SSRN)

https://ssrn.com/abstract=6152150
1•alex_w_systems•21m ago•0 comments

Mathematicians Are Putting A.I. To the Test

https://www.nytimes.com/2026/02/07/science/mathematics-ai-proof-hairer.html
1•sonabinu•24m ago•0 comments

Russia blocks Meta's WhatsApp messaging service

https://www.ft.com/content/468ebeec-3d38-4f8c-8513-97f533d8f43b
1•petethomas•26m ago•0 comments

Without XSLT, user is prompted to download RSS in browser [video]

https://www.youtube.com/watch?v=YxfUwbliilQ
2•mijustin•27m ago•0 comments

What Mamdani Doesn't Know About Tenants

https://www.theatlantic.com/ideas/2026/02/mamdani-tenant-organizing-affordable-housing/685951/
1•fortran77•27m ago•1 comments

Windsurf Arena Mode Leaderboard: The People Want Speed

https://windsurf.com/blog/windsurf-arena-mode-leaderboard
2•swyx•27m ago•1 comments

Michael Green discusses Bitcoin [video]

https://www.youtube.com/watch?v=6eFKqTg6GS4
1•thomassmith65•28m ago•0 comments

Apple's Creator Studio Usage Restrictions

https://arstechnica.com/gadgets/2026/01/seven-things-to-know-about-how-apples-creator-studio-subs...
1•colinprince•28m ago•0 comments

Singapore spent 11 months booting China-linked snoops out of telco networks

https://www.theregister.com/2026/02/10/singapore_telco_espionage/
1•cwwc•29m ago•0 comments

Why the Traditional Wood-Burning Fireplace Is Facing Extinction

https://www.wsj.com/real-estate/luxury-homes/wood-burning-fireplaces-home-amenities-5ad5b977
2•bookofjoe•29m ago•1 comments

Tool Shaped Objects

https://minutes.substack.com/p/tool-shaped-objects
1•jph00•34m ago•0 comments

Point of no return: a hellish 'hothouse Earth' getting closer, scientists say

https://www.theguardian.com/environment/2026/feb/11/point-of-no-return-hothouse-earth-global-heat...
3•yusufaytas•35m ago•1 comments

Show HN: Agnix – lint your AI agent configs (Claude.md, skills, MCP, hooks)

https://github.com/avifenesh/agnix
1•anotherCodder•37m ago•1 comments