Raw LLM Responses
Inspect the exact model output for any coded comment.
Look up by comment ID
Random samples — click to inspect
G
The worst art a human ever made is still 100x better than the best AI art…
ytr_UgxuxhryY…
G
Trying to scare people with these AI videos. You know certain people will think …
ytc_UgxBqa9UZ…
G
ai art will never exist without real artists so no matter what you say about ai,…
ytr_UgyE_92_H…
G
@JustanotherANOTHERgamer'Real human' is just a biological machine. Much more co…
ytr_Ugx8Ac7ZR…
G
The world will still need consumers to buy stuff from those people are building …
ytc_Ugxvwi87P…
G
Shaming people for shaming people for using AI is also part of the problem.
How…
rdc_n7vd4b0
G
True. And with advancing AI it will soon only take one photo. Amazing I'm gett…
rdc_l56dyfj
G
@Uberlord001 We also have to be stupid enough to give an AI access to a means of…
ytr_Ugx4pQcoI…
Comment
They state that they gave the instruction "the code only" but GPT decided to add the markdown quotes and additional explanations on multiple occasions? This does imply that GPT is less compliant with requests and does not follow the users prompts as closely. I don't see how "their tests don't work" here lol. Yeah the code might be right, but if (like they say in the paper) you use chatGPT as a code generator in a pipeline, you now have to have an additional parser that checks for python markdown and other text and deletes it.
Is this a minor change that does not change code quality? Probably yes.
Does it decrease performance in a production environment? Absolutely.
The test is valid. You just dismiss these changes because they do not seem important to you and your use of ChatGPT.
edit: typo
reddit
AI Harm Incident
1689776098.0
♥ 12
Coding Result
| Dimension | Value |
|---|---|
| Responsibility | ai_itself |
| Reasoning | consequentialist |
| Policy | none |
| Emotion | indifference |
| Coded at | 2026-04-25T08:33:43.502452 |
Raw LLM Response
[{"id":"rdc_jslc385","responsibility":"ai_itself","reasoning":"consequentialist","policy":"none","emotion":"indifference"},{"id":"rdc_jslo95t","responsibility":"none","reasoning":"deontological","policy":"none","emotion":"outrage"},{"id":"rdc_jsm370w","responsibility":"company","reasoning":"consequentialist","policy":"none","emotion":"frustration"},{"id":"rdc_jsmea4a","responsibility":"company","reasoning":"virtue","policy":"none","emotion":"outrage"},{"id":"rdc_jsk7i6o","responsibility":"none","reasoning":"consequentialist","policy":"none","emotion":"indifference"}]