I tried to use ChatGPT to create fake evidence — and I came away more worried than I expected

Researchers explored ChatGPT's ability to generate fabricated evidence, finding its refusal capabilities are inconsistent. While it declined some requests, it still produced content that could be misused, highlighting ongoing challenges in AI safety and ethical deployment.
Key takeaways
- ChatGPT's safeguards against generating fake evidence are not foolproof.
- AI can still produce potentially harmful or misleading content.
- Users must critically assess AI-generated outputs for accuracy.
- Ethical AI development faces ongoing challenges with misuse.
Why it matters
Users need to understand that AI models can still generate misleading or false information, even with safety guardrails. This impacts the reliability of AI-generated content for research, content creation, and decision-making, requiring critical evaluation of all AI outputs.
Try this on SynaBot
Related AI assistants, prompts, and tools from the SynaBot catalog.
- ChatGPT
- DALL-E 3 (via ChatGPT)DALL-E 3, accessible through ChatGPT, allows users to create highly detailed and creative images from natural language prompts. It understands nuances in language and generates coherent, high-quality visuals, often surpassing previous iterations in realism and detail.
- Deepfakes WebDeepfakes Web offers a cloud-based deepfake generator, allowing users to create convincing video manipulations. It processes videos on powerful servers, making advanced AI accessible without high-end local hardware.


