Beware – Your Customer Chatbot is Almost Certainly Insecure: Report

[rbc]

In January 2024, Ashley Beauchamp ‘tricked’ DPD’s chatbot into behaving unconventionally. The chatbot told him how bad DPD’s service is, swore, and even composed a disparaging haiku about its owner:

• DPD is a useless
• Chatbot that can’t help you.
• Don’t bother calling them.

DPD shut down the chatbot and blamed an error following an update (fuller story from Ivona Gudelj on LinkedIn). Others were not so sure – the output bears all the hallmarks of ‘jailbreaking’, or breaching AI’s guardrails through prompt engineering.
[...]
Beware – Your Customer Chatbot is Almost Certainly Insecure: Report