Over five million individuals in the UK have suffered negative consequences due to incorrect guidance from an AI chatbot, leading to financial losses and other issues. Recent findings from Uswitch.com indicate that people have faced health scares and relationship strains after relying on online advice.
A significant portion of UK adults, with more than two in five (43%), have sought personal advice from chatbots, with nearly half (48%) trusting this guidance as much as, or even more than, input from friends or family. However, 23% of AI users reported encountering problems due to inaccurate chatbot recommendations.
Moreover, approximately 18% of UK adults, close to ten million people, have acted upon chatbot advice without seeking a second opinion, with this figure rising to 40% among Generation Z. Notably, individuals cannot seek compensation from the Financial Ombudsman Service for poor financial suggestions from AI tools.
In response to these concerns, chatbots are set to be included in the Online Safety Act, holding social media platforms and search engines accountable for user welfare. Additionally, new EU regulations mandate that chatbots remind users of their artificial nature.
Uswitch advises using AI as a starting point and suggests verifying financial counsel through reputable sources such as MoneyHelper, regulated financial advisors, solicitors, or Citizens Advice. It is crucial to cross-check information, avoid relying on outdated data, and always verify the sources of online advice.
Ernest Doku, Uswitch’s technology expert, remarked on the evolving reliance on chatbots, cautioning that while AI can serve as a valuable resource, human judgment remains essential, especially for significant decisions impacting health, finances, or life choices. Doku emphasized the need to view chatbot responses as initial guidance rather than definitive solutions, urging individuals to seek human opinions when making critical choices.