CRA Invests $18M in Tax Information Chatbot ‘Charlie’

The Canada Revenue Agency (CRA) spent $18 million on Charlie the Chatbot, which Auditor General Karen Hogan reported provided inaccurate answers 66% of the time. Launched in 2020, Charlie aimed to assist taxpayers but has struggled with accuracy, achieving only a 33% success rate in a recent audit, significantly lower than other AI tools. Despite its shortcomings, CRA upgraded Charlie to a generative AI version in November, claiming improved accuracy. However, precise performance metrics for the new version remain undetermined.

Want More Context? 🔎