UK Judges Cleared to Use AI in Court despite Previous Fake Case Fiasco

Judges in England and Wales have been given permission to use ChatGPT, an AI tool, to assist with their tasks, despite the risk of it citing fake cases. The UK Judicial Office has issued guidelines on the use of AI, acknowledging its potential benefits for tasks such as summarizing texts and writing court decisions. However, the guidance advises against relying on AI for legal research and analysis. The decision to allow judges to use AI comes after incidents where the use of AI in the legal system resulted in inaccurate information being presented. In one case, a lawyer used ChatGPT to write a court brief that included references to six fake cases, leading to a fine for the law firm. Additionally, a woman who used an AI chatbot to represent herself in an appeal cited nine made-up cases, resulting in her losing the case. The Judicial Office’s guidance highlights the risks associated with AI, including the potential for members of the public to use AI for deceptive purposes or to create fake evidence. It emphasizes the importance of judges being vigilant and aware of these risks.