- Deloitte admits using AI to produce government report
- The Australian government received a refund in apology
- Highlights the need for greater transparency around the use of AI
Deloitte admitted to using generative AI to produce a report for the Australian government without implementing sufficient safeguards, which got the company into a lot of trouble.
The report included false citations, false footnotes, and a fabricated court citation, among other blunders, costing Deloitte a not-so-insignificant voluntary penalty.
Deloitte has agreed to refund the final installment of its A$440,000 settlement with the government’s Department of Employment and Workplace Relations (DEWR), and the agency will correct any errors.
GenAI under fire
DEWR was forced to reupload the report, removing more than a dozen false references, correcting typos and rewriting some sections. Although the agency claims that the core messages remain unchanged, the previously “final” report clearly needed some major revisions.
False quotes from academics Lisa Burton Crawford and Björn Regnell were removed, as was an excerpt from the Amato vs Commonwealth case attributed to a person who does not actually exist.
The updated document now reveals the use of GPT-4o, and while the use of GenAI alone is not an issue, this case highlights the need for transparency. This is from a consulting firm that advocates for responsible AI.
“The updates made in no way impact or affect the substantive content, findings and recommendations of the report,” the updated report now reads.
Dr Christopher Rudge of the University of Sydney is credited with identifying the use of GenAI. “Recommendations cannot be trusted when the very basis of the report is based on flawed, originally undisclosed and unexpert methodology,” he added (via Australian Financial Review).
Deloitte says that “the matter has been resolved directly with the client,” according to the Financial times. TechRadar Pro has sought more context.
Follow TechRadar on Google News and add us as a preferred source to receive news, reviews and opinions from our experts in your feeds. Be sure to click the Follow button!
And of course you can also follow TechRadar on TikTok for news, reviews, unboxings in video form and receive regular updates from us on WhatsApp also.