The register
Every known AI-related Incident in New Zealand.
-
Severity 4 of 5, Serious
Supreme Court warned litigants of contempt charges over AI-generated fake authorities
Declining leave to appeal in Jones v Family Court at Whangārei, the Supreme Court noted that the applicant had cited a number of authorities that appeared to have been hallucinated…
-
Severity 1 of 5, Minor
High Court noted apparent AI use in submissions that misquoted the law (Coulson v ASB Bank)
Declining a self-represented borrower’s bid to stop ASB Bank selling a property, the High Court noted the submissions suggested significant use of AI and misquoted the law.
-
Severity 2 of 5, Moderate
Litigant cited hallucinated cases and uploaded the other side’s confidential information to ChatGPT (QTR v BXD)
The Employment Relations Authority found a self-represented applicant had used ChatGPT to write submissions citing cases that did not exist, and had uploaded the respondent’s confidential information into the tool.…
-
Severity 3 of 5, Significant
AI cheating-detection tools falsely accused top students at two New Zealand high schools
High-achieving senior students at Cambridge High School and Pukekohe High School were accused of AI cheating and failed on internal assessments after AI-detection tools flagged their work, in one reported…
-
Severity 1 of 5, Minor
Employment Court found fabricated case law in a litigant’s filings (Cunningham v healthAlliance)
In Cunningham v healthAlliance NZ Ltd, the Employment Court found that a self-represented litigant’s filings relied on cases that did not exist, which the Court said may have come from…
-
Severity 2 of 5, Moderate
Privacy Commissioner inquiry into supermarket facial recognition trial finds misidentifications
The Privacy Commissioner’s inquiry into Foodstuffs North Island’s facial recognition trial documented multiple misidentification cases across the trial period. The inquiry attributed those cases primarily to human error in the…
-
Severity 3 of 5, Significant
Employment Court rebuked a litigant for citing a case that did not exist
In LMN v STC (No 2), a self-represented employee cited a supposed precedent to argue for procedural leniency on grounds of financial hardship. The Court could not locate the decision…
-
Severity 4 of 5, Serious
Google’s AI summaries breached New Zealand court name suppression orders
Google’s AI-generated search summaries were found to be naming people protected by New Zealand court suppression orders, surfacing identities that publication bans exist specifically to protect. Suppression breaches are a…
-
Severity 1 of 5, Minor
Court of Appeal found submissions relying on non-existent case law
In Wikeley v Kea Investments Ltd, the Court of Appeal noted that parts of the appellant’s original memorandum referred to authorities that do not exist, evidently produced by generative AI.…
-
Severity 3 of 5, Significant
Students used AI to create deepfake nude images of classmates at a high school
At Rangiora High School in North Canterbury, students used AI software to generate fake explicit “deep nude” images of at least 15 fellow students, both male and female, by digitally…