The register
Every known AI-related Incident in New Zealand.
-
Severity 3 of 5, Significant
AI cheating-detection tools falsely accused top students at two New Zealand high schools
High-achieving senior students at Cambridge High School and Pukekohe High School were accused of AI cheating and failed on internal assessments after AI-detection tools flagged their work, in one reported…
-
Severity 1 of 5, Minor
Employment Court found fabricated case law in a litigant’s filings (Cunningham v healthAlliance)
In Cunningham v healthAlliance NZ Ltd, the Employment Court found that a self-represented litigant’s filings relied on cases that did not exist, which the Court said may have come from…
-
Severity 2 of 5, Moderate
Privacy Commissioner inquiry into supermarket facial recognition trial finds misidentifications
The Privacy Commissioner’s inquiry into Foodstuffs North Island’s facial recognition trial documented multiple misidentification cases across the trial period. The inquiry attributed those cases primarily to human error in the…
-
Severity 3 of 5, Significant
Employment Court rebuked a litigant for citing a case that did not exist
In LMN v STC (No 2), a self-represented employee cited a supposed precedent to argue for procedural leniency on grounds of financial hardship. The Court could not locate the decision…
-
Severity 4 of 5, Serious
Google’s AI summaries breached New Zealand court name suppression orders
Google’s AI-generated search summaries were found to be naming people protected by New Zealand court suppression orders, surfacing identities that publication bans exist specifically to protect. Suppression breaches are a…
-
Severity 1 of 5, Minor
Court of Appeal found submissions relying on non-existent case law
In Wikeley v Kea Investments Ltd, the Court of Appeal noted that parts of the appellant’s original memorandum referred to authorities that do not exist, evidently produced by generative AI.…
-
Severity 3 of 5, Significant
Students used AI to create deepfake nude images of classmates at a high school
At Rangiora High School in North Canterbury, students used AI software to generate fake explicit “deep nude” images of at least 15 fellow students, both male and female, by digitally…
-
Severity 4 of 5, Serious
Police ran secret Clearview AI facial-recognition trial without authorisation
New Zealand Police trialled facial-recognition software from US firm Clearview AI for two months in 2020, running roughly 180 searches, without briefing the Police Commissioner, the Privacy Commissioner, or Cabinet.…