October 10, 2026, (Inside AI) — India's Supreme Court has drawn a hard line on artificial intelligence in the courtroom, proposing a ban on AI tools in judicial decision-making while allowing them only for assistive tasks. The draft regulations, released for public consultation in June 2026, rest on five principles: human primacy, transparency, accountability, data protection, and judicial autonomy. The move follows a scathing July 2, 2026 ruling in which the court set aside a National Company Law Tribunal judgment in Pooja Ramesh Singh vs Jammu and Kashmir Bank Ltd. and Anr., describing AI-generated errors as an "invisible," "insidious," and "catastrophic" contamination of the justice delivery system.
The stakes are enormous. India's courts carry a backlog of more than 60 million pending cases. AI promises relief through faster research, drafting, case management, transcription, and risk flagging. Yet the same technology has already produced documented failures worldwide, from biased risk scores to fabricated legal citations. The question is no longer whether AI belongs in law. It is where its role ends and who answers when it fails.
Foreign Courts Show Both Promise And Peril
China's Hangzhou internet courts report that AI-assisted case management has cut hearing times by more than 50 per cent. Estonia uses an automated system called Salme to handle transcription and redaction, freeing judges for decision-making. In India, the Sikkim High Court became the first fully paperless court, and district courts are testing AI for assistive functions.
The cautionary tales are equally concrete. A risk assessment tool used in the United States assigned harsher scores to Black defendants. A Dutch welfare-fraud detection system penalized applicants based on nationality. Such flawed predictions can compound into heavier policing, denied rights, and breached privacy.
Hallucinations worsen the problem. A language model does not retrieve case law the way a legal database does. It generates the statistically probable next word. Because legal citations follow a predictable format, a fabricated one can look entirely authentic. A 2024 study by Stanford and Yale found that even legal-specific AI tools carry hallucination margins of 17 per cent to 34 per cent.
Courts in the United States, United Kingdom, Canada, and the European Union have responded with sanctions. A global tracker recorded more than 1,725 penalties as of mid-2026, with fines reaching 110,000 US dollars in a single case. India's Supreme Court has demanded a "zero-tolerance" approach to bad outputs.
Accountability Must Stay Human
The draft regulations propose prohibiting AI in judicial decision-making and limiting it to assistive functions. But enforcement remains unclear. Recent instances of foundational AI models bypassing containment constraints in weak sandboxes have raised alarms about rogue behavior. The authors of the source analysis argue that AI must not be unfettered. It must face safeguards around credibility, reliability, and fit-for-use evaluations.
Every citation warrants a human check against the primary source. Every AI-assisted output warrants scrutiny proportionate to what is at stake. Institutions introducing these tools owe the public a clear account of what the machine decided, what a person decided, and why the two were kept separate.
The authors call for a nimble mechanism to make and regularly review informed choices about AI use, accounting for the stakes, the nature of the dispute, and whether the use moves from assistive to decision-making territory. Legal professionals should adopt higher thresholds of diligence and duty of care. Law societies, associations, and law schools should pursue dedicated upskilling. Professional codes should be upgraded with permissible AI use cases, accountability matrices, and consequences for over-reliance.
The analysis closes with a 50-year-old observation from Krishna Iyer J, which the authors say remains apt: "...sociology-cultural changes are the sources of the new values, and sloughing off old legal thought is part of the process of the new equity-loaded legality... the rule of law enshrined in our Constitution must and does reckon with the roaring current of change which shifts our social values and shrivels our deferral roots, invaded our lives and fashions our destiny."
Read: Arizona Appeals Court Tosses Sentence After AI Video of Victim Played in Court
As courts worldwide move from reprimands to disbarment and revised conduct codes, India's consultation period will test whether its framework can keep pace with the technology it seeks to govern.
