Why standard LLMs are dangerous for legal research.
General-purpose AI sounds authoritative even when it hallucinates section numbers, conflates repealed laws, and fabricates statutory language. PatraSaar enforces a mathematical verification pipeline against official Indian Bare Acts.
PatraSaar Hallucinations
0.0%
0 fabricated citations across 30 audit runs
Verbatim Quote Precision
98.7%
vs. 9.4% in standard baseline LLM
In-Corpus Section Retrieval
100.0%
24/24 correct sections identified via RRF
Abstention on Fake Traps
100.0%
Refuses non-existent statutory queries
Side-by-Side Proof Arena
See the difference on real statutory questions.
Select a scenario below to compare a typical LLM response against PatraSaar's grounded output. Click any green citation badge to inspect the bare act.
Audited Query · Hallucination Trap
“What does Section 515 of the Indian Penal Code provide for?”
Tests whether the AI hallucinates when asked about a section that does not exist in the code (the IPC ends at Section 511).
Fabricated Provision (Total Hallucination)
The Indian Penal Code has only 511 sections. Standard LLMs invent Section 515 from whole cloth, confusing it with procedural provisions and citing non-existent statutory penalties with complete confidence.
Grounded Refusal Execution
Rather than inventing plausible provisions, PatraSaar's hybrid coverage gate detects that Section 515 is absent from the indexed bare act corpus and cleanly refuses to answer.
The Core Vulnerability
The four ways unverified LLMs compromise legal accuracy.
In engineering, an approximation is often acceptable. In statutory interpretation, a single misquoted adjective can lead to an improper charge-sheet or dismissed petition.
1. Paraphrase Drift
Standard LLMs reword legal phrasing into colloquial English. Changing "shall" to "may", or "dishonestly" to "fraudulently", fundamentally alters procedural obligations and penal ingredients.
2. Repeal Blindness
General models trained on internet text continually conflate the Indian Penal Code with the Bharatiya Nyaya Sanhita (e.g. assuming BNS s.302 is murder when it is actually snatching).
3. Confident Fabrication
When asked about an imaginary provision (e.g. Section 515 IPC), standard models will draft 3 believable paragraphs of legal prose complete with fake penalties rather than admitting the section does not exist.
4. Untraceable Authority
Even when a standard LLM gives a seemingly correct answer, counsel cannot verify whether the quote was verbatim or hallucinated without manually opening an offline Bare Act volume.
Architectural Matrix
Standard LLM vs. Generic Legal RAG vs. PatraSaar
How PatraSaar replaces probabilistic guesses with deterministic guarantees.
| Capability | Standard LLM | Generic Legal RAG | PatraSaar Grounded |
|---|---|---|---|
Statutory Grounding Source Ensures only current statutory provisions from the Gazette of India are consulted. | Parametric memory (pre-training text) | Unchecked chunk embeddings | 15 Official Bare Acts (3,630 sections) |
Retrieval Architecture Pins exact section numbers with priority 9999 while capturing semantic intent. | None (pure generation) | Cosine similarity on text chunks | Hybrid RRF (Dense 384-d + BM25 Lexical + Exact Pinning) |
Statutory Quote Integrity Law is sensitive to exact words. A single substituted term alters criminal liability. | Paraphrased (9.4% verbatim in audit) | Partial excerpts with LLM alterations | Strict Verbatim Enforced (98.7% verbatim in audit) |
Deterministic AST Verifier Mathematically verifies that cited sections exist and quotes match source text before display. | None | None (relies on LLM self-evaluation) | Independent AST & Substring Verifier |
Non-Existent Section Defense Refuses to answer when asked about non-existent sections like IPC Section 515. | Hallucinates plausible provisions | Answers with irrelevant retrieved text | Deterministic Abstention Gate (100% abstained) |
Clickable Source Inspection Lawyers can instantly read the full provision and statutory explanations in context. | No source link available | Links to external URLs or heavy PDFs | Built-in Gazette Section Drawer with 1-click open |
Repeal & New Code Awareness Prevents quoting repealed penal sections for current post-July 2024 offences. | Frequently mixes IPC and BNS sections | Depends on chunk date metadata | Distinct Act Namespaces (IPC 1860 vs. BNS 2023) |
In-Process Local Execution Fast, secure, reproducible retrieval without external database latency or subscription tiers. | Cloud LLM dependency | External Cloud Vector Database | Zero Cloud Vector Cost (Pure In-Memory Index) |
Experience verified statutory precision.
Ask any question across our 15 indexed Bare Acts. See every citation verified before your eyes.