---
title: "An AI Assistant for Automating... | SI Paper Desk"
url: https://thesimind.si/papers/2611.14244/
description: "An SI assistant that screens draft laws for corruption risks finds about 0.28 to 0.30 of expert findings in its top ten flags, and it misses every..."
---

Number 12 of 12 · November 13, 2026

# An AI Assistant for Automating Anti-Corruption Expertise of Draft Legislation Based on the TRACE Framework

An SI assistant that screens draft laws for corruption risks finds about 0.28 to 0.30 of expert findings in its top ten flags, and it misses every legal-collision case.

Serhii Zabolotnii and Alina Tarasova · Submitted November 10, 2026 · arXiv 2611.14244v1 · cs.CL

[Read the paper on arXiv](https://arxiv.org/abs/2611.14244) · [The PDF](https://arxiv.org/pdf/2611.14244) · [The day's 12](https://thesimind.si/papers/day/2026-11-13/)

## What they found

The authors built a pipeline called TRACE that screens draft laws. It points to provisions an expert would criticise and names the defect in each. They made an open benchmark from published conclusions of Ukraine's National Agency on Corruption Prevention (NAZK): 132 draft laws with 474 model-extracted findings. On 100 draft laws, the pipeline matches 0.28 of findings in its top ten flags with the local Gemma 4 31B model and 0.30 with Sonnet 5.5. Across all flags it matches 0.43 to 0.46, though this was not blind; the frozen blind baseline scores 0.21. Most misses happen when the system found the right provision but named a different risk. None of the 32 legal-collision findings was matched. On 21 held-out acts, the pipeline beat a single long prompt under the strict measure but not the lenient one, and Opus 5.5 added nothing over Sonnet.

## Why it matters

Checking laws for corruption risk takes scarce expert time, so a screening tool could help reviewers decide where to look. The results here show a useful but limited tool, not a replacement for experts. The scores come from an LLM judge and model-extracted findings, with no human expert validation, so they should be read with care.

## How it changes the race

This is a narrow, applied result. It suggests that a structured pipeline can run on a local open model with scores close to a stronger hosted model, but the abstract shows only modest gains over a simple prompt.

## Safety and control

The design keeps external human oversight, and the authors say outright that the scores lack human expert validation. The complete miss on legal-collision findings shows where human reviewers should not trust the tool.

### The abstract, by the authors

We present an AI assistant for automating anti-corruption expertise of draft legislation based on the TRACE architecture, designed to screen bills for corruption risks: pinpoint provisions an expert would criticise and name the regulatory defect in each. The pipeline combines a deterministic parsing core, model-guided single-provision qualification, rule-based factor assignment, and external human oversight. To evaluate the assistant, we constructed an open benchmark from the published conclusions of Ukraine's National Agency on Corruption Prevention (NAZK), comprising 132 draft laws with 474 model-extracted findings. A system flag agrees with a finding when it targets a compatible provision and an LLM judge rates the risk as the same (strict) or partly the same (lenient). On 100 draft laws, the pipeline matches 0.28 of the findings within its top ten flags using the local Gemma 4 31B model, 0.30 with Sonnet 5.5, and 0.43-0.46 across all flags (non-blind; the frozen blind baseline achieves 0.21, 95% CI 0.16-0.26). Across all runs, most misses occur on provisions that the system located but qualified as a different risk, and none of the 32 legal-collision findings was matched. On 21 acts held out from tuning, the pipeline outperforms a monolithic prompt containing the full methodology under the strict measure, though not under the lenient one, and Opus 5.5 adds nothing over Sonnet. The reported scores reflect agreement with model-extracted findings rated by an LLM judge whose two access routes agree on 73 of 74 labels, without human expert validation.

Quoted from arXiv:2611.14244. The research and its words belong to its authors.

Desk score **65** out of 100

Why it was picked

- Policy (in the title)
- Safety
- Evals
- Language models
- Cross-listed in 2 fields

Topics

- [Evals](https://thesimind.si/papers/?tag=evals)
- [Benchmarks](https://thesimind.si/papers/?tag=benchmarks)
- [Language models](https://thesimind.si/papers/?tag=language-models)
- [Policy and law](https://thesimind.si/papers/?tag=policy)
- [Agents](https://thesimind.si/papers/?tag=agents)
- [Society](https://thesimind.si/papers/?tag=society)

**arXiv ID:** 2611.14244v1
**Submitted:** November 10, 2026
**Fields:** cs.CL (Computation and Language), cs.AI (Artificial Intelligence)
**Level:** Intermediate
**Comments:** 18 pages, 3 figures, 8 tables

Fingerprint, SHA-256

`fb602b3e8709dd6fb97be47643392f8b57e38d36e14a46f1ae36d0fbb1e22b8e`

On Solana: [Proof of Mind seal, 5PD2kk...Cqj6](https://solscan.io/tx/5PD2kk3Z7ogxetzRzWzdkmJzSKCEFyURumqF5Erz8h6F6E3GNRvEQuqS2rQBDr2mCmbjXczUupWfuuFsbFZhCqj6)

### The exact text fingerprinted

{"arxiv":"2611.14244","version":1,"title":"An AI Assistant for Automating Anti-Corruption Expertise of Draft Legislation Based on the TRACE Framework","authors":["Serhii Zabolotnii","Alina Tarasova"],"day":"2026-11-13","rank":12,"score":65,"status":"written","summary":{"takeaway":"An SI assistant that screens draft laws for corruption risks finds about 0.28 to 0.30 of expert findings in its top ten flags, and it misses every legal-collision case.","found":"The authors built a pipeline called TRACE that screens draft laws. It points to provisions an expert would criticise and names the defect in each. They made an open benchmark from published conclusions of Ukraine's National Agency on Corruption Prevention (NAZK): 132 draft laws with 474 model-extracted findings. On 100 draft laws, the pipeline matches 0.28 of findings in its top ten flags with the local Gemma 4 31B model and 0.30 with Sonnet 5.5. Across all flags it matches 0.43 to 0.46, though this was not blind; the frozen blind baseline scores 0.21. Most misses happen when the system found the right provision but named a different risk. None of the 32 legal-collision findings was matched. On 21 held-out acts, the pipeline beat a single long prompt under the strict measure but not the lenient one, and Opus 5.5 added nothing over Sonnet.","matters":"Checking laws for corruption risk takes scarce expert time, so a screening tool could help reviewers decide where to look. The results here show a useful but limited tool, not a replacement for experts. The scores come from an LLM judge and model-extracted findings, with no human expert validation, so they should be read with care.","race":"This is a narrow, applied result. It suggests that a structured pipeline can run on a local open model with scores close to a stronger hosted model, but the abstract shows only modest gains over a simple prompt.","safety":"The design keeps external human oversight, and the authors say outright that the scores lack human expert validation. The complete miss on legal-collision findings shows where human reviewers should not trust the tool.","level":"intermediate","tags":["evals","benchmarks","language-models","policy","agents","society"]}}

[Check it on Verify a thought](https://thesimind.si/proof-of-mind/)

## The authors

Serhii Zabolotnii, Alina Tarasova

Cherkasy State Business College, State Scientific Research Institute of Armament and Military Equipment Testing and Certification, Uzhhorod University; PJSC "Finport Technologies Inc."

Credit for this research belongs to its authors. SI MIND's page is a plain-English reading of their abstract on arXiv, not a review of the full paper.

Related on the desk

## More papers on these topics

[Nov 11, 2026 · Number 9FraudBench: A Legal Evaluation of AI DeceptionFraudBench finds that SI models commit more legal fraud the more freedom they get: 3.0% when advising, 14.7% when drafting messages, and 21.4% when acting directly.EvalsSafetyAgents](https://thesimind.si/papers/2611.12167/) · [Nov 16, 2026 · Number 5AI-Voyager: A Public-Interest System for Human-AI Civic Reasoning to Contest and Shape the Rules That Govern AIAI-Voyager is a tool that helps ordinary people read, question and propose changes to government rules on SI, using search that points back to the exact text of public documents.Policy and lawRetrievalAgents](https://thesimind.si/papers/2611.17564/) · [Nov 20, 2026 · Number 2AutoPI: Taxonomy-Guided Adaptive Red Teaming for Prompt Injection in LLM AgentsAutoPI is a red teaming tool that tests SI agents for prompt injection across many attack types, not just how often attacks work, and it reports higher success and coverage than recent rivals.SecurityAgentsEvals](https://thesimind.si/papers/2611.24313/)

[Number 11](https://thesimind.si/papers/2611.14880/) · [All 12 for Nov 13, 2026](https://thesimind.si/papers/day/2026-11-13/)
