RePath Labs

Combining industry knowledge, research and technology to find new solutions for community supervision.

RePath Labs is the research and development team at eHawk, Inc. We test new technology on real community corrections work, publish what we find, and build what holds up into RePath, so agencies can get better outcomes while spending less time and money.

  • 10M+data points across all dimensions of supervision
  • 10,000+participants and office visits in our research data
  • 100+interviews with officers, agency leaders and industry experts
  • 5,000+sources in our supervision resource library

The idea in 60 seconds

What if every supervision visit got expert feedback?

Five short scenes on the problem our first three studies set out to solve, and what they found.

1 · The gap

Officers hold hundreds of visits. Almost none get reviewed.

The best evidence says what happens inside a visit is the strongest lever an agency has on outcomes. In our experience, a trained auditor can carefully score four to eight visits a day, so many agencies can review only a few of every 100 by hand.

2 · The catch

Even the experts disagree.

Three experienced auditors scored the same 30 visits. On average, two experts' scores for one visit landed 19 to 33 points apart on a 100-point scale. Feedback that depends on who grades it is hard to coach from.

3 · Standard set, standard met

We built one standard. Then our AI met it more closely than any expert's own grades.

First, three experts adjudicated ten visits item by item and agreed on 429 of 430 rubric decisions: an answer key the field rarely has. Graded against it, the RePath AI workflow matched 90.21% of decisions. The experts' own grades from before the panel met matched 50% to 86%.

4 · Coaching

AI coaching rated as highly as expert coaching.

An expert reviewer rated 120 coaching notes without knowing who wrote them. The top AI coach averaged 3.58 of 5, against 3.30 for the higher-rated human coach, and wrote the most notes ready to show an officer as written.

5 · Every visit

Grade every visit. Coach every officer. Keep the skills that cut rearrests.

Caseloads of officers trained in core correctional practices recidivated at 36.2% vs. 49.9% for comparison officers, and those skills fade without feedback. Our studies point to a way to give that feedback on every recorded visit. Field pilots will test whether it changes outcomes.

1 / 5

Figures from RePath Labs Papers 1 to 3 (2026) and Chadwick, DeWolf & Serin (2015). Review rates are illustrative. Coaching examples are invented for illustration, not study text.

Why Labs exists

The technology is moving faster than the field can test it.

AI models now read, reason and write well enough to help with work that once needed a trained expert reading every visit. That opens real opportunities in community corrections, and real risk of tools that promise more than they deliver. Labs finds out which is which on real supervision work, before anything reaches an agency.

Officer time is the scarcest resource

Most of an officer's week goes to documentation and system work, not people. Every hour technology gives back can go to the conversation that changes outcomes.

8 to 10 hoursa week back per officer across RePath agencies

The evidence on what works already exists

Decades of research show that officers who use core correctional practices with fidelity get better outcomes, and that the skills fade without ongoing feedback.

36.2% vs. 49.9%recidivism, trained vs. comparison officers' caseloads (Chadwick et al., 2015)

Failure is expensive for everyone

When supervision fails, the bill goes to jails, prisons, courts, victims and taxpayers. Better practice inside the visit is the cheapest place to prevent it.

$10 billiona year spent locking people up for supervision violations (Council of State Governments)

Our north star

Better outcomes for participants. Less time and money for agencies. Savings the whole community shares.

  1. Participants

    Visits spent on what drives change: goals, problem solving and the next step, not paperwork.

    Lower recidivismThe outcome the training research links to officer skills
  2. Officers

    Specific, evidence-linked coaching on their real visits, plus hours back from documentation.

    8 to 10 hours a weekReturned per officer across RePath agencies
  3. Agencies

    Capacity without new hires, and practice quality leaders can see across every officer and office.

    765 officer hoursReturned in one state DOC's 15-week, three-office pilot
  4. Communities and taxpayers

    Every revocation avoided can mean a jail or prison bed and a court hearing that never happen.

    Nearly 1 in 4 state prison bedsFilled by supervision violations (CSG Justice Center)

What we bring to every study

Ten years of supervision technology, put to work as a research foundation.

Labs is not a lab in the abstract. It sits inside a company that supports 125+ agencies and has spent a decade learning how supervision really runs, visit by visit.

More than 10 million data points and more than 10,000 participants and office visits, combined with our own direct research and our research library.

Alexandria

The largest supervision research library we know of.

Alexandria is RePath Labs' compiled knowledge base of community corrections research, standards, and agency policies and procedures, with profiles of each jurisdiction's supervision system and the assessment instruments agencies use. Labs projects start there, so we build on what the field already knows instead of rediscovering it.

It also lets us answer practical questions fast: how a state structures graduated responses, what a policy requires of a visit, or which instruments an agency already uses.

5,000+
sources, including published research, assessment instruments, and agency policies and procedures

How Labs works

We show our work.

Every idea runs the same path. The bar to reach an agency is evidence, not a demo.

  1. Start from the evidence

    Alexandria, the published literature and national standards set the question and the yardstick.

  2. Build a working prototype

    Fast builds on synthetic or de-identified data, kept separate from the production roadmap.

  3. Test it against experts

    Qualified practitioners grade the same work. We set targets in advance where we can, and say so when we did not.

  4. Publish methods and limits

    Working papers with DOIs, methods and every limitation stated, free to read.

  5. Ship what holds up

    What survives moves into RePath through eHawk's full product development process.

Assistive by design. RePath gives officers and supervisors better information. People make the decisions. Visit grading and coaching are built for skill development, never for hiring, discipline or other personnel decisions.

The RePath Labs Evidence Series

Four papers. One path to better visits.

The training research is clear that officer skills drive outcomes and that the skills need feedback to last. The missing piece has been feedback at scale. Our first three studies test that missing piece, link by link, on real supervision visits. The fourth is the first study we know of to compare decision models, a new class of AI, with large language models against an expert-agreed standard.

  1. Paper 1 · Measure

    Can AI grade a visit like an expert?

    Yes, within the range of three expert auditors.

  2. Paper 2 · Coach

    Can AI coach like an expert?

    Blinded review rated it as highly as human coaching.

  3. Paper 3 · Standardize

    Can experts set one standard, and can AI meet it?

    429 of 430 decisions agreed; AI matched 90.21%.

  4. Paper 4 · Compare

    Can a decision model do the job?

    80 to 83% agreement once adapted, at a fraction of the cost.

Tested in RePath Labs studiesNext in the lab

Paper 1 · Measure

Published · DOI

AI grades supervision visits within the range of expert auditors.

Three experienced auditors and an AI grader scored the same 30 recorded visits against a 43-item rubric built from national standards and core correctional practices. The experts disagreed with one another more than most people expect. The AI landed inside their range.

23 of 30visits where the AI was at least as close to the expert average as the median expert
  • 16 of 18 on visits never used to tune the final prompt.
  • The AI sat closer to each auditor than the auditors sat to each other.
  • Graded three times with no memory, it agreed with itself more closely than any two experts agreed with each other (the experts were not re-tested).

How far apart two experts' scores landed on the same visit

Average gap between each pair of auditors, 100-point weighted visit score, 30 visits (one auditor scored 25)

Closest pair19.0 pts
Second pair28.4 pts
Widest pair33.3 pts
77%

23 of 30 visits (77%) passed the test: the AI's score was no farther from the three-expert average than the median expert's own score.

Source: Green, Warren & Meade (2026), Paper 1, §1 and §5.

Paper 2 · Coach

Published · DOI

AI coaching is rated as highly as expert human coaching.

A score alone does not change practice. Feedback does. An external expert reviewer rated 120 coaching notes on the same 30 visits, four per visit, without knowing which were written by expert coaches and which by AI.

3.58 of 5for the top AI coach, vs. 3.30 for the higher-rated human coach
  • Statistically non-inferior to the higher-rated human coach, and significantly ahead of the other.
  • Best average rank within each visit and the most first-place notes (10 of 30).
  • Most notes judged ready to show an officer as written (13 of 30).

In RePath today: Officer Coach in RePath Intelligence is built on this work. See Officer Coach →

Blinded expert rating of coaching quality

Mean composite of eight 1 to 5 dimensions, 30 visits per source, 95% interval

AI coach, selected3.58
Human coach 13.30
AI coach, second3.30
Human coach 22.98
AI sourceAuthentic human coaching
Source: Green & Warren (2026), Paper 2, Table 1. A follow-on study is using expert feedback to improve the coaching further.

Paper 3 · Standardize

Published · DOI

AI reaches 90% agreement with an expert-agreed standard.

Paper 1 could only show the AI landed inside the experts' spread. So the three experts met, reviewed all 43 rubric items on ten visits together, and agreed on 429 of 430 decisions. That gave the field something it rarely has: an answer key.

90.21%agreement with the expert-agreed standard (Cohen's κ 0.832)
  • The experts' own grades from before the panel met matched the standard 49.65% to 86.01% of the time.
  • 23.15 points above the experts' average, with an average gap of 4.57 points between AI and standard visit scores.
  • All four accuracy targets, set before development began, were met. This is a development result: all ten visits informed the grading instructions.

Agreement with the expert-adjudicated standard

Share of 429 rubric decisions matched, ten development visits

Expert 3, independent49.65%
Expert 2, independent65.50%
Same AI, earlier policy70.40%
Expert 1, independent86.01%
RePath AI workflow90.21%
Expert average: 67.06%. Expert bars are each expert's grades from before the panel met. The striped bar is the same AI under its earlier grading policy; the gain came from the full development process on these ten visits. Source: Green, Warren & Meade (2026), Paper 3.

Taken together

From a small sample to one standard on every visit.

What changes for every 100 recorded supervision visits when grading and coaching no longer depend on how many visits a supervisor can review by hand.

Today
With RePath

Visits graded

Coverage · Paper 1
2 of 100

reviewed by hand (illustrative)

100 of 100

every eligible recorded visit

Graded to one standard

Consistency · Paper 3
No shared key

experts' grades matched the agreed standard 50 to 86%

90.21%

agreement with the expert-agreed standard (ten-visit development study)

Coached

Feedback · Paper 2
2 of 100

reviewed visits coached by a supervisor (illustrative)

100 of 100

coaching rated as highly as human coaching in a blinded 30-visit study

The "Today" columns are illustrative; many agencies review one visit per officer per quarter or year. "With RePath" shows capacity. Quality evidence comes from RePath Labs Papers 1 to 3 (2026).

In RePath today. Visit quality scores and Officer Coach in RePath Intelligence are built on this research. See visit quality scores → See Officer Coach →

“Continuous automated scoring is, in effect, a permanent booster session.”
Green, Warren & Meade (2026), Validating an AI Grader for Community Corrections Supervision Visits

What we have not shown yet

  • None of the three studies measured recidivism or other participant outcomes.
  • Samples were small: 30 visits in Papers 1 and 2, ten adjudicated visits in Paper 3, all of which informed its grading instructions.
  • Paper 2 used one blinded expert reviewer and did not measure change in officer practice.
  • All three are working papers, not yet peer reviewed.

What comes next

Field pilots with partner agencies that track officer skill use over time, then completions and recidivism against a comparison group. A study of improved AI coaching is in expert review now.

“I think Coaching is going to be the best thing you've released. I have a brand new officer who had no prior knowledge of the criminal justice system. I've seen a big improvement in her knowledge of the system and applying the skills we train on.”

Drug court supervisor, Kansas community corrections agency, on Officer Coach
Become a pilot partner →

Beyond large language models

LLMs aren't the only AI models.

In September 2026 a new class of AI arrived: decision models, which answer each question by choosing from a fixed list of allowed answers instead of writing text. Within four weeks one leaderboard tracked more than 170 of them. Paper 4 is the first study we know of to test decision models against an expert-agreed standard in a professional field.

Paper 4 · Compare

Submitted for publication

Decision models reach the frontier range at a fraction of the cost, but not the top.

We gave three decision models, TypeSafe Jev, OpenAI Decisions and Microsoft Decision-1, the same ten visits and 429 expert judgments behind Paper 3. First we dropped them into our LLM-built grading system unchanged. Then we adapted the task to each model, without changing the rubric or the answer key.

80 to 83%agreement for the best decision-model workflows, the same range as three of five frontier LLM workflows
  • A fraction of the cost per visit of the frontier LLM workflows, at about a second per call.
  • Every answer was a valid label, and one setup returned identical answers on three runs.
  • Not a drop-in replacement: unchanged, they matched 65 to 77%, and the best LLM workflow, GPT-6 Astra, stayed ahead at 90.2%.

Agreement with the same expert standard

Share of 429 expert judgments matched, ten development visits

GPT-6 Astra90.21%
Grok 4.685.55%
GPT-5.6 Luna82.05%
Claude Sonnet 581.59%
Gemini 3.1 Pro80.89%
Jev80.42%
OpenAI Decisions79.72%
Microsoft Decision-170.40%
Experts' average67.06%

Frontier LLM workflowDecision model, task adaptedHuman experts

Jev is its fresh-control vote; its best answer order reached 82.98%, chosen after seeing results. LLM rows are the Paper 3 workflows, which differ in development effort and calls per answer. The experts' average is their grades from before the panel met. Source: Green & Warren (2026), Paper 4.

How the two kinds of AI differ

PropertyFrontier LLMDecision model
What it returnsOpen-ended text, images or codeOne answer from a fixed list, usually with a probability
Can it make things up?Yes: quotes, citations, reasonsNo, only allowed answers, though it can still return one experts would not choose
Best suited toHolistic judgment and nuanced evidenceBounded questions with concrete, observable evidence
“Systems should be built around the strengths of the tools they use and tested against a human reference to choose the right tool for each task.”
Green & Warren (2026), Decision Models in a System Built for Language Models

Questions

Questions agencies and researchers ask about Labs

What is RePath Labs?

RePath Labs is the research and development team at eHawk, Inc., the company that builds RePath, a smartphone-based supervision platform used by 125+ probation, parole, pretrial, treatment court and juvenile agencies. Labs tests new technology, especially AI, on real community corrections work, publishes the results, and moves what holds up into RePath. Ted Green directs RePath Labs.

Are the RePath Labs papers peer reviewed?

Not yet. They are working papers (preprints) posted with permanent DOIs so they can be read, cited and challenged now. Each discloses its methods, data handling, conflicts of interest and limitations. A DOI makes a paper permanent and citable; it is not peer review, and we do not describe it as one.

Does the AI make decisions about officers or participants?

No. Visit grading and coaching are built to help officers develop skills and to help supervisors coach. The papers state plainly that scores are not intended for hiring, firing, promotion, discipline or any other personnel decision. Officers and supervisors make every decision about a case.

Has RePath shown that AI coaching reduces recidivism?

While the well-accepted literature documents a strong relationship between the quality of visits and reduced recidivism, we need more field data over time to establish that relationship for AI coaching. That research also shows officers' skills fade without feedback. In our studies, on small samples, AI grading tracked expert auditors and a blinded expert rated AI coaching notes as highly as expert coaches' notes. Whether that feedback, delivered on every visit, changes officer practice and lowers recidivism is what our field pilots will measure.

What is Alexandria?

Alexandria is RePath Labs' compiled library of community corrections research, standards, and agency policies and procedures, with profiles of 55 jurisdictions and the assessment instruments agencies use: more than 5,000 sources in all. It is where Labs projects start.

How can an agency or researcher work with RePath Labs?

We are recruiting agencies for field pilots that measure officer skill use over time, then completions and recidivism against a comparison group. Researchers can request methods detail or discuss collaboration. Email Ted Green at tedgreen@ehawksolutions.com.

Partner with RePath Labs

Help us measure what feedback on every visit can do.

We are recruiting agency partners for field pilots that track officer skill use over time, then completions and recidivism against a comparison group. Partners shape the study, see results first, and help the field answer its most important open question.

Ted Green

Director, RePath Labs · Co-founder and COO, eHawk, Inc.

tedgreen@ehawksolutions.com
  • Agency field pilots
  • Research collaboration and methods requests
  • Speaking, webinars and association briefings
Are you using the RePath app and need help? Get support →
Book a Demo