feat(review): add Review Quality Scorer #274

Open
Rockachopa wants to merge 1 commits from step35/127-6-9-review-quality-scorer into main
Owner

Summary

Adds scripts/review_quality_scorer.py — a standalone quality scorer for PR
reviews. It evaluates review comments across five categories:

  • Style (weight 0.15) — formatting, lint, naming
  • Logic (weight 0.25) — correctness, edge cases, reasoning
  • Security (weight 0.25) — vulnerabilities, auth, secrets
  • Performance(weight 0.15) — bottlenecks, efficiency
  • Tests (weight 0.20) — coverage, quality, missing tests

Each category is scored 0–100 based on keyword presence and review depth.
A weighted composite is produced.

Also adds scripts/test_review_quality_scorer.py with 15 unit tests.

Closes #127

## Summary Adds `scripts/review_quality_scorer.py` — a standalone quality scorer for PR reviews. It evaluates review comments across five categories: - **Style** (weight 0.15) — formatting, lint, naming - **Logic** (weight 0.25) — correctness, edge cases, reasoning - **Security** (weight 0.25) — vulnerabilities, auth, secrets - **Performance**(weight 0.15) — bottlenecks, efficiency - **Tests** (weight 0.20) — coverage, quality, missing tests Each category is scored 0–100 based on keyword presence and review depth. A weighted composite is produced. Also adds `scripts/test_review_quality_scorer.py` with 15 unit tests. Closes #127
Rockachopa added 1 commit 2026-04-26 16:26:38 +00:00
feat(review): add Review Quality Scorer (#127)
Some checks failed
Test / pytest (pull_request) Failing after 8s
c4586eb2be
Score PR reviews across 5 categories: style, logic, security,
performance, tests. Produces weighted composite and markdown report.

Closes #127
Owner

🛡️ Goblin Patrol Alert 🛡️

Hey brother — this PR has been idle for 6 days and is unassigned.

The goblin fleet has been notified. A goblin may claim this if it remains stale.

— Timmy Goblin Wizard King

🛡️ **Goblin Patrol Alert** 🛡️ Hey brother — this PR has been idle for **6 days** and is unassigned. The goblin fleet has been notified. A goblin may claim this if it remains stale. — Timmy Goblin Wizard King
Some checks failed
Test / pytest (pull_request) Failing after 8s
This pull request can be merged automatically.
This branch is out-of-date with the base branch
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin step35/127-6-9-review-quality-scorer:step35/127-6-9-review-quality-scorer
git checkout step35/127-6-9-review-quality-scorer
Sign in to join this conversation.