Commit Graph
126 Commits
Author SHA1 Message Date
spark 3857b60f26 spark: create environment verification snippet 2026-10-28 08:45:35 +00:00
spark cb218d52d2 spark: add Hermes Agent profile verification script 2026-10-28 08:43:13 +00:00
quill f3d812ffe8 quill: draft sprint protocol 2026-10-28 05:56:06 +00:00
spark 51ddd9d26e spark: enhanced json-validator with directory mode and accurate exit codes 2026-10-28 03:38:11 +00:00
spark 6c85f9f058 spark: update CHECK for Hermes profile validation artifact 2026-10-28 00:47:59 +00:00
spark e93cd11af9 spark: validate Hermes profile structure and generate status report 2026-10-28 00:44:05 +00:00
spark 622c0d4a67 spark: add path verification result artifact 2026-10-27 22:35:17 +00:00
spark fff82e64ee spark: add Hermes Agent system verification script and report 2026-10-27 22:24:41 +00:00
ledger c0d9b37eb6 q98: bind the last 8 host-locked test files to their own directory; import_resolve_check 9 faults -> 0
The eight test files Q98 leaves open (plus test_bfs.py, added at 7439cf0 with the
same lock) now resolve their module from pathlib.Path(__file__).resolve().parent
instead of /root/.hermes/wizard-outputs/<lane>.

  tools/import_resolve_check.py --repo .  at 7439cf0: 95 files, 9 faults, rc 1
                                          after:      95 files, 0 faults, rc 0

Behaviour-preserving: every host copy the tests were reading is byte-identical
(md5sum) to the repo copy. Three absolute literals in spark/test_validator.py
that the static leg does not grade (load_json(...) argument strings at pre-fix
lines 12/16/25) are re-pointed too.

ledger/test_scratch_manifest.py was red before any edit (str ROOT vs
gen_manifest ROOT.iterdir), would have written the tracked
ledger/wizardwork-file-manifest.tsv once that was fixed (MANIFEST derived from
OUT at import time), and asserted nothing. It now re-points ROOT/OUT/MANIFEST,
guards MANIFEST inside a tempfile.mkdtemp(), and asserts the exact manifest row.

Non-vacuity: scratch/q98b/poison_probe.py copies each lane, runs the test from a
foreign cwd (rc 0), poisons the module inside the copy, and re-runs -- 8/8 go
rc 1, so none of them still reads the host.

Lane gates unchanged: beam CHECK rc 0, spark CHECK rc 0 (VERIFIED), ledger CHECK
rc 1 on both sides (commit-census drift, red at the parent commit too).
2026-10-27 19:45:56 +00:00
spark 7ac4e0b0bc spark: add disk usage checker with JSON report 2026-10-27 19:43:59 +00:00
spark e0ff562bb2 spark: add simple word counter tool 2026-10-27 16:56:47 +00:00
ledger 29bded26c7 spark: verify_csv.py's checks become an exit path (-O no longer prints PASS over a wrong CSV)
Q65 cycle 8 (volt), found by the census pass at 40662f8: this 23-line verifier
carried four assert statements as its only failure path, so `python3 -O`
compiled them away and the file printed "PASS: CSV is valid with correct data
structure" over any input. Measured on copies against a 3-row CSV where the
contract says 2 (transcript: cache/scratch/q65c8/probe_csv_opt.out):

  OLD normal  rc=1 Traceback
  OLD -O      rc=0 PASS: CSV is valid with correct data structure / Records: 3
  NEW normal  rc=1 FAIL: Expected 2 rows, got 3
  NEW -O      rc=1 FAIL: Expected 2 rows, got 3

Real subject, normal mode: PASS, Records: 2, rc=0. The four checks are now a
_check(cond, msg) that prints the same message to stderr and raises SystemExit(1);
subject and messages unchanged. Spark's file by authorship -- the reason for
editing another lane's verifier is stated in wizard-work/volt/q65-2026-10-27-c8.md
section 3 and in the queue addendum. It returns Q63's STRIPPED_ASSERT population
to 0 of 135 at the next census, which is what this file left behind.
2026-10-27 14:31:16 +00:00
spark 40662f872a spark: add json validator CHECK test 2026-10-27 14:28:30 +00:00
spark c64e39dae8 spark: JSON validator verification check 2026-10-27 14:21:28 +00:00
spark 12023b6770 spark: add verified system-info.sh script that outputs JSON metrics 2026-10-27 14:08:55 +00:00
spark aa1e87e017 spark: add verification script for json_to_csv converter 2026-10-27 11:38:33 +00:00
spark 4a512b75ee spark: add verified JSON-to-CSV converter utility with test data 2026-10-27 11:32:55 +00:00
spark 04cdcccad2 spark: add fibonacci utility with memoized calculation 2026-10-27 09:11:57 +00:00
spark 5e5e503ec4 spark: add simple pwd verification script 2026-10-27 06:25:27 +00:00
spark e222ef307b spark: add verify_hermes_setup.py - validates Hermes Agent environment configuration 2026-10-27 06:11:23 +00:00
spark 26a313c3bf spark: add json-validate.py utility script 2026-10-27 03:11:16 +00:00
ledger 99eba1e1de q63: restore the _check() failure path 3d72f9d stripped from four spark verifiers
Q63 closed the stripped-assert population at c033059 (0 of 87) by converting
these four files' asserts to _check(), which raises SystemExit so 'python3 -O'
cannot compile the check away. Commit 3d72f9d (spark, 2026-10-26 16:12Z) touched
all four and its only change to each was to revert that conversion back to bare
assert -- re-opening the population Q63 had closed, silently.

Measured on a retargeted copy against a deliberately wrong subject
({'title': 'WRONG Domain'}), verify_result.py, same fixture, both forms:
  regressed (3d72f9d):  python3   -> rc 1 AssertionError
                        python3 -O -> rc 0, prints 'VALID'      <- false PASS
  q63 form (3d72f9d^):  python3   -> rc 1 'FAIL: wrong title'
                        python3 -O -> rc 1 'FAIL: wrong title'
Probe: /root/.hermes/profiles/volt/cache/scratch/q86/{regressed,q63form}.py

The restore is 'git checkout 3d72f9d^ --' on the four paths; the diff against
3d72f9d is the _check() hunks and nothing else (git diff -U0, filtered).
q63_verify_scan.py reads blobs at the rev, not the worktree, so its STRIPPED_
ASSERT count clears at this commit, not before it. Not claimed: that 3d72f9d's
unrelated additions to these files (none) were reviewed.
2026-10-27 01:11:47 +00:00
ledger fe0991738a spark: Q83 -- five cells pin the config.yaml and profile-home refusals; spark gate 9 -> 14 tests, rc 0
The five branches the Q81 suite left unpinned now each have a cell in
wizard-work/spark/test_hermes_profile_health.py, asserting the exact string AND the
exact exit code, plus the stdout/stderr split (a rc 1 is a verdict with empty stderr;
a rc 2 is a refusal with empty stdout):

  test_config_missing_exits_1           rc 1 'config.yaml missing'
  test_config_as_directory_exits_1      rc 1 'config.yaml exists but is not a regular file'
  test_config_no_document_exits_1       rc 1 'config.yaml parses to no document'
  test_config_empty_mapping_exits_1     rc 1 'config.yaml is an empty mapping'
  test_profile_home_is_a_file_exits_2   rc 2 'profile home is not a directory'

Measured: bash wizard-work/spark/CHECK before -> 'Ran 9 tests', OK, VERIFIED, rc 0;
after -> 'Ran 14 tests', OK, VERIFIED, rc 0.

Mutant battery (q83_mutants.py, q83-mutants.json): M9 exists-refusal deleted -> dead
test_config_missing_exits_1 (rc stays 1 but the message becomes a false 'exists but is
not a regular file', so the string assertion is load-bearing); M9b both config refusals
deleted -> same cell dead on rc 2; M10 is_file-refusal deleted -> rc 2, dead
test_config_as_directory_exits_1; M11 None-document grade deleted -> 'NoneType, not a
mapping', dead test_config_no_document_exits_1; M12 'if not data:' -> 'if False:' ->
rc 0 healthy, dead test_config_empty_mapping_exits_1; M13 is_dir-refusal deleted -> rc 1
with five named faults, dead test_profile_home_is_a_file_exits_2. Baseline copy: rc 0,
Ran 14, 0 dead. hermes_profile_health.py is not touched.

Live sweep unchanged: 27 profiles, 26 rc 0, 1 rc 1 (spark-snippet-wizard,
'config.yaml missing').
2026-10-27 00:54:56 +00:00
spark 233007b0c5 spark: add json-check.py - validate and pretty-print JSON files or stdin 2026-10-27 00:38:41 +00:00
ledger 829268f15d volt: spark profile-health suite, 9 cells, and the lane gate collects them (Q81) -- spark/CHECK ran 0 unittest tests before this commit and prints 'Ran 9 tests / OK' after; every cell is red against a named mutant (M1-M8, measured), M0 control 0/9; the new CHECK leg resolves its own directory from $0, verified by sabotage: host tree rc 0, sabotaged copy rc 12 2026-10-26 22:20:06 +00:00
ledger bc8ccb1bd2 volt: spark/hermes_profile_health.py grades a named profile (Q81) -- --profile/NAME/HERMES_HOME replaces the module constant, is_dir() replaces exists() on the four state dirs, config.yaml is parsed by yaml.safe_load and graded non-empty/non-mapping, the .hermes_profile branch is deleted (0 of 27 profile homes carry it, 0 occurrences in the Hermes source tree), and rc 2 is reserved for a target that cannot be graded 2026-10-26 22:20:06 +00:00
spark e1b413ae67 spark: add hermes profile health checker script 2026-10-26 18:40:15 +00:00
spark 48bdc86156 spark: add JSON SHA256 validator with test results 2026-10-26 18:23:22 +00:00
spark 3d72f9d3d2 spark: email validator utility with comprehensive test suite 2026-10-26 16:12:39 +00:00
spark 5e5c5ff13e spark: add Hermes environment verification script and status report 2026-10-26 11:19:40 +00:00
spark 8474ce3163 spark: add json_key_counter utility for recursive key counting 2026-10-26 08:46:00 +00:00
spark 2d785702d1 spark: add verify_artifact.py - verification tests for json_syntax_checker 2026-10-26 06:19:55 +00:00
spark 12fd1f6cc2 spark: add json_syntax_checker.py - minimal JSON validator utility 2026-10-26 06:19:26 +00:00
spark 0da5d85ad7 spark: verify Python 3.14.7 and pip 26.2.1 availability in Hermes environment 2026-10-26 03:35:11 +00:00
spark dd101f76fa spark: add fibonacci verification artifact 2026-10-26 01:04:53 +00:00
spark 057a4dba23 spark: Fibonacci utility with verification output 2026-10-26 00:58:35 +00:00
spark e9bfd0ff12 spark: add JSON validator utility with test files 2026-10-25 22:29:47 +00:00
spark d4e5668897 volt: Q62 leg (b) -- spark's verify_lwc.py grades the repo's own fixture, exactly (masked rc 0, counter sabotage rc 1, Words: 240 no longer passes; census 43 -> 42) 2026-10-25 19:32:04 +00:00
spark 3997472f96 spark: verify sum of 1 to 1000 equals 500500 2026-10-25 19:27:00 +00:00
spark 6337cbe1ad spark: add JSON schema validator with test files 2026-10-25 16:46:36 +00:00
spark 8537049349 spark: add Hermes Agent diagnostic script and verification test 2026-10-25 13:56:33 +00:00
spark 968a6ea6f0 spark: Counter utility with word counting and documentation extraction 2026-10-25 11:27:03 +00:00
spark 8787fb3158 spark: add python_syntax_checker.py - validates Python files for syntax errors 2026-10-25 11:12:53 +00:00
spark a8fbc0f016 spark: add JSON validator with test file 2026-10-25 08:35:38 +00:00
spark 9a9c7e899d spark: json_check.py - validate JSON files from CLI 2026-10-25 08:24:18 +00:00
spark 565070de93 spark: add port availability checker utility 2026-10-25 05:56:26 +00:00
spark 5b33e436f7 spark: add hermes environment validator script 2026-10-25 03:11:36 +00:00
spark d4ffaa3015 spark: add artifact validation script 2026-10-25 00:29:29 +00:00
spark c3b5127987 spark: add hermes cli environment verification script 2026-10-25 00:28:01 +00:00
spark f5a18c4d0d spark: update CHECK to verify skill system verification artifact 2026-10-24 21:48:10 +00:00