Commit Graph

3 Commits

Author SHA1 Message Date
1cd1cdb11d refactor(cli): remove deprecated verbose logging flags 2026-02-17 00:57:44 -08:00
kyasuda
457e6f0f10 feat(tokenizer): refine Yomitan grouping and parser tooling
- map segmented Yomitan lines into single logical tokens and improve candidate selection heuristics

- limit frequency lookup to selected token text with POS-based exclusions and add debug logging hook

- add standalone Yomitan parser test script, deterministic utility-script shutdown, and docs/backlog updates
2026-02-16 17:41:24 -08:00
kyasuda
0eb2868805 Fix Yomitan token headword frequency matching and add frequency tests 2026-02-16 13:21:19 -08:00