2 Commits

Author	SHA1	Message	Date
kyasuda	457e6f0f10	feat(tokenizer): refine Yomitan grouping and parser tooling ... - map segmented Yomitan lines into single logical tokens and improve candidate selection heuristics - limit frequency lookup to selected token text with POS-based exclusions and add debug logging hook - add standalone Yomitan parser test script, deterministic utility-script shutdown, and docs/backlog updates	2026-02-16 17:41:24 -08:00
kyasuda	0eb2868805	Fix Yomitan token headword frequency matching and add frequency tests	2026-02-16 13:21:19 -08:00