kyasuda 457e6f0f10 feat(tokenizer): refine Yomitan grouping and parser tooling ...

- map segmented Yomitan lines into single logical tokens and improve candidate selection heuristics

- limit frequency lookup to selected token text with POS-based exclusions and add debug logging hook

- add standalone Yomitan parser test script, deterministic utility-script shutdown, and docs/backlog updates

2026-02-16 17:41:24 -08:00

..

theme

update docs

2026-02-14 01:44:52 -08:00

config.ts

feat(tokenizer): refine Yomitan grouping and parser tooling

2026-02-16 17:41:24 -08:00