2 Commits

Author	SHA1	Message	Date
sudacode	db4139ba0b	fix(tokenizer): block kanji reading collisions and name/generic length t ... - Add allowReadingOnlyMatch:false to kanji token known-word lookups so 渓谷/けいこく no longer matches a mined 警告/けいこく card via reading-only index - Greedy name pre-pass yields when a strictly longer generic word starts at the same position (空 no longer splits 空気; ties still go to the name)	2026-07-09 01:03:58 -07:00
sudacode	ae40934d3a	fix(tokenizer): greedy name pre-pass to prevent generic matches swallowing character names (#151)	2026-07-08 23:53:45 -07:00