fix(tokenizer): preserve annotation and enrichment behavior

2026-05-04 00:41:33 -07:00 · 2026-04-26 17:57:39 -07:00
parent 544a770c09
commit 8217d052e9
6 changed files with 55 additions and 16 deletions
@@ -0,0 +1,6 @@
+type: fixed
+area: tokenizer
+
+- Use Yomitan `wordClasses` metadata for subtitle POS filtering.
+- Backfill blank MeCab POS detail fields during parser enrichment.
+- Keep subtitle annotation metadata stripped from token results.