sudacode/SubMiner
1
0 Fork 0
mirror of https://github.com/ksyasuda/SubMiner.git synced 2026-10-27 11:35:23 -07:00
Code Issues Packages Projects Releases Wiki Activity

refactor(tokenizer): extract subtitle annotation filter into rule table (#162)

Browse Source
This commit is contained in:
sudacode authored and GitHub committed 2026-07-12 23:54:13 -07:00
1 parent 21a06c12fb
commit 0ab840b362
6 files changed
+706 -415
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

changes/annotation-noise-rule-table.md
+4
View File
@@ -0,0 +1,4 @@
type: fixed
area: overlay
- Applied configured primary POS exclusions consistently to merged trailing quote-particle tokens, preserved annotations for supplementary-plane kanji, and stopped treating katakana punctuation as kana-only annotation noise.