sudacode/SubMiner
1
0 Fork 0
mirror of https://github.com/ksyasuda/SubMiner.git synced 2026-11-11 04:46:07 -08:00
Code Issues Packages Projects Releases Wiki Activity

Fix tokenizer annotations for explanatory contrast ending (#33)

Browse Source
This commit is contained in:
sudacode authored and GitHub committed 2026-03-23 09:25:17 -07:00
1 parent 0317c7f011
commit c17f0a4080
5 files changed
+184
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

changes/2026-03-23-tokenizer-explanatory-contrast-ending.md
+4
View File
@@ -0,0 +1,4 @@
type: fixed
area: tokenizer
- Fixed subtitle annotation clearing so explanatory contrast endings like `んですけど` are excluded consistently across the shared tokenizer filter and annotation stage.