Files
SubMiner/backlog/tasks/task-91 - Keep-unsupported-subtitle-characters-visible-while-excluding-them-from-token-hover.md

1.4 KiB

id, title, status, assignee, created_date, updated_date, labels, dependencies, priority
id title status assignee created_date updated_date labels dependencies priority
TASK-91 Keep unsupported subtitle characters visible while excluding them from token hover Done
2026-03-06 08:29 2026-03-06 08:32
bug
tokenizer
renderer
medium

Description

Tokenizer/rendering bug: symbols and other unsupported characters with no lookup result are removed from the rendered subtitle line after tokenization, causing the displayed line to diverge from the source subtitle text. Update rendering so unsupported spans remain visible as plain text but are not tokenized/hoverable, and add regression coverage.

Acceptance Criteria

  • #1 Subtitle rendering preserves unsupported symbols and special characters from the original line.
  • #2 Unsupported symbols and special characters do not create interactive token hover targets.
  • #3 Regression tests cover a mixed line containing tokenizable text plus unsupported characters.

Final Summary

Updated tokenized subtitle rendering to preserve unsupported punctuation and symbol spans as plain text while keeping only matched tokens interactive. Added renderer and alignment regression coverage for mixed lines so hover offsets stay correct after non-tokenizable characters remain visible.