Merge pull request #247 from Witiko/feature/map-unicode-nbsp-to-nbsp-…

…renderer Map non-breaking space to `writer->nbsp` and U+0000 to U+FFFD in strings
Witiko · Jan 9, 2023 · 31d90e6 · 31d90e6
2 parents 8634db6 + 59ea9c6
commit 31d90e6
Show file tree

Hide file tree

Showing 2 changed files with 9 additions and 1 deletion.
diff --git a/CHANGES.md b/CHANGES.md
@@ -8,6 +8,11 @@ Documentation:
 - Update examples for options `bracketedSpans` and `fencedDivs`.
   (499c65a, 532cdb8)
 
+Fixes:
+
+- Map U+0000 to U+FFFD in strings. (lostenderman#34, #247)
+- Map non-breaking space to `writer->nbsp` in strings. (lostenderman#99, #247)
+
 Default Renderer Prototypes:
 
 - Use `paralist` LaTeX package to define default renderer prototypes for
@@ -20,7 +25,8 @@ Default Renderer Prototypes:
 
 Unit Tests:
 
-- Do not fold tabs and spaces into a single space token. (#242)
+- Do not fold tabs and spaces into a single space token.
+  (lostenderman#107, #242)
 
 Speed Improvements:
 

diff --git a/markdown.dtx b/markdown.dtx
@@ -20861,6 +20861,8 @@ function M.writer.new(options)
      ["^"] = "\\markdownRendererCircumflex{}",
      ["~"] = "\\markdownRendererTilde{}",
      ["|"] = "\\markdownRendererPipe{}",
+     [entities.hex_entity('0000')] = entities.hex_entity('FFFD'),
+     [entities.hex_entity('00A0')] = self.nbsp,
    }
 %    \end{macrocode}
 % \par