cmark/src/html_unescape.h, branch master My own fork of cmark for commonmark conversion Replace gperf-based entity lookup with binary tree lookup. 2015-06-16T19:59:47+00:00 John MacFarlane jgm@berkeley.edu 2015-06-16T16:54:31+00:00 208c794def61eb819ed6eebe1d51867613addce0 The primary advantage is a big reduction in the size of the compiled library and executable (> 100K). There should be no measurable performance difference in normal documents. I detected a slight performance hit (around 5%) in a file containing 1,000,000 entities. * Removed `src/html_unescape.gperf` and `src/html_unescape.h`. * Added `src/entities.h` (generated by `tools/make_entities_h.py`). * Added binary tree lookup functions to `houdini_html_u.c`, and use the data in `src/entities.h`. 
The primary advantage is a big reduction in the size of
the compiled library and executable (> 100K).

There should be no measurable performance difference in
normal documents.  I detected a slight performance
hit (around 5%) in a file containing 1,000,000 entities.

* Removed `src/html_unescape.gperf` and `src/html_unescape.h`.
* Added `src/entities.h` (generated by `tools/make_entities_h.py`).
* Added binary tree lookup functions to `houdini_html_u.c`, and
  use the data in `src/entities.h`.
Fixed entity lookup table. 2015-06-13T23:00:00+00:00 John MacFarlane jgm@berkeley.edu 2015-06-13T22:49:59+00:00 cdcb65c5a209a1a3be4a1b9e804f5a4292127509 The old one had many errors. The new one is derived from the list in the npm entities package. Since the sequences can now be longer (multi-code-point), we have bumped the length limit from 4 to 8, which also affects houdini_html_u.c. An example of the kind of error that was fixed in given in jgm/commonmark.js#47: `≧̸` should be rendered as "≧̸" (U+02267 U+00338), but it's actually rendered as "≧" (which is the same as `≧`). 
The old one had many errors.
The new one is derived from the list in the npm entities package.
Since the sequences can now be longer (multi-code-point), we
have bumped the length limit from 4 to 8, which also affects
houdini_html_u.c.

An example of the kind of error that was fixed in given
in jgm/commonmark.js#47: `≧̸` should be rendered as "≧̸" (U+02267
U+00338), but it's actually rendered as "≧" (which is the same as
`≧`).
Reduce size of gperf entity table 2015-01-12T01:11:16+00:00 Nick Wellnhofer wellnhofer@aevum.de 2015-01-11T00:08:02+00:00 491b7775b273daf1325a1b050345dbf75b394315 Don't store length of UTF-8 string. It can be computed by NULL-terminating strings shorter than 4 bytes and using strnlen. Use gperf's string pool option. This allows to use an 'int' index into the string pool instead of a pointer and is helpful on 64-bit systems. Shaves about 75 KB off the 32-bit binaries on Linux and 128 KB off the 64-bit binaries on OS X. 
Don't store length of UTF-8 string. It can be computed by
NULL-terminating strings shorter than 4 bytes and using strnlen.

Use gperf's string pool option. This allows to use an 'int' index into the
string pool instead of a pointer and is helpful on 64-bit systems.

Shaves about 75 KB off the 32-bit binaries on Linux and 128 KB off the
64-bit binaries on OS X.
Create html_unescape.h with extra struct initializers 2014-12-08T17:11:47+00:00 Nick Wellnhofer wellnhofer@aevum.de 2014-12-08T17:11:47+00:00 a752c95b439272420525d9a1fbe12f2413625795 Fixes missing initializer warnings. 
Fixes missing initializer warnings.
Moved source files from src/html into src. 2014-12-05T07:13:54+00:00 John MacFarlane jgm@berkeley.edu 2014-12-05T07:13:54+00:00 27bd6c0b18318a9c43801409bbababf2ceb6302e The separate directory presents problems for some simple extension building systems, like luarocks. 
The separate directory presents problems for some simple
extension building systems, like luarocks.