Commit Graph

30 Commits

Author SHA1 Message Date
Maurice Makaay 8ef9aed096 Switching from various Byte and Rune handlers to single Char handlers.
The Char handlers determine on their own if they should handle things
in byte or rune mode.
2019-07-29 09:45:25 +00:00
Maurice Makaay e0b1039abd Made a big jump in performance on big files with lots of comments, by reading in chunks till end of line, instead of byte-by-byte. 2019-07-28 23:50:58 +00:00
Maurice Makaay 53ae659ef6 Moving results to their own light weight tokenize.API.Result. 2019-07-28 22:35:33 +00:00
Maurice Makaay eda71f304e Dropped PeekWithResult(), because it does not add any substantial performance. A simpler API which is virtually as fast wins any day. 2019-07-27 12:26:02 +00:00
Maurice Makaay fcdd3d4ea7 Wow, going nicely! Some more miliseconds stripped. 2019-07-26 22:56:12 +00:00
Maurice Makaay 87cdadae78 Hmm... this whole snapshot idea seems to work and a valid replacement for the forking method. 2019-07-26 08:02:37 +00:00
Maurice Makaay bc9e718e47 Lowering the number of forks required. 2019-07-24 22:42:40 +00:00
Maurice Makaay 802701ade5 Added multi-byte peeks for some performance improvements. 2019-07-23 23:23:40 +00:00
Maurice Makaay 7037c6d24a Fixing some naming inconsistencies. 2019-07-23 17:55:13 +00:00
Maurice Makaay 93d2cfa6f1 Backup work. 2019-07-22 23:28:05 +00:00
Maurice Makaay cf679b2225 Backup work for next refactoring step. 2019-07-22 22:16:28 +00:00
Maurice Makaay 070e6a13a7 Made some nice steps, backup and continue! 2019-07-22 15:37:52 +00:00
Maurice Makaay 7d2d8dbed3 Moved input-related functions to their own API.Input struct. 2019-07-19 23:41:15 +00:00
Maurice Makaay 9d98c9dff7 Moving output functions to its own substruct of the API. 2019-07-19 22:57:06 +00:00
Maurice Makaay 1771e237c0 Switched to a []byte backing store instead of []rune for collecting input data (we can use both bytes and runes for input in an easy way now) 2019-07-18 09:26:11 +00:00
Maurice Makaay 17935b7534 Further performance optimization and code cleanup. 2019-07-12 21:32:40 +00:00
Maurice Makaay 56b8df3aab Removed loop protection code. This is useful, but it puts a performance burden on the code when doing it by keeping track of actual callers through the call stack. Maybe to be reintroduced in a future version with something like a simple counter and a maximum depth-style protection. 2019-07-12 12:33:18 +00:00
Maurice Makaay 3c9a678d7a Fixed the ModifyDrop() behavior. It worked, but it caused memory build-up in the old implementation. 2019-07-11 14:52:12 +00:00
Maurice Makaay c532af67ca Optimization round completed (for now :-) All tests successful. 2019-07-11 12:43:57 +00:00
Maurice Makaay 5fa0b5eace Backup work on performance improvements. 2019-07-08 14:31:01 +00:00
Maurice Makaay 23ca3501e1 Backup changes for performance fixes. 2019-07-08 00:12:30 +00:00
Maurice Makaay 7bc7fda593 Backup changes for performance fixes. 2019-07-05 15:07:07 +00:00
Maurice Makaay 5e9879326a Backup work to performance tuning. 2019-07-05 08:08:42 +00:00
Maurice Makaay 583197c37a Made a distinction between MatchWhitespace() and MatchUnicodeSpace(). 2019-07-04 11:32:07 +00:00
Maurice Makaay 4b0309453f Added a feature to run the parser without any of the built-in sanity checks (like loop checks). This improved performance, but at the risk of missing some runtime issues with the parser implementation. 2019-06-30 01:05:54 +00:00
Maurice Makaay 7ce12d1632 A few small changes used for TOML support. 2019-06-23 12:06:31 +00:00
Maurice Makaay 99654c2f9e Simplified some internal code, which also fixes a bug with correct error reporting from within parsekit in various edge cases. 2019-06-17 13:59:31 +00:00
Maurice Makaay cdfc4ce52c More documentation and examples. 2019-06-12 16:17:13 +00:00
Maurice Makaay cef6ae1bc4 Working on documentation. 2019-06-12 15:24:09 +00:00
Maurice Makaay 27c97ae902 Big overhaul on separating packages for code containment. 2019-06-12 14:30:46 +00:00