Commit Graph

20 Commits

Author SHA1 Message Date
Maurice Makaay e0b1039abd Made a big jump in performance on big files with lots of comments, by reading in chunks till end of line, instead of byte-by-byte. 2019-07-28 23:50:58 +00:00
Maurice Makaay 53ae659ef6 Moving results to their own light weight tokenize.API.Result. 2019-07-28 22:35:33 +00:00
Maurice Makaay fcdd3d4ea7 Wow, going nicely! Some more miliseconds stripped. 2019-07-26 22:56:12 +00:00
Maurice Makaay 7037c6d24a Fixing some naming inconsistencies. 2019-07-23 17:55:13 +00:00
Maurice Makaay cf679b2225 Backup work for next refactoring step. 2019-07-22 22:16:28 +00:00
Maurice Makaay 070e6a13a7 Made some nice steps, backup and continue! 2019-07-22 15:37:52 +00:00
Maurice Makaay 7d2d8dbed3 Moved input-related functions to their own API.Input struct. 2019-07-19 23:41:15 +00:00
Maurice Makaay 9d98c9dff7 Moving output functions to its own substruct of the API. 2019-07-19 22:57:06 +00:00
Maurice Makaay 458d6f60a6 A nice performance gain by making a difference between AcceptRunes/AcceptBytes and the new simpler AcceptRune/AcceptByte functions. The simpler versions are faster when only accepting a single byte or rune (which is the case in most situations). 2019-07-19 21:13:15 +00:00
Maurice Makaay 9a53ea9012 Working on API speed. 2019-07-19 14:44:44 +00:00
Maurice Makaay 56b8df3aab Removed loop protection code. This is useful, but it puts a performance burden on the code when doing it by keeping track of actual callers through the call stack. Maybe to be reintroduced in a future version with something like a simple counter and a maximum depth-style protection. 2019-07-12 12:33:18 +00:00
Maurice Makaay a4eda45d2c Made all unit tests work again. 2019-07-11 14:55:08 +00:00
Maurice Makaay c532af67ca Optimization round completed (for now :-) All tests successful. 2019-07-11 12:43:57 +00:00
Maurice Makaay 5fa0b5eace Backup work on performance improvements. 2019-07-08 14:31:01 +00:00
Maurice Makaay 23ca3501e1 Backup changes for performance fixes. 2019-07-08 00:12:30 +00:00
Maurice Makaay 583197c37a Made a distinction between MatchWhitespace() and MatchUnicodeSpace(). 2019-07-04 11:32:07 +00:00
Maurice Makaay d96511ce0a Backup work. 2019-07-03 15:46:43 +00:00
Maurice Makaay cef6ae1bc4 Working on documentation. 2019-06-12 15:24:09 +00:00
Maurice Makaay 27c97ae902 Big overhaul on separating packages for code containment. 2019-06-12 14:30:46 +00:00
Maurice Makaay 1f0e0fcc17 Splitting up functionality in packages, intermediate step. 2019-06-11 22:23:30 +00:00