Commit Graph

11 Commits

Author SHA1 Message Date
Maurice Makaay 3f9c745ac4 Unit tests improved for the parsekit.read package. 2019-07-19 09:50:42 +00:00
Maurice Makaay 22bcf4677e Some work on simlifying the reader code, to see if I can squeeze some more performance out of that part. 2019-07-19 08:47:13 +00:00
Maurice Makaay 0a4e44b8f8 Allow for bufio Readers that deliver data in chunks (like our unit test Reader) 2019-07-17 23:03:00 +00:00
Maurice Makaay 6d3eacdcae Allocate read buffer in 1024 byte chunks, and read the data in chunks as well. This is more efficient than reading byte by byte. 2019-07-17 22:12:37 +00:00
Maurice Makaay 0362763e83 Switched to byte input for built-in tokenize.Handler functions. 2019-07-15 22:48:00 +00:00
Maurice Makaay d4492e4f0a Bytes reader working, now carry on switching to byte reading in the tokenizer code. 2019-07-15 20:03:05 +00:00
Maurice Makaay 56b8df3aab Removed loop protection code. This is useful, but it puts a performance burden on the code when doing it by keeping track of actual callers through the call stack. Maybe to be reintroduced in a future version with something like a simple counter and a maximum depth-style protection. 2019-07-12 12:33:18 +00:00
Maurice Makaay 7bc7fda593 Backup changes for performance fixes. 2019-07-05 15:07:07 +00:00
Maurice Makaay 5e9879326a Backup work to performance tuning. 2019-07-05 08:08:42 +00:00
Maurice Makaay cef6ae1bc4 Working on documentation. 2019-06-12 15:24:09 +00:00
Maurice Makaay 27c97ae902 Big overhaul on separating packages for code containment. 2019-06-12 14:30:46 +00:00