Maurice Makaay
a4eda45d2c
Made all unit tests work again.
2019-07-11 14:55:08 +00:00
Maurice Makaay
3c9a678d7a
Fixed the ModifyDrop() behavior. It worked, but it caused memory build-up in the old implementation.
2019-07-11 14:52:12 +00:00
Maurice Makaay
c532af67ca
Optimization round completed (for now :-) All tests successful.
2019-07-11 12:43:57 +00:00
Maurice Makaay
7598b62dd0
Finalized the work-through of the new version of the tokenizer code.
2019-07-10 20:36:21 +00:00
Maurice Makaay
48d7fda9f8
New implementation for performance.
2019-07-10 11:26:47 +00:00
Maurice Makaay
7795588fe6
Speed improvement work.
2019-07-08 21:57:32 +00:00
Maurice Makaay
5fa0b5eace
Backup work on performance improvements.
2019-07-08 14:31:01 +00:00
Maurice Makaay
23ca3501e1
Backup changes for performance fixes.
2019-07-08 00:12:30 +00:00
Maurice Makaay
7bc7fda593
Backup changes for performance fixes.
2019-07-05 15:07:07 +00:00
Maurice Makaay
5e9879326a
Backup work to performance tuning.
2019-07-05 08:08:42 +00:00
Maurice Makaay
583197c37a
Made a distinction between MatchWhitespace() and MatchUnicodeSpace().
2019-07-04 11:32:07 +00:00
Maurice Makaay
d96511ce0a
Backup work.
2019-07-03 15:46:43 +00:00
Maurice Makaay
92e6eec7f3
implemented Cursor.moveByRune(), to get rid of some useless rune->string conversion for updating cursor positions.
2019-06-30 10:16:46 +00:00
Maurice Makaay
4b0309453f
Added a feature to run the parser without any of the built-in sanity checks (like loop checks). This improved performance, but at the risk of missing some runtime issues with the parser implementation.
2019-06-30 01:05:54 +00:00
Maurice Makaay
7ce12d1632
A few small changes used for TOML support.
2019-06-23 12:06:31 +00:00
Maurice Makaay
5904da9677
Added some package docs.
2019-06-18 22:52:17 +00:00
Maurice Makaay
2293627232
Small code cleanup things, mainly backing up the changes.
2019-06-18 15:46:09 +00:00
Maurice Makaay
99654c2f9e
Simplified some internal code, which also fixes a bug with correct error reporting from within parsekit in various edge cases.
2019-06-17 13:59:31 +00:00
Maurice Makaay
cdfc4ce52c
More documentation and examples.
2019-06-12 16:17:13 +00:00
Maurice Makaay
1a280233b0
Got rid of the testify dependency. My testing needs are so basic, that there's no need for this full fledged testing library.
2019-06-12 15:25:15 +00:00
Maurice Makaay
cef6ae1bc4
Working on documentation.
2019-06-12 15:24:09 +00:00
Maurice Makaay
27c97ae902
Big overhaul on separating packages for code containment.
2019-06-12 14:30:46 +00:00
Maurice Makaay
1f0e0fcc17
Splitting up functionality in packages, intermediate step.
2019-06-11 22:23:30 +00:00
Maurice Makaay
0f7b4e0d26
Added a few syntactic sugar methods for ParseHandler.
2019-06-11 09:09:41 +00:00
Maurice Makaay
65895ac502
Making parsekit.reader both simpler and more complex (more complex by adopting some buffer allocation logic from the built-in bytes package, to not be copying memory all the time during the read operations.
2019-06-09 21:55:01 +00:00
Maurice Makaay
9656cd4449
The parsekit.reader.Reader now caches error messages that are returned from
...
the embedded io.Reader. When an error is returned, the read offset and the
error are stored. When later on, the same of a higher offset is requested,
the error is returned again. This way the code will work for Readers that do
not repeatedly return the correct error when calling the Read() method
multiple times arter a first error has occurred.
Note: I am not sure if there are any Reader implementations that wouldn't
return the same error message over and over again, but hardening the
parsekit Reader to support this is not hard, so let's just go for it.
2019-06-09 19:42:20 +00:00
Maurice Makaay
76336e883e
Removed the use of Error.Full(). The default Error() method now includes the extra data from Full() (line and column offset)
2019-06-09 15:20:44 +00:00
Maurice Makaay
add28feb33
In the spirit of Go, slimmed down the ParseAPI interface. I'm no longer using ParseAPI.On(..).<DoSomething>(), but now it's simply ParseAPI.<DoSomething>(). I also dropped the difference between a Stay() and an Accept(). All that is possible now is ParseAPI.Peek() and ParseAPI.Accept().
2019-06-09 10:25:49 +00:00
Maurice Makaay
9f5caa2024
Backup work.
2019-06-08 22:48:56 +00:00
Maurice Makaay
05ae55c487
Brought the examples up-to-date with the lateset code. All are working correctly now.
2019-06-07 16:20:32 +00:00
Maurice Makaay
40bad51064
Improvement a few TokanHandlers by letting them make use of the new MatchRuneByCallback method, instead of having them implement their own logic.
2019-06-07 15:57:53 +00:00
Maurice Makaay
9a5bf8b9af
Further code cleaning for the interaction between ParseAPI and TokenAPI. Extra atoms added, also one based on a callback which can accept single runes based on thhat callback function.
2019-06-07 15:48:49 +00:00
Maurice Makaay
98d2db0374
Moved Reader into its own package.
2019-06-07 10:55:55 +00:00
Maurice Makaay
6d92e1dc68
Merged functionality of p.Expects(string) and p.UnexpectedInput().
...
It is now simply p.UnexpectedInput(string). This makes the naming
of unexpected input not as magical, but explicit (which is a GoodThing).
With one of the earlier incarnations of parsekit it did make sense,
but it went in a way in which explicit is more idiomatic for the package.
2019-06-07 07:56:24 +00:00
Maurice Makaay
3094b09284
Adding documentation and getting the interactions between ParseAPI and TokenAPI cleaned up a bit.
2019-06-07 07:26:41 +00:00
Maurice Makaay
c0389283bd
Added input check for MatchIntegerBetween()
2019-06-05 22:21:34 +00:00
Maurice Makaay
3d791233e0
Added a lot of IP-address-related TokenHandlers, so we can now process IPv4 addresses, IPv6 addresses, CIDR netmasks, IPv4 dotted quad netmasks, IPv4Net (ipv4 + mask) and IPv6Mask (ipv6 + mask).
2019-06-05 22:16:09 +00:00
Maurice Makaay
05585db341
Normalizing error handling, to always include the caller location in errors. This makes debugging a lot easier for users of the package, because it doesn't say stuff like 'Method() was called incorrectly', but instead something like 'Method() was called incorrectlty at /path/to/file.go:1234'.
2019-06-05 10:07:50 +00:00
Maurice Makaay
75373e5ed5
Big simplification run once more, cleaned up code, added tests and examples, made stuff unexported where possible, to slim down the exported interface.
2019-06-04 23:15:02 +00:00
Maurice Makaay
4580962fb8
Backup a load of work on typed token support, making it easy to produce tokens directly from parser/combinator-based parsing rules.
2019-06-04 00:03:08 +00:00
Maurice Makaay
21f1aa597c
Made the panic() calls (which basically indicate parser implementation bugs) more useful by referencing from where illegal calls were made.
2019-05-29 07:24:27 +00:00
Maurice Makaay
2fa5b8d0f4
OCD ..OCD ...OCD ...
2019-05-29 00:01:24 +00:00
Maurice Makaay
1e7ec7553a
Tiny fix in variable naming, because the test had grown in a different direction.
2019-05-28 23:59:02 +00:00
Maurice Makaay
e1534f678e
Simplified calculator 2 example.
2019-05-28 23:51:19 +00:00
Maurice Makaay
11883b06ac
Added a unit test for the actual parser loop issue that I ran into myself. This one will not bite me again!
2019-05-28 23:13:28 +00:00
Maurice Makaay
d31d09abf0
Added crude loop protection to the parser, which should prevent parsers running in circles (happened to me a few times too).
2019-05-28 23:01:23 +00:00
Maurice Makaay
7aff3fc43e
Added a nice example that shows how a []string-based type can be turned into a parser that fills its own slice elements during parsing.
2019-05-28 14:38:04 +00:00
Maurice Makaay
2d851103e5
Cleanup of stuff that I don't need anymore, because it has been fully deprecated. Also added some tests for panic() calls in parsekit, which brings test coverage to 100%. It's not a goal as such, but it's good to know that I got there without cheaty tests :)
2019-05-28 13:41:58 +00:00
Maurice Makaay
3dfa99c965
Modified all examples and tests to make use of the new ideas on how to keep parsing state. After this commit, I can cleanup a lot of stuff from the emitting loop-based parser which was basically crap for complex parsers.
2019-05-28 10:42:46 +00:00
Maurice Makaay
980c18099e
A small change to the computation interpreter to get rid of one useless level of recursion.
2019-05-28 07:26:50 +00:00
Maurice Makaay