Prevent lexer from skipping characters

[jonestristand]

It appears that if the lexer can't get a match at the current index position on any token, it will go to the next index on the input string and attempt to match a token there, disregarding the skipped character. Is there any way to prevent this behaviour? e.g. if no lexing token matches at the current index, it should fail?

[jonestristand]

Relevant code here:

chevrotain/packages/chevrotain/src/scan/lexer_public.ts

Line 688 in 376d9fe

// error recovery, drop characters until we identify a valid token's start point

It would be very, very nice to be able to disable this sort of resync recovery if it is not desired...

[bd82]

This may be possible as the logic is outside the main lexer "hotspot", but why do you need the feature?
Do you have very large inputs for which you need to fail-fast?