ContextualLexer now uses self.basic_lexer for easy extensibility (iss…

[erezsh]

…ue #1329)

[codecov-commenter]

Codecov Report

Patch coverage: 89.47% and project coverage change: -0.02% ⚠️

Comparison is base (c2e44ea) 89.23% compared to head (d83ad87) 89.22%.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #1342      +/-   ##
==========================================
- Coverage   89.23%   89.22%   -0.02%     
==========================================
  Files          51       51              
  Lines        7591     7600       +9     
==========================================
+ Hits         6774     6781       +7     
- Misses        817      819       +2     

Flag	Coverage Δ
unittests	89.22% <89.47%> (-0.02%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed	Coverage Δ
lark/lexer.py	90.78% <89.47%> (-0.28%)	⬇️

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[erezsh]

@davidmcnabnz Can you confirm this PR solves your issue?

(you can inherit ContextualLexer and override its basic_lexer attribute)

[davidmcnabnz]

Thanks for that @erezsh . Commits look good, and plug up the configurability gap well. I look forward to migrating my lexer/parser over to the new version.