Code

Clean out the saw-core lexer#2195

Code

Merged

sauclovian-g merged 26 commits intomasterGaloisInc/saw-script:masterfrom 1225-sawcore-lexerGaloisInc/saw-script:1225-sawcore-lexerCopy head branch name to clipboardJan 24, 2025

+344-119

Commits

Commits on Jan 23, 2025

• Don't re-export random things from the saw-core parser.

  Show description for 2cdce5d
  sauclovian-g

  committed
  2cdce5d

  Copy full SHA for 2cdce5d

• Begin unwinding the tangle in the main loop of the saw-core lexer.

  Show description for d9af5ea
  sauclovian-g

  committed
  d9af5ea

  Copy full SHA for d9af5ea

• Move error-throwing out of the main loop of the saw-core lexer.

  Show description for ff754c0
  sauclovian-g

  committed
  ff754c0

  Copy full SHA for ff754c0

• Now move the main loop of the saw-core lexer out of the parser monad.

  Show description for 70d6319
  sauclovian-g

  committed
  70d6319

  Copy full SHA for 70d6319

• In the main loop of the saw-core lexer, don't use the parser's error type.

  Show description for 6a1c3fa
  sauclovian-g

  committed
  6a1c3fa

  Copy full SHA for 6a1c3fa

• Move the main loop of the saw-core lexer to the lexer source.

  Show description for 9f01a70
  sauclovian-g

  committed
  9f01a70

  Copy full SHA for 9f01a70

• Tidy up the saw-core lexer's exports.

  Show description for e69e08f
  sauclovian-g

  committed
  e69e08f

  Copy full SHA for e69e08f

• saw-core lexer: drop dead code

  sauclovian-g

  committed
  b2cfda5

  Copy full SHA for b2cfda5

• saw-core lexer: move code around.

  Show description for 9a11b34
  sauclovian-g

  committed
  9a11b34

  Copy full SHA for 9a11b34

• Unwind the innermost layer of continuation passing in the saw-core lexer.

  Show description for a461aed
  sauclovian-g

  committed
  a461aed

  Copy full SHA for a461aed

• Now simplify the saw-core lexer further.

  Show description for 99c5591
  sauclovian-g

  committed
  99c5591

  Copy full SHA for 99c5591

• saw-core lexer: move "go Nothing" to its own function; call it scanToken.

  Show description for db93f3d
  sauclovian-g

  committed
  db93f3d

  Copy full SHA for db93f3d

• saw-core lexer: remove unneeded do-notation and Either monad from scanToken

  Show description for bf1bcd9
  sauclovian-g

  committed
  bf1bcd9

  Copy full SHA for bf1bcd9

• saw-core lexer: tidy scanToken further.

  Show description for d5054c6
  sauclovian-g

  committed
  d5054c6

  Copy full SHA for d5054c6

• saw-core lexer: apply same treatment to "read".

  Show description for ec1d3da
  sauclovian-g

  committed
  ec1d3da

  Copy full SHA for ec1d3da

• saw-core lexer: move "read" to its own function, call it scanSkipComments.

  Show description for 233d082
  sauclovian-g

  committed
  233d082

  Copy full SHA for 233d082

• saw-core lexer: remove remaining unneeded do-notation and Either ()

  Show description for cd7eb46
  sauclovian-g

  committed
  cd7eb46

  Copy full SHA for cd7eb46

• saw-core lexer: a few final tidyups related to the previous few changes.

  Show description for 0df4366
  sauclovian-g

  committed
  0df4366

  Copy full SHA for 0df4366

• saw-core lexer: adjust formatting.

  Show description for b617f06
  sauclovian-g

  committed
  b617f06

  Copy full SHA for b617f06

• Extend test-and-diff to handle saw-core errors.

  Show description for fd6e8f8
  sauclovian-g

  committed
  fd6e8f8

  Copy full SHA for fd6e8f8

• saw-core lexer: make comment state machine not hang on unclosed comments.

  Show description for bacafa8
  sauclovian-g

  committed
  bacafa8

  Copy full SHA for bacafa8

• saw-core lexer: fix the interaction of block and line comments.

  Show description for bf27c91
  sauclovian-g

  committed
  bf27c91

  Copy full SHA for bf27c91

• saw-core parser: simplify the lexer call

  Show description for 9eaa679
  sauclovian-g

  committed
  9eaa679

  Copy full SHA for 9eaa679

• Add Unicode support to the saw-core lexer.

  Show description for da23d3b
  sauclovian-g

  committed
  da23d3b

  Copy full SHA for da23d3b

• saw-core lexer: fix oversight in previous

  Show description for 20a230e
  sauclovian-g

  committed
  20a230e

  Copy full SHA for 20a230e

Commits on Jan 24, 2025

• saw-core lexer: Adjust confusing comment by request

  sauclovian-g

  committed
  c42eb2d

  Copy full SHA for c42eb2d