Skip to content

Latest commit

 

History

History
26 lines (24 loc) · 929 Bytes

TODO.org

File metadata and controls

26 lines (24 loc) · 929 Bytes

v0.2

run this out of a docker container

Write out the results to file for JSON processing

Send the results to a webapp

Need to make a progress reporting web app

v0.3

take rows in batches

log level command line flag

ignore rows and columns

write a settings form that makes sure required flags are present

If you try running the app without database credentials it will fail non-gracefully

After v0.3

stop using SELECT * and move to explicit columns

support mysql

profile speed over:

long tables (5k, 50k, 500k rows)

wide tables (10, 1000, 10000 columns)

many rules (1, 100, 1000 rules)

Score each kind of result (e.g. CC number 100, email 10)

write tests for logging.rkt

the reason this is tricky is that it’s a massive pot of side-effects and it uses threads

heroicons - put in CSS folder.

parse URLs for DB connections?

does koyo have something worth looking at?