Code

10b disk flushing#19

Code

Merged

Russell-Tran merged 50 commits intomainrodrigo-castellon/babyray:mainfrom 10b-disk-flushingrodrigo-castellon/babyray:10b-disk-flushingCopy head branch name to clipboardJun 8, 2024

+4,849-207

Commits

Commits on May 30, 2024

• Update dockerfile to enable CGO_ENABLED

  Russell-Tran

  committed
  4e134eb

  Copy full SHA for 4e134eb

• Merge branch 'main' into 10b-disk-flushing

  Russell-Tran

  committed
  c60c2f2

  Copy full SHA for c60c2f2

• Add SQLite with some SQLite example code

  Russell-Tran

  committed
  29fe73c

  Copy full SHA for 29fe73c

Commits on May 31, 2024

• WIP on db connection for gcsobjtable

  Russell-Tran

  committed
  ebd123f

  Copy full SHA for ebd123f

• WIP on object locations table

  Russell-Tran

  committed
  96f80ab

  Copy full SHA for 96f80ab

• Accomplish flushing behavior for object locations

  Russell-Tran

  committed
  45aac42

  Copy full SHA for 45aac42

• Remove print statements

  Russell-Tran

  committed
  c3e5fe7

  Copy full SHA for c3e5fe7

Commits on Jun 2, 2024

• Eliminate waitlist table because it's really not necessary

  Russell-Tran

  committed
  dc04f93

  Copy full SHA for dc04f93

• Add function to fetch an object from disk

  Russell-Tran

  committed
  d2706dc

  Copy full SHA for d2706dc

• Update config to add a flush interval

  Russell-Tran

  committed
  4484dee

  Copy full SHA for 4484dee

Commits on Jun 3, 2024

• Implement flush to disk but not yet cache miss

  Russell-Tran

  committed
  56793db

  Copy full SHA for 56793db

• Comment

  Russell-Tran

  committed
  9225752

  Copy full SHA for 9225752

• Implement getNodeId cache behavior

  Russell-Tran

  committed
  15eae4b

  Copy full SHA for 15eae4b

• Changes to Docker and Makefile -- make docker and ./scripts/run_tests.sh PASS

  Russell-Tran

  committed
  847a511

  Copy full SHA for 847a511

• Progress on Figure10b run script (WIP)

  Russell-Tran

  committed
  7a1b318

  Copy full SHA for 7a1b318

• Merge branch 'main' into 10b-disk-flushing

  Russell-Tran

  committed
  2900cc3

  Copy full SHA for 2900cc3

Commits on Jun 4, 2024

• Update Fig10b experiment creation

  Russell-Tran

  committed
  4ad0480

  Copy full SHA for 4ad0480

• Modify exp setup

  Russell-Tran

  committed
  9ec0836

  Copy full SHA for 9ec0836

• Modify exp setup II

  Russell-Tran

  committed
  b2da955

  Copy full SHA for b2da955

• WORKAROUND FOR THE FACT THAT SQLite3 IN THE GCS OBJECT TABLE's STORAGE CANNOT TAKE HIGH BIT OF UINT64

  Russell-Tran

  committed
  bf871f4

  Copy full SHA for bf871f4

• Results of 10b run1, aka no caching, 2GB memory limit

  Russell-Tran

  committed
  dbc747a

  Copy full SHA for dbc747a

• 10b experiment with flush every 60 seconds

  Russell-Tran

  committed
  77d89f8

  Copy full SHA for 77d89f8

• Log successful flush

  Russell-Tran

  committed
  e89a39e

  Copy full SHA for e89a39e

• setCacheSizeToZero(database)

  Russell-Tran

  committed
  e68b9a6

  Copy full SHA for e68b9a6

• Experiment flush 60s

  Russell-Tran

  committed
  c9dca2d

  Copy full SHA for c9dca2d

• Jk this is every 300s exp output

  Russell-Tran

  committed
  a1421d2

  Copy full SHA for a1421d2

• Configure experiment 3 for every 40s

  Russell-Tran

  committed
  8780e0c

  Copy full SHA for 8780e0c

• Add result of 40s

  Russell-Tran

  committed
  0de964a

  Copy full SHA for 0de964a

• Fix the name

  Russell-Tran

  committed
  c37eaab

  Copy full SHA for c37eaab

• Bad parser

  Russell-Tran

  committed
  25c81ba

  Copy full SHA for 25c81ba

• a

  Russell-Tran

  committed
  d5c0842

  Copy full SHA for d5c0842

• Config for experiment 300s flush again

  Russell-Tran

  committed
  739b9e7

  Copy full SHA for 739b9e7

• Change experiment: flush every 1 second

  Russell-Tran

  committed
  23bcf8f

  Copy full SHA for 23bcf8f

• Attempt manual garbage collection

  Russell-Tran

  committed
  774aa53

  Copy full SHA for 774aa53

• output_10b_run4_1s_flush_no_manual_garbage_yet.txt

  Russell-Tran

  committed
  aac51de

  Copy full SHA for aac51de

• Refactor code to bypass mysql db with a simple append only file flushing

  Russell-Tran

  committed
  7347b42

  Copy full SHA for 7347b42

• working on debugging whether AOF exists...

  Russell-Tran

  committed
  59dc4dc

  Copy full SHA for 59dc4dc

• Configure experiment for forced garbage collection each flush

  Russell-Tran

  committed
  b0dbe61

  Copy full SHA for b0dbe61

• Exp result run5

  Russell-Tran

  committed
  e3f0d08

  Copy full SHA for e3f0d08

• LOL GCS memory reporting

  Russell-Tran

  committed
  78c69fd

  Copy full SHA for 78c69fd

• Idiot chatgpt screwed up my logging

  Russell-Tran

  committed
  e3e2820

  Copy full SHA for e3e2820

• Log adjustment

  Russell-Tran

  committed
  e070c8b

  Copy full SHA for e070c8b

• Experiment result for run6 flush GC golang

  Russell-Tran

  committed
  4052159

  Copy full SHA for 4052159

• Experimental config now dont flush flush -1

  Russell-Tran

  committed
  55d7300

  Copy full SHA for 55d7300

• Conclude experiment No flush

  Russell-Tran

  committed
  ed44286

  Copy full SHA for ed44286

• Setup for Flush to MySQL experiment

  Russell-Tran

  committed
  192b4ef

  Copy full SHA for 192b4ef

• Experiments pre-presentation

  Russell-Tran

  committed
  21e3aab

  Copy full SHA for 21e3aab

• More graphs

  Russell-Tran

  committed
  f64efb0

  Copy full SHA for f64efb0

Commits on Jun 8, 2024

• Commit the DS Store

  Russell-Tran

  committed
  495a61e

  Copy full SHA for 495a61e

• Merge branch 'main' into 10b-disk-flushing

  Russell-Tran

  committed
  35c39b9

  Copy full SHA for 35c39b9