Code

Add SamplerWrapper node#1357

Code

Merged

andrewkho merged 48 commits intomainpytorch/data:mainfrom andrewkh/add-sampler-wrapperpytorch/data:andrewkh/add-sampler-wrapperCopy head branch name to clipboardNov 8, 2024

+136-7

Commits

Commits on Nov 2, 2024

• half-working commit

  andrewkho

  committed
  f8b59b5

  Copy full SHA for f8b59b5

• half-working commit

  andrewkho

  committed
  c1dabe2

  Copy full SHA for c1dabe2

Commits on Nov 4, 2024

• basic fast-forward in iterablewrapper

  andrewkho

  committed
  a04521a

  Copy full SHA for a04521a

• partial: update adapters

  andrewkho

  committed
  0853a3a

  Copy full SHA for 0853a3a

• partial: update batcher

  andrewkho

  committed
  5d701bf

  Copy full SHA for 5d701bf

Commits on Nov 5, 2024

• simplify, prefetcher

  andrewkho

  committed
  d3723c6

  Copy full SHA for d3723c6

• simplify, prefetcher

  andrewkho

  committed
  a4cf475

  Copy full SHA for a4cf475

• finish map tests

  andrewkho

  committed
  d781f6d

  Copy full SHA for d781f6d

• fix pin_memory

  andrewkho

  committed
  376660b

  Copy full SHA for 376660b

• fix mypy

  andrewkho

  committed
  8e1f7dc

  Copy full SHA for 8e1f7dc

• remove lock and rely on deque consistency

  andrewkho

  committed
  336859e

  Copy full SHA for 336859e

• test for hang

  andrewkho

  committed
  1ed42eb

  Copy full SHA for 1ed42eb

• test for hang

  andrewkho

  committed
  8d2cd9a

  Copy full SHA for 8d2cd9a

• test for hang

  andrewkho

  committed
  d871e7f

  Copy full SHA for d871e7f

• test for hang

  andrewkho

  committed
  f5f65ae

  Copy full SHA for f5f65ae

• test for hang

  andrewkho

  committed
  ae4062d

  Copy full SHA for ae4062d

• test for hang

  andrewkho

  committed
  95d7e59

  Copy full SHA for 95d7e59

• test for hang

  andrewkho

  committed
  b7f0e68

  Copy full SHA for b7f0e68

• test for hang

  andrewkho

  committed
  83fe9a1

  Copy full SHA for 83fe9a1

• test for hang

  andrewkho

  committed
  6511669

  Copy full SHA for 6511669

• test for hang

  andrewkho

  committed
  13a8266

  Copy full SHA for 13a8266

Commits on Nov 6, 2024

• test for hang

  andrewkho

  committed
  005bbbf

  Copy full SHA for 005bbbf

• test for hang

  andrewkho

  committed
  8280a11

  Copy full SHA for 8280a11

• test for hang

  andrewkho

  committed
  6583dec

  Copy full SHA for 6583dec

• test for hang

  andrewkho

  committed
  0096298

  Copy full SHA for 0096298

• test for hang

  andrewkho

  committed
  2bd099b

  Copy full SHA for 2bd099b

• test for hang

  andrewkho

  committed
  45a2796

  Copy full SHA for 45a2796

• test for hang

  andrewkho

  committed
  c080d27

  Copy full SHA for c080d27

• test for hang

  andrewkho

  committed
  6692e5a

  Copy full SHA for 6692e5a

• test for hang

  andrewkho

  committed
  bff18db

  Copy full SHA for bff18db

• test for hang

  andrewkho

  committed
  149e56a

  Copy full SHA for 149e56a

• test for hang

  andrewkho

  committed
  1e44014

  Copy full SHA for 1e44014

• test for hang

  andrewkho

  committed
  270f99e

  Copy full SHA for 270f99e

• test for hang

  andrewkho

  committed
  2a9af36

  Copy full SHA for 2a9af36

• revert ci changes

  andrewkho

  committed
  e89aef1

  Copy full SHA for e89aef1

• format

  andrewkho

  committed
  b9fb830

  Copy full SHA for b9fb830

• add logging and disable daemon

  andrewkho

  committed
  2dfc975

  Copy full SHA for 2dfc975

• Revert "add logging and disable daemon"

  Show description for 5b3f09a
  andrewkho

  committed
  5b3f09a

  Copy full SHA for 5b3f09a

• switch to pytorch TestCase and add test for snapshot_store

  andrewkho

  committed
  6850b60

  Copy full SHA for 6850b60

Commits on Nov 7, 2024

• update state test to handle end of epoch

  andrewkho

  committed
  7a1278f

  Copy full SHA for 7a1278f

• add sampler adapter with epoch wrapping

  andrewkho

  committed
  b87147a

  Copy full SHA for b87147a

• fix adapter test

  andrewkho

  committed
  7337555

  Copy full SHA for 7337555

• Merge branch 'andrewkh/add-state-management' into andrewkh/add-sampler-wrapper

  andrewkho

  committed
  7c64b46

  Copy full SHA for 7c64b46

• fix mypy

  andrewkho

  committed
  b5eec07

  Copy full SHA for b5eec07

• Merge branch 'andrewkh/add-state-management' into andrewkh/add-sampler-wrapper

  andrewkho

  committed
  0c14215

  Copy full SHA for 0c14215

• fix mypy

  andrewkho

  committed
  6b1775e

  Copy full SHA for 6b1775e

• add initial_epoch arg

  andrewkho

  committed
  f4c5a1e

  Copy full SHA for f4c5a1e

• Merge branch 'main' into andrewkh/add-sampler-wrapper

  andrewkho

  committed
  7e6e948

  Copy full SHA for 7e6e948