Code

[WIP] Lineage for data and code#12

Code

Open

YuanmingLeee wants to merge 20 commits intomainMLSysOps/DataCI:mainfrom feat-lineageMLSysOps/DataCI:feat-lineageCopy head branch name to clipboard

+1,795-280

Commits

Commits on Nov 20, 2023

• ✨ [metadata] create a lineage server

  YuanmingLeee

  committed
  8741986

  Copy full SHA for 8741986

Commits on Nov 23, 2023

• ✨ [lineage] add lineage and run data model

  YuanmingLeee

  committed
  ba784cb

  Copy full SHA for ba784cb

• 🔧 [model] Add methods for run data model

  YuanmingLeee

  committed
  f8f3b3b

  Copy full SHA for f8f3b3b

Commits on Nov 24, 2023

• 🔧 [lineage] Add dao for run model

  YuanmingLeee

  committed
  ef0301d

  Copy full SHA for ef0301d

Commits on Nov 26, 2023

• 🔧 [model] Add run model update method

  YuanmingLeee

  committed
  2b08ab2

  Copy full SHA for 2b08ab2

Commits on Nov 27, 2023

• 🐛 [run] Fix bug in run model create and update APIs

  YuanmingLeee

  committed
  fc2c63b

  Copy full SHA for fc2c63b

• ✨ [model] Add lineage data model

  YuanmingLeee

  committed
  ef794ba

  Copy full SHA for ef794ba

Commits on Nov 29, 2023

• 🐛 [lineage] Fix lineage save API

  YuanmingLeee

  committed
  2ea0a45

  Copy full SHA for 2ea0a45

• 🔧 [lineage] Add lineage track for DataCI dataset

  YuanmingLeee

  committed
  bb9e032

  Copy full SHA for bb9e032

Commits on Nov 30, 2023

• 🐛 [lineage] Fix bug in output data not tracked by lineage

  YuanmingLeee

  committed
  0ea3dfd

  Copy full SHA for 0ea3dfd

Commits on Dec 1, 2023

• 🔧 [lineage] Modify lineage data object structure

  YuanmingLeee

  committed
  19f84e7

  Copy full SHA for 19f84e7

Commits on Dec 4, 2023

• 🐛 [lineage] Fix bug in lineage save

  YuanmingLeee

  committed
  324a2e1

  Copy full SHA for 324a2e1

Commits on Dec 5, 2023

• 🔧 [lineage] Add lineage get API design

  YuanmingLeee

  committed
  3519be5

  Copy full SHA for 3519be5

Commits on Dec 7, 2023

• 🍺 Add lineage downstream/upstream query for stage

  YuanmingLeee

  committed
  9626941

  Copy full SHA for 9626941

• ♻️ [rename] Rename class BaseModel -> Job to be consistent with db table

  YuanmingLeee

  committed
  b1d9130

  Copy full SHA for b1d9130

• 🔧 [refactor] Add a sub-class register for Job for better method overriding

  YuanmingLeee

  committed
  64f5da0

  Copy full SHA for 64f5da0

Commits on Dec 10, 2023

• 🐛 [lineage] Fix bug in get upstream/downstream lineage

  YuanmingLeee

  committed
  6c04604

  Copy full SHA for 6c04604

• ✅ [test] Add test for lineage (WIP)

  YuanmingLeee

  committed
  add5ea5

  Copy full SHA for add5ea5

• 🐛 [lineage] Fix bug for lineage post API

  Show description for 8785cdd
  YuanmingLeee

  committed
  8785cdd

  Copy full SHA for 8785cdd

• 🐛 [lineage] Fix bug for lineage upstream/downstream due to common query for multiple times

  YuanmingLeee

  committed
  47f5631

  Copy full SHA for 47f5631