Code

PII data file#828

Code

Merged

touma-I merged 54 commits intoIBM:devIBM/data-prep-kit:devfrom PoojaHolkar:devPoojaHolkar/data-prep-kit:devCopy head branch name to clipboardDec 27, 2024

+516

Commits

Commits on Dec 4, 2024

• Update README.md

  Show description for c59bc6c
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  c59bc6c

  Copy full SHA for c59bc6c

• Update README.md

  Show description for 9c58af3
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  9c58af3

  Copy full SHA for 9c58af3

• Update README.md

  Show description for 501570c
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  501570c

  Copy full SHA for 501570c

• Update README.md

  Show description for 30c8a19
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  30c8a19

  Copy full SHA for 30c8a19

• Update README inweb2parquet

  Show description for ebfe95e
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  ebfe95e

  Copy full SHA for ebfe95e

• Update README.md for the web2parquet

  Show description for eb5d0ad
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  eb5d0ad

  Copy full SHA for eb5d0ad

• Update README-list.md

  Show description for af8cdd8
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  af8cdd8

  Copy full SHA for af8cdd8

• Update README-list.md

  Show description for 3738e51
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  3738e51

  Copy full SHA for 3738e51

• Update README.md

  Show description for d87c992
  

  Padarn

  authored and

  pholkar1

  committed
  d87c992

  Copy full SHA for d87c992

• Update README.md

  Show description for b0beaf5
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  b0beaf5

  Copy full SHA for b0beaf5

• Create test

  Show description for a00380b
  

  PoojaHolkar

  authored and

  pholkar1

  committed
  a00380b

  Copy full SHA for a00380b

• PII input file

  Show description for 7be8cb1
  

  PoojaHolkar

  authored and

  pholkar1

  committed
  7be8cb1

  Copy full SHA for 7be8cb1

• PII_redactor code example

  Show description for 2aceec1
  

  PoojaHolkar

  authored and

  pholkar1

  committed
  2aceec1

  Copy full SHA for 2aceec1

• invoice data

  Show description for d16f0f7
  

  PoojaHolkar

  authored and

  pholkar1

  committed
  d16f0f7

  Copy full SHA for d16f0f7

• upload data

  Show description for ee735cd
  

  PoojaHolkar

  authored and

  pholkar1

  committed
  ee735cd

  Copy full SHA for ee735cd

• upload data

  Show description for d825e8b
  

  PoojaHolkar

  authored and

  pholkar1

  committed
  d825e8b

  Copy full SHA for d825e8b

• Delete examples/notebooks/PII/Invoice.pdf

  Show description for 22ec3fd
  

  PoojaHolkar

  authored and

  pholkar1

  committed
  22ec3fd

  Copy full SHA for 22ec3fd

• Delete examples/notebooks/PII/invoicedata/test.py

  Show description for a1965c2
  

  PoojaHolkar

  authored and

  pholkar1

  committed
  a1965c2

  Copy full SHA for a1965c2

• notebook recipe for PII redaction code

  Show description for ea9d692
  

  PoojaHolkar

  authored and

  pholkar1

  committed
  ea9d692

  Copy full SHA for ea9d692

• update pdf2parquet README

  Show description for f47b45f
  

  dolfim-ibm

  authored and

  pholkar1

  committed
  f47b45f

  Copy full SHA for f47b45f

• add data_files_to_use

  Show description for 1f1764e
  

  dolfim-ibm

  authored and

  pholkar1

  committed
  1f1764e

  Copy full SHA for 1f1764e

• doc_chunk README

  Show description for 4d2d212
  

  dolfim-ibm

  authored and

  pholkar1

  committed
  4d2d212

  Copy full SHA for 4d2d212

• text_encoder README

  Show description for d4bb363
  

  dolfim-ibm

  authored and

  pholkar1

  committed
  d4bb363

  Copy full SHA for d4bb363

• Added notebook for pdf2parquet

  Show description for 44f9905
  

  Maroun Touma

  authored and

  pholkar1

  committed
  44f9905

  Copy full SHA for 44f9905

• Added doc chunk minimal notebook

  Show description for b4a23a5
  

  touma-I

  authored and

  pholkar1

  committed
  b4a23a5

  Copy full SHA for b4a23a5

• Update pdf2parquet.ipynb

  Show description for 964f3a1
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  964f3a1

  Copy full SHA for 964f3a1

• Update pdf2parquet.ipynb

  Show description for b7d4161
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  b7d4161

  Copy full SHA for b7d4161

• minimal sample notebook for how transform can be invoked

  Show description for b3aff29
  

  touma-I

  authored and

  pholkar1

  committed
  b3aff29

  Copy full SHA for b3aff29

• restoring the make venv

  Show description for 2763d17
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  2763d17

  Copy full SHA for 2763d17

• unification of notebooks

  Show description for 0204795
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  0204795

  Copy full SHA for 0204795

• added constraint for pydantic to prevent llama-index-core from picking up 2.10

  Show description for 3205ef2
  

  touma-I

  authored and

  pholkar1

  committed
  3205ef2

  Copy full SHA for 3205ef2

• updated README file and added a sample notebook

  Show description for ef6eccd
  

  Sungeun An

  authored and

  pholkar1

  committed
  ef6eccd

  Copy full SHA for ef6eccd

• removed python code in README and minor changes in the notebook

  Show description for 818bd07
  

  Sungeun An

  authored and

  pholkar1

  committed
  818bd07

  Copy full SHA for 818bd07

• updated with relative path and added markdown for notebook

  Show description for ed0f084
  

  Sungeun An

  authored and

  pholkar1

  committed
  ed0f084

  Copy full SHA for ed0f084

• Update web2parquet.ipynb

  Show description for 6cb60a9
  

  shahrokhDaijavad

  authored and

  pholkar1

  committed
  6cb60a9

  Copy full SHA for 6cb60a9

• Update Run_your_first_PII_redactor_transform.ipynb

  Show description for 0abb743
  

  PoojaHolkar

  authored and

  pholkar1

  committed
  0abb743

  Copy full SHA for 0abb743

• updated code

  Show description for a567fcc
  pholkar1

  committed
  a567fcc

  Copy full SHA for a567fcc

• Delete examples/notebooks/PII/test

  Show description for 9fd1b77
  

  PoojaHolkar

  authored and

  pholkar1

  committed
  9fd1b77

  Copy full SHA for 9fd1b77

• Added google colab version for users

  Show description for dbd977c
  pholkar1

  committed
  dbd977c

  Copy full SHA for dbd977c

Commits on Dec 5, 2024

• Merge branch 'IBM:dev' into dev

  PoojaHolkar

  authored
  5c15dad

  Copy full SHA for 5c15dad

• Delete examples/notebooks/Input-Test-Data/Invoice.pdf

  Show description for 10fde20
  PoojaHolkar

  authored
  10fde20

  Copy full SHA for 10fde20

Commits on Dec 6, 2024

• Merge branch 'IBM:dev' into dev

  PoojaHolkar

  authored
  0de92a3

  Copy full SHA for 0de92a3

Commits on Dec 8, 2024

• colab version notebook

  pholkar1

  committed
  1099e48

  Copy full SHA for 1099e48

• colab version notebook

  pholkar1

  committed
  9e51577

  Copy full SHA for 9e51577

• colab running version update

  pholkar1

  committed
  032e8f0

  Copy full SHA for 032e8f0

Commits on Dec 12, 2024

• parquet inout uodate

  pholkar1

  committed
  d13bb5c

  Copy full SHA for d13bb5c

• colab version notebook

  Show description for fcf9aa8
  pholkar1

  committed
  fcf9aa8

  Copy full SHA for fcf9aa8

• Merge branch 'IBM:dev' into dev

  PoojaHolkar

  authored
  e520a95

  Copy full SHA for e520a95

• Delete examples/notebooks/PII/invoicedata directory

  Show description for a8b226c
  PoojaHolkar

  authored
  a8b226c

  Copy full SHA for a8b226c

• colab version updated notebook

  Show description for c6d2e29
  pholkar1

  committed
  c6d2e29

  Copy full SHA for c6d2e29

• fixed the path to the Invoice.odf

  Show description for 2f2f0ca
  shahrokhDaijavad

  committed
  2f2f0ca

  Copy full SHA for 2f2f0ca

Commits on Dec 19, 2024

• required code changes

  pholkar1

  committed
  896713b

  Copy full SHA for 896713b

Commits on Dec 22, 2024

• edited code to pull full transform

  pholkar1

  committed
  e8318b0

  Copy full SHA for e8318b0

Commits on Dec 27, 2024

• removed unneccessary installs

  pholkar1

  committed
  8bdcf7c

  Copy full SHA for 8bdcf7c