Skip to content

Commit

Permalink
Add demo of CSV enrichment
Browse files Browse the repository at this point in the history
Signed-off-by: Jesse Szwedko <[email protected]>
  • Loading branch information
jszwedko committed Aug 27, 2021
1 parent 8f29653 commit f0ea1b2
Show file tree
Hide file tree
Showing 5 changed files with 10,076 additions and 0 deletions.
20 changes: 20 additions & 0 deletions csv-enrichment/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
# CSV enrichment in Vector

**Note:** This feature is unreleased and still under active development. However, if you want to try it out, we would
love any feedback!

## How to start it

`docker-compose up`

## What it does

This demo shows an example of using CSV enrichment in Vector to enrich events with data from a CSV file.

The CSV file ([`./data/users.csv`](./data/users.csv) contains a list of users with their phone numbers and addresses.

The `vector.toml` configuration contains:

* A `random` source in the `vector.toml` that simply generates some fake events using names that match users in the CSV file
* A `remap` transform then parses these events and then looks up the corresponding record from the CSV file to enrich the event with more metadata
* A `console` sink to print out the events
Loading

0 comments on commit f0ea1b2

Please sign in to comment.