feat(clp-s): Add support for ingesting logs from S3.#639

Merged

gibber9809 merged 27 commits intoy-scope:mainfrom gibber9809:clp-s-s3-ingestion

Jan 8, 2025

+717-217

Commits on Dec 16, 2024

Add Path and NetworkAuth structs which describe how to access a resource including network auth
gibber9809
committed
Remove boost::filesystem usage from ZstdDecompressor
gibber9809
committed
Add utility to create a reader for a resource given Path and NetworkAuth
gibber9809
committed
Add utilities for finding all files or archives in a directory, and add utilities for finding archive Id given a Path
gibber9809
committed
Update CMakeLists to pull in boost::urls
gibber9809
committed
Update ArchiveReader to accept Path and NetworkAuth
gibber9809
committed
Accept clp::ReaderInterface in JsonFileIterator
gibber9809
committed
Update JsonParser to accept Path and NetworkAuth
gibber9809
committed
Update JsonConstructor to accept Path and NetworkAuth
gibber9809
committed
Remove unnecessary dependency from kql build target
gibber9809
committed
Update clp_s end to end tests to account for new interface
gibber9809
committed
Update command line arguments and simplify clp-s.cpp
gibber9809
committed
Catch exception when failing to open archive during search
gibber9809
committed

Commits on Dec 17, 2024

Commits on Dec 18, 2024

Revert all changes to kql CMakeLists to simplify review
gibber9809
committed

Commits on Dec 19, 2024

Commits on Dec 20, 2024

Commits on Dec 30, 2024

Apply suggestions from code review

gibber9809
and
wraymo
authored

Commits on Jan 3, 2025

Address rabbit comments and fix macos build
gibber9809
committed