feat(api-gateway): Async native query results transformations#8961

Merged

KSDaemon merged 132 commits intomasterfrom feat/cubestore-driver-rust-parsing

Jan 24, 2025

+5,531-2,241

Commits on Jan 23, 2025

create a basic cubeorchestrator project structure
KSDaemon
committed
wip
KSDaemon
committed
move flatbuffer schema/code to separate crate
KSDaemon
committed
implement parse_cubestore_ws_result
KSDaemon
committed
add cubeorchestrator/parse_cubestore_ws_result_message export
KSDaemon
committed
use native parseCubestoreResultMessage
KSDaemon
committed
init hashmap with capacity
KSDaemon
committed
cargo fmt
KSDaemon
committed
some optimizations and improvements
KSDaemon
committed
a bit optimized version
KSDaemon
committed
use cx.execute_scoped for optimization
KSDaemon
committed
a bit more rust idiomatic code
KSDaemon
committed
put native parseCubestoreResultMessage behind the flag
KSDaemon
committed
tiny improvement
KSDaemon
committed
cargo fmt
KSDaemon
committed
cargo fmt
KSDaemon
committed
cargo clippy fix
KSDaemon
committed
update cubestore Dockerfile
KSDaemon
committed
cargo fmt
KSDaemon
committed
update cubestore Docker builds
KSDaemon
committed
introduce CubeStoreResult struct
KSDaemon
committed
create CubeStoreResultWrapper class and switch to lazy evaluation of results set
KSDaemon
committed
add resToRawResultFn in API GW
KSDaemon
committed
cargo fmt
KSDaemon
committed
update resToResultFn
KSDaemon
committed
call prepareAnnotation later
KSDaemon
committed
remove bytes
KSDaemon
committed
add cached flag to CubeStoreResultWrapper
KSDaemon
committed
convert core data types from api gateway
KSDaemon
committed
implement transformData and related helpers
KSDaemon
committed
cargo fmt
KSDaemon
committed
down chrono to same version as in cubesql (0.4.31)
KSDaemon
committed
fail fast in api gw load()
KSDaemon
committed
update cargo.lock (syn crate)
KSDaemon
committed
linter fix
KSDaemon
committed
implement get_query_granularities & get_pivot_query
KSDaemon
committed
prepare transformQueryData native wrapper
KSDaemon
committed
small optimization: do not use native parsing for short messages
KSDaemon
committed
refactor transformValue and related
KSDaemon
committed
types restructure
KSDaemon
committed
debug and fix native transform_data()
KSDaemon
committed
lazy transformData evaluation
KSDaemon
committed
omplement get_final_cubestore_result & get_final_cubestore_result_multi in native
KSDaemon
committed
cargo fmt
KSDaemon
committed
cargo clippy fix
KSDaemon
committed
refactor getVanillaRow
KSDaemon
committed
implement get_final_cubestore_result_array() native
KSDaemon
committed
fix native response flow for sqlApiLoad
KSDaemon
committed
add postgres with native cubestore results driver tests
KSDaemon
committed
Build native (without Python) in drivers tests
KSDaemon
committed
workaround for native build in testings-drivers
KSDaemon
committed
small improvements in CubeStoreResultWrapper
KSDaemon
committed
make parse_cubestore_ws_result_message async
KSDaemon
committed
make all native cubestore_result_transform functions async
KSDaemon
committed
cargo fmt
KSDaemon
committed
refactor results transformations
KSDaemon
committed
yarn sync
KSDaemon
committed
implement custom deserializer from JS Value to rust
KSDaemon
committed
refactor json_to_array_buffer()
KSDaemon
committed
a bit of refactoring
KSDaemon
committed
code rearrangement
KSDaemon
committed
switch to use DBResponsePrimitive instead of just Strings
KSDaemon
committed
refactoring
KSDaemon
committed
always use transform data native for all results
KSDaemon
committed
fix dtos for native query processing (thnx unit tests)
KSDaemon
committed
cache loadNative
KSDaemon
committed
remove not needed anymore native.transformQueryData
KSDaemon
committed
add Build native for unit tests in CI
KSDaemon
committed
refactor serde annotations
KSDaemon
committed
remove unused
KSDaemon
committed
annotate native query results processing functions
KSDaemon
committed
add Build native for unit tests in CI for Debian without pushing
KSDaemon
committed
add few unit tests
KSDaemon
committed
fix some tests
KSDaemon
committed
attempt to fix native build/test in docker-dev CI
KSDaemon
committed
fix empty result set issue
KSDaemon
committed
another fix in datetime parsing
KSDaemon
committed
another fix in deserialization
KSDaemon
committed
another fix in datetime parsing
KSDaemon
committed
update postgres-native-cubestore-response-full.test.ts.snap
KSDaemon
committed
another fix in deserialization
KSDaemon
committed
cargo fmt
KSDaemon
committed
another fix in datetime parsing
KSDaemon
committed
update postgres-native-cubestore-response-full.test.ts.snap
KSDaemon
committed
attempt to fix native build/test in docker-dev CI
KSDaemon
committed
add some comments
KSDaemon
committed
edits in result processing when streaming
KSDaemon
committed
fix native response processing via websocket
KSDaemon
committed
fix yarn lock
KSDaemon
committed
attempt to fix native build/test in cloud integration tests in CI
KSDaemon
committed
recreated unit tests for transform data in native
KSDaemon
committed
run rust unit tests on push
KSDaemon
committed
commented out cargo fmt/build/test for cubesql, cubesqlplanner
KSDaemon
committed
remove transformdata JS implementation
KSDaemon
committed
refactor push CI jobs
KSDaemon
committed
rename CubestoreResultWrapper → ResultWrapper
KSDaemon
committed
add isNative flag to ResultWrapper
KSDaemon
committed
rename getResultInternal → prepareResultTransformData
KSDaemon
committed
use ResultWrapper for all results
KSDaemon
committed
fix getArray in ResultWrapper
KSDaemon
committed
lint fix
KSDaemon
committed
encapsulate rootResultObject into ResultWrapper
KSDaemon
committed
add DataResult interface + implement it in result wrappers
KSDaemon
committed
add isWrapper property to wrappers
KSDaemon
committed
transform wrapped result later before returning the response
KSDaemon
committed
fix lint warn
KSDaemon
committed
fix async request porcessing
KSDaemon
committed
some node version fix
KSDaemon
committed
weird yarn.lock change. Wtf?
KSDaemon
committed
full transition of result native-js-native
KSDaemon
committed
fix @cubejs-backend/native version ref
KSDaemon
committed
refactor ResultWrapper constructor
KSDaemon
committed
fix string deserialize in transport
KSDaemon
committed
extend DataResult interface
KSDaemon
committed
support iterative access in ResultWrapper
KSDaemon
committed
refactor ResultWrapper classes
KSDaemon
committed
pass ResultWrapper to native and offload transformData from the eventloop
KSDaemon
committed
remove obsolete getFinalQueryResultArray
KSDaemon
committed
fix ws api subscriptionServer results processing
KSDaemon
committed
pass SchemaRef to load methods.
KSDaemon
committed
trying to fix flaky ws failing tests
KSDaemon
committed
remove cubeorchestrator dependency from cubesql
KSDaemon
committed
rewrite all load api calls to return RecordBatch
KSDaemon
committed
fix @cubejs-backend/native version ref after rebase
KSDaemon
committed
set prototype of ResultWrapper proxy to class prototype
KSDaemon
committed
fix linter warnings
KSDaemon
committed
fix yarn.lock
KSDaemon
committed
linter fix
KSDaemon
committed
Set CUBEJS_TESSERACT_ORCHESTRATOR: true for all tests workflows
KSDaemon
committed
fix old refs after rebase
KSDaemon
committed
update integration-cubestore job with the build of backend-native
KSDaemon
committed

Commits on Jan 24, 2025

remove postgres-native-cubestore-response from testing drivers as we turnon new orchestrator for all tests
KSDaemon
committed