AppendSink

[cryogenian]

https://github.com/precog/features/issues/126#issuecomment-1071217955

AppendEvent stream need to be prepared and split/rechunked due to considerably small maximum size of append block in azure (it's 4Mib).

An alternative to usage of AppendBlob we can use BlockBlob, it also has size limits but they're much greater, and usage somewhat more familiar (e.g. it has commit). Construction of BlockBlobAsyncClient is the same as AppendBlobAsyncClient.

I'd go with block blobs, uploading all data from AppendEvent chunks to stages and on commit/finalize do commit(listOfPreviousIds ++ justUploadedStageIds).

[cryogenian]

<2>