-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Bump amazon-kinesis-client to 2.2.10 #151
Comments
I think it's a much bigger workflow. In order to update the KCL lib we'd have to get rid of https://github.com/awslabs/amazon-kinesis-connectors, which is core of the ES (and S3) Loader. I'm considering to switch to something like https://github.com/laserdisc-io/fs2-aws which could make all streaming loaders very source (PubSub/Kinesis/NSQ) and sink (ES, S3) agnostic. |
Indeed seems like removing |
Getting this back online involved manually editing the KCL table to ignore the failed shards and moving it to the new shards... very painful recovery. |
Hey guys, sorry for being late. I think something similar to it happened for us, too. I think we manually overriden the |
We started to see weird errors in ES loader logs:
And we can't find a sensible explanation. Version 1.9.1 that we're currently using is 2 years old today. Time to bump!
The text was updated successfully, but these errors were encountered: