You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The current java implementation will introduce the hadoop-aws dependency, which is about 200M and occupies most of the jar files (#13113). Currently we have the java iceberg sink and delta lake sink depending on hadoop-aws for writing data files to S3. Java iceberg sink can be deprecated since we have already implemented a rust one. If we reimplement the delta lake sink rust rust, we can get rid of the hadoop-aws dependency.
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Delta lake has its own rust sdk. https://github.com/delta-io/delta-rs
The current java implementation will introduce the
hadoop-aws
dependency, which is about 200M and occupies most of the jar files (#13113). Currently we have the java iceberg sink and delta lake sink depending onhadoop-aws
for writing data files to S3. Java iceberg sink can be deprecated since we have already implemented a rust one. If we reimplement the delta lake sink rust rust, we can get rid of thehadoop-aws
dependency.Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: