Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Large file imports fail due to db integer limit #945

Open
zstumgoren opened this issue Dec 24, 2014 · 0 comments
Open

Large file imports fail due to db integer limit #945

zstumgoren opened this issue Dec 24, 2014 · 0 comments

Comments

@zstumgoren
Copy link

Files with byte counts too big for the standard Postgres integer field cannot be imported using the bulk load command (or, presumably, via the API).

The issue was recently encountered by another PANDA user, and I ran into it myself today.

I haven't yet verified, but the fix likely requires migrating the DataUpload.size field from a standard IntegerField to a BigIntField. This field is inherited from the parent abstract base class BaseUpload.

I'm working on a patch and will try to send a PR this week or next. Guessing this one might deserve another patch release, or perhaps it should be bundled with #941 into the 1.1.2 release?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant