Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade spark and loader containers to Python 3.8 #131

Closed
lwrubel opened this issue Jul 29, 2021 · 1 comment
Closed

Upgrade spark and loader containers to Python 3.8 #131

lwrubel opened this issue Jul 29, 2021 · 1 comment
Milestone
2.2

Comments

@lwrubel
Copy link
Collaborator

lwrubel commented Jul 29, 2021 •
edited
Loading

Note that 1) Spark 2.4 will not work with Python 3.8 and so needs to be upgraded first to 3.x, and 2) in the loader container openjdk-8-jre-headless is not available for a 3.8-buster base image so will need to happen once jdk version 11 can be used. This assumes that having different versions of Java in the loader and spark containers would be problematic, but perhaps they can be done independent of each other.
@lwrubel lwrubel added this to the 2.2 milestone Jul 29, 2021
@dolsysmith
Copy link
Contributor

Encapsulated in #128

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
2.2
Development

No branches or pull requests
2 participants
@lwrubel @dolsysmith