Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HADOOP-17679. Upgrade Protobuf to 3.17.3 #13

Closed
wants to merge 7 commits into from
Closed

Conversation

medb
Copy link

@medb medb commented May 2, 2021

Protobuf 3.17.3 is the latest Protobuf release now.

Copy link
Contributor

@jojochuang jojochuang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code looks good. Makes sense for hadoop-thirdparty 1.2.0.

@medb could you push an empty commit to trigger the precommit test?

@jojochuang jojochuang changed the title HADOOP-17679. Upgrade Protobuf to 3.12.4 HADOOP-17679. Upgrade Protobuf to 3.12.4 May 13, 2021
@jojochuang
Copy link
Contributor

So at the end of the day, we probably don't need to use protobuf in the hadoop-thirdparty repository. See: #14 (comment)

@jojochuang
Copy link
Contributor

Instead, we should do this for the main hadoop repository, not the hadoop-thirdparty repo. https://github.com/apache/hadoop/blob/trunk/dev-support/docker/Dockerfile#L120

@medb
Copy link
Author

medb commented May 13, 2021

@jojochuang May you clarify, do you mean that we do not need to compile protoc in hadoop-thirdparty Docker file?

@jojochuang
Copy link
Contributor

Yeah. We have a number of redundant steps in hadoop-thirdparty Dockerfile. It was copied from the main hadoop repo but we don't need many of the packages.

@medb medb changed the title HADOOP-17679. Upgrade Protobuf to 3.12.4 HADOOP-17679. Upgrade Protobuf to 3.17.0 May 14, 2021
@medb medb requested a review from jojochuang May 14, 2021 03:43
@medb
Copy link
Author

medb commented May 14, 2021

@jojochuang rebased on the trunk HEAD and updated PR to the latest Protobuf version

@jojochuang
Copy link
Contributor

As I said, this PR is not needed. I'd like to ask you to work on the protobuf update in the main hadoop repository.

@medb medb changed the title HADOOP-17679. Upgrade Protobuf to 3.17.0 HADOOP-17679. Upgrade Protobuf to 3.17.3 Sep 4, 2021
@medb
Copy link
Author

medb commented Sep 4, 2021

@jojochuang sent PR to the Hadoop repo: apache/hadoop#3384

Please, let me know if this is correct.

@medb
Copy link
Author

medb commented Sep 5, 2021

@jojochuang I took a look at Hadoop changes in apache/hadoop#3384, and it seems that to upgrade Protobuf both PRs are required (#13 in hadoop-thirdparty and apache/hadoop#3384 in hadoop repositories)

May you explain, how can I update Protobuf without any changes in Hadoop Thirdparty repository (i.e. this PR)?

@cjolivier01
Copy link
Member

It would be good to update this to a non-vulnerable version of protobuf

@adoroszlai
Copy link
Contributor

Superseded by #38.

@adoroszlai adoroszlai closed this Oct 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants