-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ci: speed up win64 test #8728
ci: speed up win64 test #8728
Conversation
Limit to running only tpcds_physical_q44 with backtrace feature: good (2023-10-29 nightly) = 70 seconds bad (2023-10-30 nightly) = 692 seconds Without backtrace: good (2023-10-29 nightly) = 1.25 seconds bad (2023-10-30 nightly) = 1.26 seconds Trying more recent toolchains, with backtrace: 2023-12-21 nightly = 682 seconds 2024-01-01 nightly = 682 seconds |
# use higher optimization level to overcome Windows rust slowness for tpc-ds | ||
# and speed builds: https://github.com/apache/arrow-datafusion/issues/8696 | ||
# Cargo profile docs https://doc.rust-lang.org/cargo/reference/profiles.html?profile-settings#profile-settings | ||
RUSTFLAGS: "-C debuginfo=0 -C opt-level=1 -C target-feature=+crt-static -C incremental=false -C codegen-units=256" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Removing the other optimization flags as it caused compilation to take 27 min
Without them, it takes 8 min
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you very much @Jefffrey This looks really good to me. Also watching you debug this issue I think is a master class in careful engineering. Very impressive 💪
# Cargo profile docs https://doc.rust-lang.org/cargo/reference/profiles.html?profile-settings#profile-settings | ||
RUSTFLAGS: "-C debuginfo=0 -C opt-level=1 -C target-feature=+crt-static -C incremental=false -C codegen-units=256" | ||
# Minimize producing debug symbols to keep memory usage down | ||
# Set debuginfo=line-tables-only as debuginfo=0 causes immensely slow build |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍 thank you
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
oh, wow, so debuginfo another level fixed the problem, nicely done @Jefffrey
Which issue does this PR close?
Relates to #8696
Rationale for this change
Apply changes per analysis from rust-lang/rust#119560
What changes are included in this PR?
Are these changes tested?
Are there any user-facing changes?