Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(ndt_scan_matcher): added score diff to ndt diag #7227

Conversation

SakodaShintaro
Copy link
Contributor

@SakodaShintaro SakodaShintaro commented Jun 3, 2024

Description

Since ndt_scan_matcher performs score optimization, it is desirable for the score to increase with each run. Currently, we do not check how the score changes with each run of NDT, so we will first introduce a change to output score difference to /diagnostics.

Relate PR

Tests performed

For now, I've confirmed that the correct values are being sent to /diagnostics.

The results have been plotted for the AWSIM Nishi-Shinjuku data.

Transform Probability Diff

pose_transform_probability_diff

Nearest Voxel Transformation Likelihood Diff

pose_nearest_voxel_transformation_likelihood_diff

In this data, there appears to be a small bump in the roll direction around the first intersection, which is likely to be the reason for the large Score Diff.
At around 18 seconds in the video below

awsim_nishishinjuku.mp4

In the future, we plan to check the indicators using larger amounts of data and set appropriate thresholds if they exist.

Effects on system behavior

There are no effects on system behavior.

Interface changes

Output is added to /diagnostics of ndt_scan_matcher.

  • transform_probability_diff
  • transform_probability_before
  • nearest_voxel_transformation_likelihood_diff
  • nearest_voxel_transformation_likelihood_before

It is redundant to show both the diff and the before, so I can remove "before".

Pre-review checklist for the PR author

The PR author must check the checkboxes below when creating the PR.

In-review checklist for the PR reviewers

The PR reviewers must check the checkboxes below before approval.

Post-review checklist for the PR author

The PR author must check the checkboxes below before merging.

  • There are no open discussions or they are tracked via tickets.

After all checkboxes are checked, anyone who has write access can merge the PR.

Signed-off-by: Shintaro Sakoda <[email protected]>
@SakodaShintaro SakodaShintaro added the run:build-and-test-differential Mark to enable build-and-test-differential workflow. (used-by-ci) label Jun 3, 2024
@SakodaShintaro SakodaShintaro self-assigned this Jun 3, 2024
@github-actions github-actions bot added type:documentation Creating or refining documentation. (auto-assigned) component:localization Vehicle's position determination in its environment. (auto-assigned) labels Jun 3, 2024
@SakodaShintaro SakodaShintaro merged commit c085b15 into autowarefoundation:main Jun 6, 2024
22 of 25 checks passed
@SakodaShintaro SakodaShintaro deleted the feat/add_score_diff_to_ndt_diag branch June 6, 2024 05:53
kminoda pushed a commit to kminoda/autoware.universe that referenced this pull request Jun 6, 2024
…ion#7227)

* Added score diff to ndt diag

Signed-off-by: Shintaro Sakoda <[email protected]>

* Updated README.md

Signed-off-by: Shintaro Sakoda <[email protected]>

* style(pre-commit): autofix

---------

Signed-off-by: Shintaro Sakoda <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
KhalilSelyan pushed a commit that referenced this pull request Jul 22, 2024
* Added score diff to ndt diag

Signed-off-by: Shintaro Sakoda <[email protected]>

* Updated README.md

Signed-off-by: Shintaro Sakoda <[email protected]>

* style(pre-commit): autofix

---------

Signed-off-by: Shintaro Sakoda <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:localization Vehicle's position determination in its environment. (auto-assigned) run:build-and-test-differential Mark to enable build-and-test-differential workflow. (used-by-ci) type:documentation Creating or refining documentation. (auto-assigned)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants