-
-
Notifications
You must be signed in to change notification settings - Fork 4.3k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat(issue summary) Only show possible cause if confident and novel (#…
…84349) ## Background `possible_cause_confidence` increases when there's less speculation (which correlates w/ slightly more accurate causes) `possible_cause_novelty` increases when there's more novelty / less redundancy wrt `whats_wrong` thresholds led to 50% of possible causes getting dropped on our autofix sentry issues ([notebook here](https://github.com/getsentry/data-analysis/blob/main/autofix/issue_summary/issue_summary_confidence.ipynb)) ## Backend changes corresponding backend change to sentry: #84346 corresponding backend change to seer: getsentry/seer#1788 without the sentry backend change (there are no `data.scores`), default to current behavior: always show possible cause ![before](https://github.com/user-attachments/assets/9f632a94-690b-4602-bdea-cbd2b95824b0) with the change, only show it if both scores are greater than the threshold ![after](https://github.com/user-attachments/assets/0b1e84af-cc0b-4d0a-8106-58cc615ea602) (note: this example is actually considered novel and confident-enough. I hardcoded the threshold to test the behavior)
- Loading branch information
Showing
3 changed files
with
63 additions
and
10 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters