Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Security Solution][Threat Intelligence] - fix Cypress tests #209195

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

PhilippeOberti
Copy link
Contributor

Summary

This PR fixes the few Threat Intelligence Cypress tests which started failing recently.

This PR (commit on main) which was a basic bump PR started had to skip a few Threat Intelligence Cypress tests that started failing.

I tried to understand what happened but did not find the origin of the issue. The indicators table was previously showing data sorted from oldest to newest (but only on Cypress, not when running the application locally, really weird). After the commit mentioned above, the Cypress tests are now sorting the data from newest to oldest.
Looking at the code, nothing mentions sorting, the threatIntelligenceSearchStrategy is identical between the application running locally and the Cypress tests.

Payload

Local run Cypress
Screenshot 2025-01-31 at 2 20 33 PM Screenshot 2025-01-31 at 2 21 39 PM

Result

The results are different, one sorted ascending, the other descending.

Local run Cypress
Screenshot 2025-01-31 at 2 22 19 PM Screenshot 2025-01-31 at 2 22 03 PM

No code changes have been done to the Threat Intelligence plugin in many months. Fetching the data is done using useQuery (see here) and the logic to fetch the actual data is here. Both haven't been touched in months...

Nothing in the commit mentioned above seems to give any details on why these tests just started failing. Resetting to the commit right before makes the tests pass...

The solution to fix the tests was to ensure that the data_archive files had the correct timestamps, to know exactly which ones we select in the Cypress tests to test against...

#209050
#209039
#209051

@PhilippeOberti PhilippeOberti added release_note:skip Skip the PR/issue when compiling release notes Team:Threat Hunting:Investigations Security Solution Investigations Team backport:version Backport to applied version labels v9.1.0 v8.19.0 labels Feb 1, 2025
@PhilippeOberti PhilippeOberti requested review from a team as code owners February 1, 2025 00:16
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-threat-hunting-investigations (Team:Threat Hunting:Investigations)

@elasticmachine
Copy link
Contributor

elasticmachine commented Feb 1, 2025

💔 Build Failed

Failed CI Steps

Metrics [docs]

✅ unchanged

History

Copy link
Member

@MadameSheema MadameSheema left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

security-engineering-productivity LGTM!

Qq @PhilippeOberti is there any reason why these tests are executed in ESS and not in serverless? Thanks! :)

@janmonschke
Copy link
Contributor

janmonschke commented Feb 3, 2025

@PhilippeOberti Given that BASELINE_ELASTICSEARCH_VERSION was also bumped to 9.1.0 makes me think that the issue came from a change in ES itself. I wonder if we should dig deeper?

Edit: I had a quick look at the changes that were merged to ES 9.1.0 and nothing out of the ordinary popped up.

@janmonschke
Copy link
Contributor

@elasticmachine merge upstream

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:version Backport to applied version labels release_note:skip Skip the PR/issue when compiling release notes Team:Threat Hunting:Investigations Security Solution Investigations Team v8.19.0 v9.1.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants