Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add *working* sar binary data indexing support #645

Conversation

portante
Copy link
Member

Fixes #227, replaces #176.

sysstat updates:

  • cover error patterns and version check
  • add support for 0x2173 in sysstat

Add TODO task lists as comments in extract_sa.py

Add unit tests for sar ingress under 'test-7.10'

Also:

Fixes distributed-system-analysis#227

sysstat updates:
 - cover error patterns and version check
 - add support for 0x2173 in sysstat

Add TODO task lists as comments in extract_sa.py

Add unit tests for sar ingress under 'test-7.10'

Also:
 - fix existing unit tests for this branch
 - update line no.s for gold test 7.{3..5}. Refer distributed-system-analysis#303
 - update .gitignore: __pycache__ in any dir
 - cleanup sar-index code addition
Copy link
Member

@ndokos ndokos left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This commit delete server/pbench/lib/vos/* - why? AFAICT, it's still needed by the indexing code.

@ndokos ndokos modified the milestones: V0.46, V0.48 Nov 28, 2017

# Do we need a test to see if DEFAULT_SADF_PATH not present,
# whereas binaries path contains the scripts needed to process?
# Idk, since pbench-sysstat is installed de-facto.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@portante should we be adding that test for DEFAULT_SADF_PATH in a separate PR or have this amended in the current one? The modifications done by you to extract_sa.py would end up being useful for https://github.com/distributed-system-analysis/sarjitsu

Also, how do we plan on maintaining these 2 copies of extract_sa.py? (one in pbench, other in sarjitsu, and actually another in https://github.com/distributed-system-analysis/satools/blob/master/satools/extractsa.py).

Related: distributed-system-analysis/satools#1

thanks for the rework btw :-)) apologies for not being able to review this earlier. Working on my new year resolutions!

@ashishkamra ashishkamra modified the milestones: V0.48, V0.49 Jan 18, 2018
@ndokos ndokos modified the milestones: V0.49, v0.51 May 14, 2018
@portante portante modified the milestones: v0.51, v0.52 Jul 16, 2018
@portante portante modified the milestones: v0.52, v0.53, v0.54 Aug 16, 2018
@portante portante modified the milestones: v0.54, v0.55 Sep 11, 2018
@portante portante modified the milestones: v0.55, v0.56 Jan 25, 2019
@portante portante modified the milestones: v0.56, v0.57 Feb 6, 2019
@portante portante removed this from the v0.57 milestone Feb 23, 2019
@portante portante closed this Feb 24, 2019
@portante portante deleted the pr176-sar-index-archit branch February 24, 2019 01:22
@portante portante added this to the v0.57 milestone May 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature Request] No option in pbench-server for ingressing sar data into elasticsearch
4 participants