Skip to content

Experiment tracker: organize, visualize, compare and share runs. Removes toil from algorithm/performance R&D and tuning.

License

Notifications You must be signed in to change notification settings

Samsung/qaboard

Folders and files

NameName
Last commit message
Last commit date

Latest commit

7d654ce · Jul 1, 2020
Jun 20, 2020
Jul 1, 2020
Jul 1, 2020
Feb 25, 2020
Jul 1, 2020
Jun 4, 2020
Jul 1, 2020
Jul 1, 2020
Jun 5, 2020
Jul 1, 2020
May 3, 2020
Jul 1, 2020
Feb 12, 2020
Mar 17, 2020
Feb 12, 2020
Feb 17, 2020
Jun 29, 2020
Jun 11, 2020
Jun 29, 2020
Feb 12, 2020
Jun 28, 2020
Jul 1, 2020

Repository files navigation

QA-Board

QA-Board helps Algorithms/Software/QA engineers build great products with powerful quality evaluation and collaboration tools.

qaboard-chat PyPI Docs CI

Features

  • Organize, View and Compare Results, Tuning/Optimization
  • Web-based, with sharable URLs.
  • Visualizations: support for quantitative metrics, and many file formats: advanced image viewer, support for videos, plotly graphs, flame graphs, text, pointclouds, HTML...
  • Integrations: direct access from Git and CI tools, easily exportable results, API, links to the code, trigger gitlabCI/jenkins/webhooks...
  • Agnostic to your language/framework: run your existing code, write files, view them.

For screenshots check the project's website.

Benefits

  • Scale R&D: enable engineers to achieve more and be more productive.
  • Faster Time-to-Market: collaboration across teams, workflow integration..
  • Quality: uncover issues earlier, KPIs, tuning, reporting...

Get in touch

We are looking for feedback and insights from outside Samsung. This will help us set the direction for qaboard.

We think you could be interested if have projects where:

  • unit tests are not enough (ML, operational research...), and a loss function doesn't tell the whole story. Maybe because...
  • there are performance / quality trade-offs, or different configurations of your code you need to compare (hardware design, mobile/embedded...).
  • you need advanced visualizations to make sense of results (statistics, image processing, 3d sensors, sensing and decision tasks...) and need tools to dive down into outputs.
  • lifecycles are complex, with many stakeholders (algo, hardware, software, QA, production...)

Contact arthur.flam@samsung.com

Getting Started

Read the docs! You will learn how to:

  • run a QA-Board server
  • install QA-Board's CLI wrapper
  • wrap your code with QA-Board
  • view output files and KPIs
  • ...and improve your integration with many guides: bit-accuracy, tuning, etc.

If you want to learn about the code organization, or how to contribute, read CONTRIBUTING.md

Questions? Need Help? Found a bug?

If you've got questions about setup, deploying, want to develop new features, or just want to chat with the developers, please feel free to start a thread in our Spectrum community!

Found a bug with QA-Board? Go ahead and submit an issue. And, of course, feel free to submit pull requests with bug fixes or changes to the master branch.

Contributors

QA-Board was started at Samsung SIRC by Arthur Flam.

Thanks to the following people for their contributions, testing, feedback or bug reports: Amir Fruchtman, Avi Schori, Yochay Doutsh, Itamar Persi, Amichay Amitay, Lena Grechikhin, Shai Shamir, Matan Danino, Roy Shaul, Gal Hai, Rivka Emanuel, Ela Shahar, Nadav Ofer, David Nukrai. Thanks also to Sebastien Derhy, Elad Rozin, Nathan Levy, Shahaf Duenyas, Yotam Ater, Asaf Jazcilevich and Yoel Yaffe for supporting the project.

You don't see your name? Get in touch to be added to the list!

Credits

  • The logo is a the Poodle twemoji 🐩, recolored in Samsung Blue 🔵. Copyright 2019 Twitter, Inc and other contributors. Code licensed under the MIT License. Graphics licensed under CC-BY 4.0