You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As of now, the check is binary. This requires the outputs to be pixel-perfect, whereas reality might require a human reviewer to make that call. Therefore we should discuss to loosen the binary nature of the check and...
consider adding different result levels, better distinguishing
consider not requiring images to be pixel perfect - can the checker distinguish between grayscale changes and completely different curves in a graph?
consider allowing reviewers to override a result (transparently), maybe with a specific status check_overruled ?
The text was updated successfully, but these errors were encountered:
As of now, the check is binary. This requires the outputs to be pixel-perfect, whereas reality might require a human reviewer to make that call. Therefore we should discuss to loosen the binary nature of the check and...
check_overruled
?The text was updated successfully, but these errors were encountered: