Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unsound results for configuration #83

Open
kkaulen opened this issue Nov 26, 2024 · 0 comments
Open

Unsound results for configuration #83

kkaulen opened this issue Nov 26, 2024 · 0 comments

Comments

@kkaulen
Copy link

kkaulen commented Nov 26, 2024

Describe the bug
Given the following configuration, the solver returns an UNSAT result for every instance. However, two of the instances are actually SAT. I also tried this config with other models and, again, every instance was found to be UNSAT.

The configuration in question:

attack:
  pgd_order: middle
bab:
  branching:
    input_split:
      catch_assertion: true
      compare_with_old_bounds: true
      enable: true
    method: sb
model:
  name: mnist_conv_big
  path: models/eran/mnist_conv_big_diffai.pth
data:
  dataset: MNIST_ERAN
  start: 0
  end: 20
solver:
  bound_prop_method: crown
specification:
  epsilon: 0.3

To Reproduce
Save the above config under ./complete_verifier/faulty_config.yaml and run python3 abcrown.py --config ./faulty_config.yaml.

System configuration:

  • OS: Rocky Linux 9.4 (Blue Onyx)
  • Python version: 3.11.5
  • Pytorch Version: 2.5.0
  • Hardware: NVIDIA H100
  • Have you tried to reproduce the problem in a cleanly created conda/virtualenv environment using official installation instructions and the latest code on the main branch?: Yes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant