Network not found for provisionAppEmissaries

[ramiror]

When I run the aws cli command as per the "Testing the provissionAppEmissaries section in the documentation, I get an error about network not existing. Where is the network name taken from? Should I change a config file or maybe recreate docker containers used by this command?

The command in the documentation is:

aws lambda invoke --function-name "provisionAppEmissaries" --endpoint-url "http://172.25.0.1:3001" --no-verify-ssl --payload '{"provisionViaLambdaDto":{"items": [{"testSessionId":"lowPrivUser", "browser":"chrome", "appEmissaryContainerName":"", "seleniumContainerName":""},{"testSessionId":"adminUser", "browser":"firefox", "appEmissaryContainerName":"", "seleniumContainerName":""},{"testSessionId":"lowPrivUser", "browser":"chrome", "appEmissaryContainerName":"", "seleniumContainerName":""},{"testSessionId":"adminUser", "browser":"firefox", "appEmissaryContainerName":"", "seleniumContainerName":""},{"testSessionId":"lowPrivUser", "browser":"chrome", "appEmissaryContainerName":"", "seleniumContainerName":""},{"testSessionId":"adminUser", "browser":"firefox", "appEmissaryContainerName":"", "seleniumContainerName":""},{"testSessionId":"lowPrivUser", "browser":"firefox", "appEmissaryContainerName":"", "seleniumContainerName":""},{"testSessionId":"adminUser", "browser":"firefox", "appEmissaryContainerName":"", "seleniumContainerName":""},{"testSessionId":"lowPrivUser", "browser":"chrome", "appEmissaryContainerName":"", "seleniumContainerName":""},{"testSessionId":"adminUser", "browser":"chrome", "appEmissaryContainerName":"", "seleniumContainerName":""}]}}' local/app-emissary-provisioner/out.txt

but it complains about bad base64 format, so I changed it to:

aws lambda invoke --function-name "provisionAppEmissaries" --endpoint-url "http://172.25.0.1:3001" --no-verify-ssl --payload 'eyJwcm92aXNpb25WaWFMYW1iZGFEdG8iOnsiaXRlbXMiOiBbeyJ0ZXN0U2Vzc2lvbklkIjoibG93UHJpdlVzZXIiLCAiYnJvd3NlciI6ImNocm9tZSIsICJhcHBFbWlzc2FyeUNvbnRhaW5lck5hbWUiOiIiLCAic2VsZW5pdW1Db250YWluZXJOYW1lIjoiIn0seyJ0ZXN0U2Vzc2lvbklkIjoiYWRtaW5Vc2VyIiwgImJyb3dzZXIiOiJmaXJlZm94IiwgImFwcEVtaXNzYXJ5Q29udGFpbmVyTmFtZSI6IiIsICJzZWxlbml1bUNvbnRhaW5lck5hbWUiOiIifSx7InRlc3RTZXNzaW9uSWQiOiJsb3dQcml2VXNlciIsICJicm93c2VyIjoiY2hyb21lIiwgImFwcEVtaXNzYXJ5Q29udGFpbmVyTmFtZSI6IiIsICJzZWxlbml1bUNvbnRhaW5lck5hbWUiOiIifSx7InRlc3RTZXNzaW9uSWQiOiJhZG1pblVzZXIiLCAiYnJvd3NlciI6ImZpcmVmb3giLCAiYXBwRW1pc3NhcnlDb250YWluZXJOYW1lIjoiIiwgInNlbGVuaXVtQ29udGFpbmVyTmFtZSI6IiJ9LHsidGVzdFNlc3Npb25JZCI6Imxvd1ByaXZVc2VyIiwgImJyb3dzZXIiOiJjaHJvbWUiLCAiYXBwRW1pc3NhcnlDb250YWluZXJOYW1lIjoiIiwgInNlbGVuaXVtQ29udGFpbmVyTmFtZSI6IiJ9LHsidGVzdFNlc3Npb25JZCI6ImFkbWluVXNlciIsICJicm93c2VyIjoiZmlyZWZveCIsICJhcHBFbWlzc2FyeUNvbnRhaW5lck5hbWUiOiIiLCAic2VsZW5pdW1Db250YWluZXJOYW1lIjoiIn0seyJ0ZXN0U2Vzc2lvbklkIjoibG93UHJpdlVzZXIiLCAiYnJvd3NlciI6ImZpcmVmb3giLCAiYXBwRW1pc3NhcnlDb250YWluZXJOYW1lIjoiIiwgInNlbGVuaXVtQ29udGFpbmVyTmFtZSI6IiJ9LHsidGVzdFNlc3Npb25JZCI6ImFkbWluVXNlciIsICJicm93c2VyIjoiZmlyZWZveCIsICJhcHBFbWlzc2FyeUNvbnRhaW5lck5hbWUiOiIiLCAic2VsZW5pdW1Db250YWluZXJOYW1lIjoiIn0seyJ0ZXN0U2Vzc2lvbklkIjoibG93UHJpdlVzZXIiLCAiYnJvd3NlciI6ImNocm9tZSIsICJhcHBFbWlzc2FyeUNvbnRhaW5lck5hbWUiOiIiLCAic2VsZW5pdW1Db250YWluZXJOYW1lIjoiIn0seyJ0ZXN0U2Vzc2lvbklkIjoiYWRtaW5Vc2VyIiwgImJyb3dzZXIiOiJjaHJvbWUiLCAiYXBwRW1pc3NhcnlDb250YWluZXJOYW1lIjoiIiwgInNlbGVuaXVtQ29udGFpbmVyTmFtZSI6IiJ9XX19Cg==' local/app-emissary-provisioner/out.txt

And the output is:

INFO:werkzeug:172.25.0.4 - - [08/Mar/2022 14:25a:49] "PUT /api/v1/services HTTP/1.1" 500 -
DEBUG:root:get project /home/violeta/./purpleteam-s2-containers/app-emissary
DEBUG:compose.config.config:Using configuration files: /home/violeta/./purpleteam-s2-containers/app-emissary/docker-compose.yml
DEBUG:docker.utils.config:Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
DEBUG:docker.utils.config:No config file found
DEBUG:docker.utils.config:Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
DEBUG:docker.utils.config:No config file found
WARNING:compose.service:The "zap" service specifies a port on the host. If multiple containers for this service are created on a single host, the port will clash.
DEBUG:urllib3.connectionpool:http://localhost:None "GET /v1.36/containers/json?all=0&limit=-1&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dappemissary%22%2C+%22com.docker.compose.service%3Dzap%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D&trunc_cmd=0&size=0 HTTP/1.1" 200 3
DEBUG:urllib3.connectionpool:http://localhost:None "GET /v1.36/containers/json?all=1&limit=-1&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dappemissary%22%2C+%22com.docker.compose.service%3Dzap%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D&trunc_cmd=0&size=0 HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:http://localhost:None "GET /v1.36/containers/5e3c4d485aaf0f8b6f0185af0e3681b159722b6c79c7f937498dbcd6bff6a607/json HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:http://localhost:None "GET /v1.36/containers/1b72cd67341e2b386ae603a72eef52e0f2a9fa67efad7259f1fccf3de94f46cf/json HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:http://localhost:None "GET /v1.36/images/owasp/zap2docker-stable:2.10.0/json HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:http://localhost:None "GET /v1.36/images/owasp/zap2docker-stable:2.10.0/json HTTP/1.1" 200 None
Starting appemissary_zap_1 ... 
Starting appemissary_zap_2 ... 
DEBUG:compose.parallel:Pending: set([<Container: appemissary_zap_2 (5e3c4d)>, <Container: appemissary_zap_1 (1b72cd)>])
Starting appemissary_zap_2 ... error
Starting appemissary_zap_1 ... error
DEBUG:urllib3.connectionpool:http://localhost:None "POST /v1.36/containers/5e3c4d485aaf0f8b6f0185af0e3681b159722b6c79c7f937498dbcd6bff6a607/start HTTP/1.1" 404 97
DEBUG:urllib3.connectionpool:http://localhost:None "POST /v1.36/containers/1b72cd67341e2b386ae603a72eef52e0f2a9fa67efad7259f1fccf3de94f46cf/start HTTP/1.1" 404 97
DEBUG:compose.parallel:Failed: <Container: appemissary_zap_2 (5e3c4d)>
DEBUG:compose.parallel:Pending: set([])
DEBUG:compose.parallel:Failed: <Container: appemissary_zap_1 (1b72cd)>
DEBUG:compose.parallel:Pending: set([])

ERROR: for appemissary_zap_1  Cannot start service zap: network cda5591e2386a497d150ac39ed7930f282d6fab8b50830fa3826bbba18b00d31 not found

ERROR: for appemissary_zap_2  Cannot start service zap: network cda5591e2386a497d150ac39ed7930f282d6fab8b50830fa3826bbba18b00d31 not found
Traceback (most recent call last):
  File "/env/lib/python2.7/site-packages/flask/app.py", line 1612, in full_dispatch_request
    rv = self.dispatch_request()
  File "/env/lib/python2.7/site-packages/flask/app.py", line 1598, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/app/scripts/requires_auth.py", line 54, in decorated
    return func(*args, **kwargs)
  File "/app/main.py", line 198, in scale
    project.get_service(service_name).scale(desired_num=int(num))
  File "/env/lib/python2.7/site-packages/compose/service.py", line 267, in scale
    sorted_containers, desired_num, timeout, True, True
  File "/env/lib/python2.7/site-packages/compose/service.py", line 451, in _execute_convergence_start
    raise OperationFailedError(error)
OperationFailedError
INFO:werkzeug:172.25.0.4 - - [08/Mar/2022 14:32:07] "PUT /api/v1/services HTTP/1.1" 500 -

[binarymist]

Hi @ramiror . It sounds like you may have missed the creation of the docker network step?

but it complains about bad base64 format

Seems most likely that this could be to do with a breaking change in aws cli. I'm currently on:

aws --version
aws-cli/2.2.1 Python/3.8.8 Linux/5.4.0-100-generic exe/x86_64.linuxmint.20 prompt/off

[ramiror]

I solved it. For some reason I had lost docker-compose images for purpleteam-s2-containers. Both app-emissary and selenium-standalone.

Thanks for the tip of aws.

$ aws --version
aws-cli/1.18.69 Python/3.8.10 Linux/5.11.0-46-generic botocore/1.16.19
$