Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Docker images have certain layers stuck in retrying during push #33646

Closed
JustKato opened this issue Feb 19, 2025 · 8 comments
Closed

Docker images have certain layers stuck in retrying during push #33646

JustKato opened this issue Feb 19, 2025 · 8 comments
Labels
type/bug

Comments

@JustKato
Copy link

Description

Description

The current issue I am facing is the fact that I can not use the container registry at all, I have tried all possible combinations and the results are always the same:

  1. I tried to use an Authentication Token ( with ALL permissions set to write ) to create a workflow that automatically builds and pushes my image to the repository when someone merges my PR ( this is where the error showed up, I got frustrated that maybe it was permissions and I just gave it all permissions )
  2. I have tried the authentication locally, seems like I can use the gitea API completely fine with it, I have managed to do anything you could wish for, anything from fetching what repos I have access to to creating new repos.
  3. I tried to do docker login with my authentication token with my username ( and _token username ) and when I push the image I always get the same response ( can be seen below at the logs section )
  4. I removed all my 2FA and passkeys and tried logging in with my username+password, exactly the same results where the API is ok but I can not do anythin with the repository.
  5. I kept trying different small tweaks, settings, nginx confis, etc.. but couldn't fix it at all or change the outcome

Notes

I have tried changing the org name, the org altogether, make it a personal repo, to try a new account, to try a new name format, to delete the repo and re-create it, etc.. Nothing worked and I would just get 401 Unauthorized and Retrying for all layers.
It asked for my GPG password from my key ( I didn't configure anything like this on my gitea ) at one point, I completed it, and after that it simply pushed SOME of the layers succesfully and I am getting stuck at this latest erorr.

Setup

General idea of the setup:

I have an NGINX running on systemd that is doing a reverse proxy of all requests handling domains and whatnot to my docker compose containers.
I have multiple services working using this method, and I have been using this setup many many times and it has proven itself.
https nginx -> reverse proxy -> http://0.0.0.0:8000 local docker container

nginx config

server {
    server_name git.mydomain.com;

    location / {
        proxy_pass http://0.0.0.0:3000;
        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-Forwarded-Proto $scheme;
        proxy_set_header X-Forwarded-Host $server_name;
        
        # WebSocket support
        proxy_http_version 1.1;
        proxy_set_header Upgrade $http_upgrade;
        proxy_set_header Connection "upgrade";
    }

    # Redirect HTTP to HTTPS (will configure SSL later)
    location /.well-known/acme-challenge/ {
        root /var/www/letsencrypt;
    }

    error_log /var/log/nginx/gitea_error.log;
    access_log /var/log/nginx/gitea_access.log;

    listen 443 ssl; # managed by Certbot
    ssl_certificate /etc/letsencrypt/live/git.mydomain.com/fullchain.pem; # managed by Certbot
    ssl_certificate_key /etc/letsencrypt/live/git.mydomain.com/privkey.pem; # managed by Certbot
    include /etc/letsencrypt/options-ssl-nginx.conf; # managed by Certbot
    ssl_dhparam /etc/letsencrypt/ssl-dhparams.pem; # managed by Certbot

}
server {
    if ($host = git.mydomain.com) {
        return 301 https://$host$request_uri;
    } # managed by Certbot


    listen 80;
    server_name git.mydomain.com;
    return 404; # managed by Certbot
}

docker-compose.yml

services:
  gitea:
    image: gitea/gitea:1.23.4
    container_name: gitea
    restart: unless-stopped
    env_file: .env
    environment:
      - USER_UID=1000
      - USER_GID=1000
      - DB_TYPE=postgres
      - DB_HOST=db:5432
      - DB_NAME=${POSTGRES_DB}
      - DB_USER=${POSTGRES_USER}
      - DB_PASSWD=${POSTGRES_PASSWORD}
    depends_on:
      - db
    ports:
      - "${GITEA_HTTP_PORT}:3000"
      - "${GITEA_SSH_PORT}:22"
    volumes:
      - ./data/gitea:/data
    networks:
      - gitea_network

  db:
    image: postgres:latest
    container_name: gitea_db
    restart: unless-stopped
    env_file: .env
    environment:
      - POSTGRES_USER=${POSTGRES_USER}
      - POSTGRES_PASSWORD=${POSTGRES_PASSWORD}
      - POSTGRES_DB=${POSTGRES_DB}
    volumes:
      - ./data/postgres:/var/lib/postgresql/data
    networks:
      - gitea_network

  runner:
    image: gitea/act_runner:latest
    restart: always
    depends_on:
      - gitea
    volumes:
      - ./act_runner:/data
      - /var/run/docker.sock:/var/run/docker.sock
    environment:
      - GITEA_INSTANCE_URL=https://git.mydomain.com
      - GITEA_RUNNER_NAME=local_runner
      - GITEA_RUNNER_REGISTRATION_TOKEN=lErnBlahBlahBlahBlahBlahBlahBlahZguN4

networks:
  gitea_network:
    driver: bridge

Gitea config .ini

APP_NAME = mydomain Git Server
RUN_MODE = prod
RUN_USER = git
WORK_PATH = /data/gitea

[repository]
ROOT = /data/git/repositories

[repository.local]
LOCAL_COPY_PATH = /data/gitea/tmp/local-repo

[repository.upload]
TEMP_PATH = /data/gitea/uploads

[server]
APP_DATA_PATH = /data/gitea
DOMAIN = git.mydomain.com
SSH_DOMAIN = git.mydomain.com
HTTP_PORT = 3000
ROOT_URL = https://git.mydomain.com/
DISABLE_SSH = false
SSH_PORT = 2222
SSH_LISTEN_PORT = 22
LFS_START_SERVER = true
LFS_JWT_SECRET = ripmBLAHBLAHBLAHBLAHBLAHBLAHBLAH0Gwk
OFFLINE_MODE = false

[database]
PATH = /data/gitea/gitea.db
DB_TYPE = postgres
HOST = db:5432
NAME = gitea
USER = gitea
PASSWD = 7ZvGBLAHBLAHBLAHBLAHBLAHTNJgf
LOG_SQL = false
SCHEMA = 
SSL_MODE = disable

[indexer]
ISSUE_INDEXER_PATH = /data/gitea/indexers/issues.bleve

[session]
PROVIDER_CONFIG = /data/gitea/sessions
PROVIDER = file

[picture]
AVATAR_UPLOAD_PATH = /data/gitea/avatars
REPOSITORY_AVATAR_UPLOAD_PATH = /data/gitea/repo-avatars
DISABLE_GRAVATAR = false
ENABLE_FEDERATED_AVATAR = true

[attachment]
ENABLED = true
PATH = /data/gitea/attachments
MAX_SIZE = 2000
MAX_FILES = 100
STORE_TYPE = local

[log]
MODE = console
LEVEL = info
ROOT_PATH = /data/gitea/log

[security]
INSTALL_LOCK = true
SECRET_KEY = 
REVERSE_PROXY_LIMIT = 1
REVERSE_PROXY_TRUSTED_PROXIES = *
INTERNAL_TOKEN = eyJhbBLAHJBLBLAHBLAHBLAHBLAHBLAHBLAHBLAHBLAHBLAHBLAHBLAHfQ
PASSWORD_HASH_ALGO = pbkdf2

[service]
DISABLE_REGISTRATION = true
REQUIRE_SIGNIN_VIEW = true
REGISTER_EMAIL_CONFIRM = false
ENABLE_NOTIFY_MAIL = false
ALLOW_ONLY_EXTERNAL_REGISTRATION = false
ENABLE_CAPTCHA = false
DEFAULT_KEEP_EMAIL_PRIVATE = false
DEFAULT_ALLOW_CREATE_ORGANIZATION = true
DEFAULT_ENABLE_TIMETRACKING = true
NO_REPLY_ADDRESS = noreply.localhost

[lfs]
PATH = /data/git/lfs

[mailer]
ENABLED = false

[openid]
ENABLE_OPENID_SIGNIN = true
ENABLE_OPENID_SIGNUP = false

[cron.update_checker]
ENABLED = true

[repository.pull-request]
DEFAULT_MERGE_STYLE = merge

[repository.signing]
DEFAULT_TRUST_MODEL = committer

[oauth2]
JWT_SECRET = zDBLAHBLAHBLAHBLAHBLAHBLAHBLAHBLAHBLAHvoIdQ

[packages]
ENABLED = true

[container]
ENABLED = true
SERVE_DIRECT = false

Logs

Command Line ( client side sending the request )

$ docker push git.mydomain.com/myorg/socialwebextensionbackend:latest
The push refers to repository [git.mydomain.com/myorg/socialwebextensionbackend]
3c6f0581657e: Layer already exists 
5ed8ccc9e2c0: Layer already exists 
585f1e565f44: Retrying in 15 seconds 
3dc6063d9c92: Layer already exists 
5bfc68ac9c97: Layer already exists 
64947a0ff87d: Layer already exists 
26decc367e87: Retrying in 15 seconds 
a047ee7a639a: Retrying in 15 seconds 
9b3c072882f3: Layer already exists 
dafb8aed9f7f: Retrying in 15 seconds 
41d4dc7516bb: Retrying in 15 seconds 
c0f51bbdc37d: Waiting 
91b542912d12: Waiting 
^Ccontext canceled

Gitea docker log

docker logs -f gitea

Connection closed by authenticating user git xxx.xxx.xxx.xxx port 55970 [preauth]
2025/02/19 12:02:19 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 30.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed GET /v2/ for xxx.xxx.xxx.xxx:0, 401 Unauthorized in 0.5ms @ container/container.go:128(container.ReqContainerAccess)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed GET /v2/token?account=daniel&scope=repository%3Aorgname%2Fsocialwebextensionbackend%3Apush%2Cpull&service=container_registry for xxx.xxx.xxx.xxx:0, 200 OK in 34.2ms @ container/container.go:151(container.Authenticate)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/orgname/socialwebextensionbackend/blobs/sha256:3158e7d90c1e9376c2554828a03231308fca282b07453c6f036aa3762ce7028d for xxx.xxx.xxx.xxx:0, 200 OK in 12.5ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/orgname/socialwebextensionbackend/blobs/sha256:d562f4690a5c7df74d89aca8ddec9df04f262baad61c897035d4cbc1b78f1839 for xxx.xxx.xxx.xxx:0, 200 OK in 10.6ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/orgname/socialwebextensionbackend/blobs/sha256:f1dcf377abe3ceb9484456b8f33a3ec149fdd69aed1cd48d2b9f2bbbac5d84d1 for xxx.xxx.xxx.xxx:0, 404 Not Found in 6.0ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/orgname/socialwebextensionbackend/blobs/sha256:95d7bd57a6047d01d04425a1ed3533d005432c09eca5958289507d3a90a72e55 for xxx.xxx.xxx.xxx:0, 200 OK in 39.6ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 35.6ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/orgname/socialwebextensionbackend/blobs/sha256:85e58a3b469ff21f2a03d14e028b3ed46191098bdfa8fe8942074a8b250e4e6d for xxx.xxx.xxx.xxx:0, 200 OK in 50.2ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/orgname/socialwebextensionbackend/blobs/sha256:ac7f192c84351109a2f36dfd21823af52276ba969182bec352822d12bb4db623 for xxx.xxx.xxx.xxx:0, 200 OK in 28.5ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 8.0ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/orgname/socialwebextensionbackend/blobs/sha256:f64adf656190accbf34f4298b25b57ec91a68d7296786a84bb1b69f459e2636c for xxx.xxx.xxx.xxx:0, 200 OK in 10.8ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/orgname/socialwebextensionbackend/blobs/sha256:7576b00d9bb10cc967bb5bdeeb3d5fa078ac8800e112aa03ed15ec199662d4f7 for xxx.xxx.xxx.xxx:0, 404 Not Found in 6.7ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/orgname/socialwebextensionbackend/blobs/sha256:a9b29c5495e6916997092b89796869085ea740f42438eee0695b464042d6700e for xxx.xxx.xxx.xxx:0, 404 Not Found in 38.4ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 6.8ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/orgname/socialwebextensionbackend/blobs/sha256:35af2a7690f2b43e7237d1fae8e3f2350dfb25f3249e9cf65121866f9c56c772 for xxx.xxx.xxx.xxx:0, 404 Not Found in 7.0ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 7.1ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:20 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 6.5ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:21 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.7ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:02:23 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:02:25 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.1ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:02:25 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 9.0ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:25 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 8.4ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:25 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 6.5ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:25 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 18.7ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:25 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 36.9ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:27 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 29.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:02:29 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 35.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:02:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.5ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:02:33 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.9ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:02:35 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:02:35 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 8.7ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:35 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 7.0ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:35 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 7.3ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:35 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 8.4ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:02:35 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/orgname/socialwebextensionbackend/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 7.9ms @ container/container.go:233(container.InitiateUploadBlob)

Gitea Version

1.23.4

Can you reproduce the bug on the Gitea demo site?

No

Log Gist

No response

Screenshots

No response

Git Version

git version 2.47.2

Operating System

Container Alpine Linux v3.21 | Host OS: Debian 12

How are you running Gitea?

Through a reverse proxy with nginx and a docker-compose.yml that is running the container.

Database

PostgreSQL
@JustKato
Copy link
Author

I would appreciate any kind of tips or help, it's been really infuriating trying to deal with this, what is most annoying is that the same docker-compose is running on my personal server which doesn't have these issues with the container registry... I really want to find out how I have gotten to this point, I would even agree to send a .zip of my docker-compose.yml to devs.

@wxiaoguang
Copy link
Contributor

Just a guess, would setting max-concurrent-uploads to 1 resolve the problem? IIRC there are still many pending bugs in the container/docker registry implementation.

also @KN4CK3R

@JustKato
Copy link
Author

Update

About

Managed to reproduce the issue from pushing from another machine, I have tried doing another container push by:

  1. Cloning the repo to one of my personal servers
  2. Building the docker image
  3. Logging in with username:password using docker login git.mydomain.com

⚠ The exact same behaviour is present when using a PAT ⚠

Client command output

$ docker push git.mydomain.com/daniel/clinic-social-api-2
Using default tag: latest
The push refers to repository [git.mydomain.com/daniel/clinic-social-api-2]
961530ec9c6b: Pushed 
59e34931e5eb: Pushed 
8f7d204405f9: Retrying in 8 seconds 
98fef930a655: Pushed 
853fbae479f1: Pushed 
64947a0ff87d: Pushed 
26decc367e87: Retrying in 8 seconds 
a047ee7a639a: Retrying in 8 seconds 
9b3c072882f3: Pushed 
dafb8aed9f7f: Retrying in 8 seconds 
41d4dc7516bb: Retrying in 8 seconds 
c0f51bbdc37d: Waiting 
91b542912d12: Waiting 
^Ccontext canceled

Server Log

2025/02/19 12:12:19 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
Connection closed by authenticating user git xxx.xxx.xxx.xxx port 58226 [preauth]
2025/02/19 12:12:21 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.1ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:23 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.0ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:25 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:27 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.1ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:29 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 30.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.6ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:33 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.3ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:35 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.6ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:37 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.9ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:39 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:41 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 35.5ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:43 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:44 ...eb/routing/logger.go:102:func1() [I] router: completed GET /myorg/socialwebextensionbackend.git/info/refs?service=git-upload-pack for xxx.xxx.xxx.xxx:0, 401 Unauthorized in 2.0ms @ web/githttp.go:16(web.addOwnerRepoGitHTTPRouters)
2025/02/19 12:12:45 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:47 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:49 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.6ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:51 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:52 ...rvices/auth/basic.go:139:Verify() [E] UserSignIn: user's password is invalid [uid: 2, name: daniel]
2025/02/19 12:12:52 routers/web/web.go:121:func9() [E] Failed to verify user: user's password is invalid [uid: 2, name: daniel]
2025/02/19 12:12:52 ...eb/routing/logger.go:102:func1() [I] router: completed GET /myorg/socialwebextensionbackend.git/info/refs?service=git-upload-pack for xxx.xxx.xxx.xxx:0, 401 Unauthorized in 88.3ms @ web/web.go:118(web.Routes.webAuth)
2025/02/19 12:12:52 ...rvices/auth/basic.go:139:Verify() [E] UserSignIn: user's password is invalid [uid: 2, name: daniel]
2025/02/19 12:12:52 routers/web/web.go:121:func9() [E] Failed to verify user: user's password is invalid [uid: 2, name: daniel]
2025/02/19 12:12:52 ...eb/routing/logger.go:102:func1() [I] router: completed GET /myorg/socialwebextensionbackend.git/info/refs?service=git-upload-pack for xxx.xxx.xxx.xxx:0, 401 Unauthorized in 92.4ms @ web/web.go:118(web.Routes.webAuth)
2025/02/19 12:12:53 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.1ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:54 ...eb/routing/logger.go:102:func1() [I] router: completed GET /myorg/socialwebextensionbackend.git/info/refs?service=git-upload-pack for xxx.xxx.xxx.xxx:0, 401 Unauthorized in 0.5ms @ web/githttp.go:16(web.addOwnerRepoGitHTTPRouters)
2025/02/19 12:12:55 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.9ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:57 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:12:59 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:01 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:03 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:05 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.3ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:07 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.7ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:07 ...eb/routing/logger.go:102:func1() [I] router: completed GET /myorg/socialwebextensionbackend.git/info/refs?service=git-upload-pack for xxx.xxx.xxx.xxx:0, 200 OK in 125.3ms @ repo/githttp.go:518(repo.GetInfoRefs)
2025/02/19 12:13:07 ...eb/routing/logger.go:102:func1() [I] router: completed POST /myorg/socialwebextensionbackend.git/git-upload-pack for xxx.xxx.xxx.xxx:0, 200 OK in 107.8ms @ repo/githttp.go:478(repo.ServiceUploadPack)
2025/02/19 12:13:08 ...eb/routing/logger.go:102:func1() [I] router: completed POST /myorg/socialwebextensionbackend.git/git-upload-pack for xxx.xxx.xxx.xxx:0, 200 OK in 235.1ms @ repo/githttp.go:478(repo.ServiceUploadPack)
2025/02/19 12:13:09 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 29.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:11 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:13 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.7ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:15 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:17 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.1ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:19 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.3ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:21 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.9ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:23 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.0ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:25 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:27 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 37.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:29 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.1ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:33 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:35 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.5ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:37 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.3ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:39 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.0ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:41 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.3ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:43 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:45 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.3ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:47 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.5ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:49 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:51 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:53 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.7ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:55 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.0ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:57 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 28.6ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:13:59 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.5ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:01 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:03 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.9ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:05 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.3ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:07 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.1ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:09 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.6ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:11 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.0ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:13 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:15 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.5ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:17 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:19 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.5ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:19 ...eb/routing/logger.go:102:func1() [I] router: completed GET /v2/ for xxx.xxx.xxx.xxx:0, 401 Unauthorized in 0.4ms @ container/container.go:128(container.ReqContainerAccess)
2025/02/19 12:14:19 ...eb/routing/logger.go:102:func1() [I] router: completed GET /v2/token?account=daniel&client_id=docker&offline_token=true&service=container_registry for xxx.xxx.xxx.xxx:0, 200 OK in 93.5ms @ container/container.go:151(container.Authenticate)
2025/02/19 12:14:19 ...eb/routing/logger.go:102:func1() [I] router: completed GET /v2/ for xxx.xxx.xxx.xxx:0, 200 OK in 2.3ms @ container/container.go:143(container.DetermineSupport)
2025/02/19 12:14:21 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.6ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:23 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.9ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:25 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:27 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.7ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:29 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 31.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed GET /v2/ for xxx.xxx.xxx.xxx:0, 401 Unauthorized in 0.2ms @ container/container.go:128(container.ReqContainerAccess)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed GET /v2/token?account=daniel&scope=repository%3Adaniel%2Fclinic-social-api-2%3Apush%2Cpull&service=container_registry for xxx.xxx.xxx.xxx:0, 200 OK in 89.6ms @ container/container.go:151(container.Authenticate)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.8ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.1ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.3ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.0ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PATCH /v2/daniel/clinic-social-api-2/blobs/uploads/8t70lpfvukjb3rvjhduwe9eqz for xxx.xxx.xxx.xxx:0, 202 Accepted in 5.0ms @ container/container.go:343(container.UploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 33.7ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PATCH /v2/daniel/clinic-social-api-2/blobs/uploads/okf9bb7qqa2ofuj9vnbrsazzt for xxx.xxx.xxx.xxx:0, 202 Accepted in 8.2ms @ container/container.go:343(container.UploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PUT /v2/daniel/clinic-social-api-2/blobs/uploads/8t70lpfvukjb3rvjhduwe9eqz?digest=sha256%3A77f1d932773e63e7c921647a50c08af10150da075962c9f79cd9b73266eadc2d for xxx.xxx.xxx.xxx:0, 201 Created in 19.1ms @ container/container.go:388(container.EndUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PUT /v2/daniel/clinic-social-api-2/blobs/uploads/okf9bb7qqa2ofuj9vnbrsazzt?digest=sha256%3A417eb597568a18118d303bf28067e5001e41c0f65212e5640e84c8c36cc5f02f for xxx.xxx.xxx.xxx:0, 201 Created in 13.4ms @ container/container.go:388(container.EndUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:77f1d932773e63e7c921647a50c08af10150da075962c9f79cd9b73266eadc2d for xxx.xxx.xxx.xxx:0, 200 OK in 5.9ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:417eb597568a18118d303bf28067e5001e41c0f65212e5640e84c8c36cc5f02f for xxx.xxx.xxx.xxx:0, 200 OK in 9.1ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PATCH /v2/daniel/clinic-social-api-2/blobs/uploads/zjirzyc5nqmzelb3mzdditvpw for xxx.xxx.xxx.xxx:0, 202 Accepted in 44.7ms @ container/container.go:343(container.UploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:ac7f192c84351109a2f36dfd21823af52276ba969182bec352822d12bb4db623 for xxx.xxx.xxx.xxx:0, 404 Not Found in 5.4ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:f1dcf377abe3ceb9484456b8f33a3ec149fdd69aed1cd48d2b9f2bbbac5d84d1 for xxx.xxx.xxx.xxx:0, 404 Not Found in 4.8ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PUT /v2/daniel/clinic-social-api-2/blobs/uploads/zjirzyc5nqmzelb3mzdditvpw?digest=sha256%3Af3066b9562a12f5db310bdf8cada6ad67b4a63937ff347085a29e36d9beb57a5 for xxx.xxx.xxx.xxx:0, 201 Created in 15.0ms @ container/container.go:388(container.EndUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 3.9ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 3.6ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:f3066b9562a12f5db310bdf8cada6ad67b4a63937ff347085a29e36d9beb57a5 for xxx.xxx.xxx.xxx:0, 200 OK in 6.7ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PATCH /v2/daniel/clinic-social-api-2/blobs/uploads/l02izecit2fjuyn2mjfwljlwv for xxx.xxx.xxx.xxx:0, 202 Accepted in 39.4ms @ container/container.go:343(container.UploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PATCH /v2/daniel/clinic-social-api-2/blobs/uploads/4i7ex6ak08aipzcxgla485kbu for xxx.xxx.xxx.xxx:0, 202 Accepted in 5.0ms @ container/container.go:343(container.UploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:a9b29c5495e6916997092b89796869085ea740f42438eee0695b464042d6700e for xxx.xxx.xxx.xxx:0, 404 Not Found in 3.4ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PUT /v2/daniel/clinic-social-api-2/blobs/uploads/4i7ex6ak08aipzcxgla485kbu?digest=sha256%3Aac7f192c84351109a2f36dfd21823af52276ba969182bec352822d12bb4db623 for xxx.xxx.xxx.xxx:0, 201 Created in 10.9ms @ container/container.go:388(container.EndUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.4ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:ac7f192c84351109a2f36dfd21823af52276ba969182bec352822d12bb4db623 for xxx.xxx.xxx.xxx:0, 200 OK in 6.9ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:f64adf656190accbf34f4298b25b57ec91a68d7296786a84bb1b69f459e2636c for xxx.xxx.xxx.xxx:0, 404 Not Found in 4.4ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.3ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PATCH /v2/daniel/clinic-social-api-2/blobs/uploads/djjlajehu4j2kictb7r4t1e1c for xxx.xxx.xxx.xxx:0, 202 Accepted in 5.1ms @ container/container.go:343(container.UploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PUT /v2/daniel/clinic-social-api-2/blobs/uploads/l02izecit2fjuyn2mjfwljlwv?digest=sha256%3A924266f0f908e1e61311824fc8c7086ca26eb11d3be589a993338afbc73e01ae for xxx.xxx.xxx.xxx:0, 201 Created in 113.9ms @ container/container.go:388(container.EndUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed PUT /v2/daniel/clinic-social-api-2/blobs/uploads/djjlajehu4j2kictb7r4t1e1c?digest=sha256%3Af64adf656190accbf34f4298b25b57ec91a68d7296786a84bb1b69f459e2636c for xxx.xxx.xxx.xxx:0, 201 Created in 12.5ms @ container/container.go:388(container.EndUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:924266f0f908e1e61311824fc8c7086ca26eb11d3be589a993338afbc73e01ae for xxx.xxx.xxx.xxx:0, 200 OK in 7.3ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:f64adf656190accbf34f4298b25b57ec91a68d7296786a84bb1b69f459e2636c for xxx.xxx.xxx.xxx:0, 200 OK in 7.0ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:7576b00d9bb10cc967bb5bdeeb3d5fa078ac8800e112aa03ed15ec199662d4f7 for xxx.xxx.xxx.xxx:0, 404 Not Found in 4.6ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 3.9ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:35af2a7690f2b43e7237d1fae8e3f2350dfb25f3249e9cf65121866f9c56c772 for xxx.xxx.xxx.xxx:0, 404 Not Found in 4.7ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:31 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.1ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:33 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.8ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:35 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.3ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:36 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 5.5ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:36 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 5.5ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:36 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.6ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:37 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 5.0ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:37 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.6ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:37 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.0ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:39 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.9ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:40 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:a492eee5e55976c7d3feecce4c564aaf6f14fb07fdc5019d06f4154eddc93fde for xxx.xxx.xxx.xxx:0, 404 Not Found in 6.5ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:40 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/clinic-social-api-2/blobs/sha256:32b550be6cb62359a0f3a96bc0dc289f8b45d097eaad275887f163c6780b4108 for xxx.xxx.xxx.xxx:0, 404 Not Found in 6.3ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:14:40 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.5ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:40 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/clinic-social-api-2/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.3ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:14:41 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:14:43 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)

@JustKato
Copy link
Author

Update

Description

I have tried to create a completely new DockerFile and push that as a completely standalone package and I am getting exacrtly the same issues, it has 4 layers and on the 4th layer it gets stuck in retrying...

logs

Dockerfile

FROM alpine:latest
RUN apk add --no-cache bash

WORKDIR /app
COPY . .

CMD ["echo", "Hello from example-package!"]

Client Logs

docker push git.mydomain.com/daniel/example-package:latest
The push refers to repository [git.mydomain.com/daniel/example-package]
e87ff25c1c12: Pushed 
818c5ebe29b0: Pushed 
54408965fe73: Pushed 
08000c18d16d: Retrying in 9 seconds 
^Ccontext canceled

Server Logs

2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed GET /v2/ for xxx.xxx.xxx.xxx:0, 401 Unauthorized in 0.4ms @ container/container.go:128(container.ReqContainerAccess)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed GET /v2/token?account=daniel&scope=repository%3Adaniel%2Fexample-package%3Apush%2Cpull&service=container_registry for xxx.xxx.xxx.xxx:0, 200 OK in 34.4ms @ container/container.go:151(container.Authenticate)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/example-package/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 5.1ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/example-package/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 5.0ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/example-package/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 4.4ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/example-package/blobs/sha256:f18232174bc91741fdf3da96d85011092101a032a93a388b79e99e69c2d5c870 for xxx.xxx.xxx.xxx:0, 404 Not Found in 34.5ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed PATCH /v2/daniel/example-package/blobs/uploads/24bq9jz2xixiq7cpqo1vtiwik for xxx.xxx.xxx.xxx:0, 202 Accepted in 5.9ms @ container/container.go:343(container.UploadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/example-package/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 3.8ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed PUT /v2/daniel/example-package/blobs/uploads/24bq9jz2xixiq7cpqo1vtiwik?digest=sha256%3Af234e2519680959d3a48526d599a7d39f8649c8085a15bd33e2723a2e3112212 for xxx.xxx.xxx.xxx:0, 201 Created in 19.5ms @ container/container.go:388(container.EndUploadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed PATCH /v2/daniel/example-package/blobs/uploads/3s4oxk7qu4rynv2x0e8yfzco6 for xxx.xxx.xxx.xxx:0, 202 Accepted in 7.1ms @ container/container.go:343(container.UploadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/example-package/blobs/sha256:f234e2519680959d3a48526d599a7d39f8649c8085a15bd33e2723a2e3112212 for xxx.xxx.xxx.xxx:0, 200 OK in 7.3ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed PUT /v2/daniel/example-package/blobs/uploads/3s4oxk7qu4rynv2x0e8yfzco6?digest=sha256%3A490983e9861b86c11e2ee574ed9f79ad49e48f47a4d0300c96303eff47a1fc0d for xxx.xxx.xxx.xxx:0, 201 Created in 16.7ms @ container/container.go:388(container.EndUploadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/example-package/blobs/sha256:490983e9861b86c11e2ee574ed9f79ad49e48f47a4d0300c96303eff47a1fc0d for xxx.xxx.xxx.xxx:0, 200 OK in 8.0ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed PATCH /v2/daniel/example-package/blobs/uploads/kh49wn1ojznercn7vkronkcrn for xxx.xxx.xxx.xxx:0, 202 Accepted in 26.4ms @ container/container.go:343(container.UploadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed PUT /v2/daniel/example-package/blobs/uploads/kh49wn1ojznercn7vkronkcrn?digest=sha256%3Acfa007682548e370d2e82575a4bb86dcf1791ad6b2f72b4d78bf5d2fc0dd4fa2 for xxx.xxx.xxx.xxx:0, 201 Created in 17.0ms @ container/container.go:388(container.EndUploadBlob)
2025/02/19 12:21:38 ...eb/routing/logger.go:102:func1() [I] router: completed HEAD /v2/daniel/example-package/blobs/sha256:cfa007682548e370d2e82575a4bb86dcf1791ad6b2f72b4d78bf5d2fc0dd4fa2 for xxx.xxx.xxx.xxx:0, 200 OK in 7.4ms @ container/container.go:501(container.HeadBlob)
2025/02/19 12:21:39 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:21:41 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:21:43 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 33.2ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:21:43 ...eb/routing/logger.go:102:func1() [I] router: completed POST /v2/daniel/example-package/blobs/uploads/ for xxx.xxx.xxx.xxx:0, 202 Accepted in 5.9ms @ container/container.go:233(container.InitiateUploadBlob)
2025/02/19 12:21:45 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 30.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:21:47 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.1ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:21:49 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 32.4ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)
2025/02/19 12:21:51 ...eb/routing/logger.go:102:func1() [I] router: completed POST /api/actions/runner.v1.RunnerService/FetchTask for 172.20.0.2:0, 200 OK in 34.0ms @ <autogenerated>:1(http.Handler.ServeHTTP-fm)

@JustKato
Copy link
Author

Just a guess, would setting max-concurrent-uploads to 1 resolve the problem? IIRC there are still many pending bugs in the container/docker registry implementation.

also @KN4CK3R

Where could I find this to set? Is it in the postgresql or in the gitea config?

@KN4CK3R
Copy link
Member

KN4CK3R commented Feb 19, 2025 •
edited
Loading

It's a Docker client setting for the build/push command.

@JustKato
Copy link
Author

It's a Docker client setting for the build/push command.

Doesn't seem to fix the issue, I have applied it in the daemon and other places. Is this because of postgresql? My other mariadb instance is working flawlessly and I use it daily, over 50 repos working just fine to auto-build into docker images.

Is there no fix for this?

@JustKato
Copy link
Author

Update

After re-creating and reproducing this issue on multiple servers from multiple clients ( definitely the server-side issue ), I have finally figured it out, how? I let the retry command actually finish. What did it say?

unknown: <html>
<head><title>413 Request Entity Too Large</title></head>
<body>
<center><h1>413 Request Entity Too Large</h1></center>
<hr><center>nginx/1.22.1</center>
</body>
</html>

Now if you are not an idiot like me, you wait for commands to finish their retries to tell you the error, but me being a smartass I thought that the authorization issues were a deeper rooted issue...
I have now found out that, it is not a gitea issue...

Fixed 🍾🎉

The issue was the nginx configuration for the site, you will notice that I do not mention anywhere what the request size can be, hence it defaults to a quite reasonable but small size ( for repository layers )...

If you are having this issue, please make sure you set the client_max_body_size 0; or to whatever big size like 10G inside of your server { HERE } body in the nginx config!

Thanks @KN4CK3R and @wxiaoguang for even humoring my stupid issue...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type/bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@KN4CK3R @wxiaoguang @JustKato