feat: augment metrics with cid and cid+path counters

[vasco-santos]

As part of nftstorage/nftstorage.link#18 this PR augments metrics with query type counter. Prometheus metrics look as follows:

# HELP nftgateway_responses_by_query_type_total total of responses by query status. Either CID or CID+PATH.
# TYPE nftgateway_responses_by_query_type_total counter
nftgateway_responses_by_query_type_total{env="test",type="CID"} 1
nftgateway_responses_by_query_type_total{env="test",type="CID+PATH"} 1

[cloudflare-workers-and-pages]

Deploying with    Cloudflare Pages

Latest commit:	6afa2b7
Status:	✅  Deploy successful!
Preview URL:	https://80632ea2.nft-storage-1at.pages.dev

View logs

[vasco-santos]

Any suggestions for better naming for query type would be appreciated. Not super fan of it

[olizilla]

📎 It looks like we are trying to use prometheus to do the job of http access logs We should explore https://www.cloudflare.com/en-gb/products/cloudflare-logs/ and a http access log summary tool.

[vasco-santos]

📎 It looks like we are trying to use prometheus to do the job of http access logs

Thanks for the feedback. I actually understood that I could get part of this metrics with Cloudflare Analytics. Currently using Cloudflare Analytics to obtain content type using https://github.com/nftstorage/cloudflare-analytics-prometheus-exporter/ and this PR will simply focus on query type.

We already have a storage service for logs setup with Logtail and all the Logs go there. Sadly, they don't seem to offer any way of listening to the logtail source and parse inputs so that we can track metrics with a different app that exposes metrics to our Prometheus. They actually have a Grafana dashboard within Logtail, but we need to interact with the logs with SQL and it is quite complex to graph there rates of requests (for subdomain only) that are either CID or CID+Path format. Also, I would prefer to have everything in the same Grafana dashboard and just tracking here seems better than maintaining other service anyway.

[vasco-santos]

Apologies for adding this refactor here 😬 I did the code because this PR already had MimeTypes histogram, but now I think we should keep it as it simplifies current histograms and if we add more in the future

[vasco-santos]

Closed in favour of nftstorage/nftstorage.link#15 as we moved gateway to new repo