-
-
Notifications
You must be signed in to change notification settings - Fork 201
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Caching not creating files #880
Comments
@dansku looks like you closed this out, but was the issue related to the missing flag on the seed command? I believe it's --zxy |
Hey @ARolek i did close because i didn't know anyone would answer it. When I ran have you seen something like this? |
Can you post your config? If you're using the postgis provider, you should move to the mvt_postgis provider for better results. |
here is the config, i will check the provider
|
Yeah you're using the postgis type for the provider. Look at the mvt_postgis provider for better results. Also make sure you have indexes on you're geometry columns. |
Change provider type, give me a new error:
This could be an issue?! |
Yea, you need to change you're query up a bit. Please refer to the link I posted earlier. |
yeah just realized i don't, adding them now |
Here's the best documentation on the mvt_postgis provider: https://github.com/go-spatial/tegola/blob/master/mvtprovider/postgis/README.md |
ahh i see, working on it! |
What a massive difference in performance! Valid Geometries: And this is the cell:
getting error:
|
Glad that worked for you! |
thank you for the help, so close from nailing this side of things ;) |
I would need to look at the data. You can turn on SQL debugging to see the query tegola is forming up and then inspect the results against the database directly. |
Will do, 5AM here, will go to sleep and check this in the morning. |
I am facing a similar issue: I ran the command expecting to get tiles from zoom levels 0 to 7, but the result only includes a few of them, not all the tiles in the area zoom 0-7. Additionally, in my configuration, I am using mvt_postgis. app# tegola cache seed \
--config=/opt/tegola_config/config.toml \
--map=osm \
--min-zoom=0 \
--max-zoom=7\
--bounds=-180,-85.05112878,180,85.05112878 \
--concurrency=128 \
--overwrite=true
2024-11-27 18:42:22 [INFO] config.go:406: loading local config (/opt/tegola_config/config.toml)
2024-11-27 18:42:22 [INFO] providers.go:82: registering provider(type): osm (mvt_postgis)
2024-11-27 18:42:22 [INFO] providers.go:82: registering provider(type): ne (mvt_postgis)
2024-11-27 18:42:23 [INFO] seed_purge.go:194: zoom list: [0 1 2 3 4 5 6 7]
2024-11-27 18:42:23 [INFO] cache.go:213: waiting for workers to finish up
2024-11-27 18:42:35 [INFO] worker.go:94: seeding map (osm) tile (1/1/1) took: 12196ms
2024-11-27 18:42:36 [INFO] worker.go:94: seeding map (osm) tile (1/0/1) took: 13271ms
2024-11-27 18:42:45 [INFO] worker.go:94: seeding map (osm) tile (1/0/0) took: 22493ms
2024-11-27 18:42:58 [INFO] worker.go:94: seeding map (osm) tile (2/1/2) took: 35524ms
2024-11-27 18:42:59 [INFO] worker.go:94: seeding map (osm) tile (2/2/1) took: 36435ms
2024-11-27 18:43:09 [INFO] worker.go:94: seeding map (osm) tile (3/3/4) took: 46769ms
2024-11-27 18:43:11 [INFO] worker.go:94: seeding map (osm) tile (0/0/0) took: 48013ms
2024-11-27 18:43:11 [INFO] worker.go:94: seeding map (osm) tile (1/1/0) took: 48548ms
2024-11-27 18:43:18 [INFO] worker.go:94: seeding map (osm) tile (2/1/1) took: 55526ms
2024-11-27 18:43:20 [INFO] worker.go:94: seeding map (osm) tile (2/2/2) took: 57884ms
2024-11-27 18:43:23 [INFO] worker.go:94: seeding map (osm) tile (3/4/4) took: 60612ms
2024-11-27 18:43:24 [INFO] worker.go:94: seeding map (osm) tile (3/3/3) took: 61831ms
2024-11-27 18:43:32 [INFO] worker.go:94: seeding map (osm) tile (4/7/8) took: 69100ms
2024-11-27 18:43:33 [INFO] worker.go:94: seeding map (osm) tile (3/4/3) took: 70648ms
2024-11-27 18:43:36 [INFO] worker.go:94: seeding map (osm) tile (4/8/8) took: 73310ms
2024-11-27 18:43:36 [INFO] worker.go:94: seeding map (osm) tile (4/7/7) took: 73910ms
2024-11-27 18:43:45 [INFO] worker.go:94: seeding map (osm) tile (5/15/16) took: 82271ms
2024-11-27 18:43:45 [INFO] worker.go:94: seeding map (osm) tile (4/8/7) took: 82454ms
2024-11-27 18:43:47 [INFO] worker.go:94: seeding map (osm) tile (5/16/16) took: 84086ms
2024-11-27 18:43:48 [INFO] worker.go:94: seeding map (osm) tile (5/15/15) took: 85456ms
2024-11-27 18:43:53 [INFO] worker.go:94: seeding map (osm) tile (6/31/32) took: 90739ms
2024-11-27 18:43:56 [INFO] worker.go:94: seeding map (osm) tile (5/16/15) took: 92950ms
2024-11-27 18:43:56 [INFO] worker.go:94: seeding map (osm) tile (6/32/32) took: 93547ms
2024-11-27 18:43:57 [INFO] worker.go:94: seeding map (osm) tile (6/32/31) took: 94162ms
2024-11-27 18:44:05 [INFO] worker.go:94: seeding map (osm) tile (6/31/31) took: 102106ms
2024-11-27 18:44:07 [INFO] worker.go:94: seeding map (osm) tile (7/63/64) took: 104398ms
2024-11-27 18:44:07 [INFO] worker.go:94: seeding map (osm) tile (7/64/64) took: 104773ms
2024-11-27 18:44:08 [INFO] worker.go:94: seeding map (osm) tile (7/64/63) took: 105238ms
2024-11-27 18:44:15 [INFO] worker.go:94: seeding map (osm) tile (7/63/63) took: 112725ms
2024-11-27 18:44:15 [INFO] cache.go:223: all workers are done
2024-11-27 18:44:15 [INFO] provider.go:289: cleaning up providers
2024-11-27 18:44:15 [INFO] postgis.go:1039: cleaning up postgis providers
|
Using the tiles-list option work well, |
@Rub21 can you post the cache part of your config? |
Sure, here is my 👉 config . Maybe I missed something, but setting bounds=-180,-85.05112878,180,85.05112878 did not work. maybe that was removed. But using the $ echo "0/0/0" > tile-list.tiles
$ tegola cache seed tile-list tile-list.tiles \
--config=/opt/tegola_config/config.toml \
--map=osm \
--min-zoom=0 \
--max-zoom=7\
--concurrency=128 \
--overwrite=true |
@ARolek It seems that i'm facing exactly the same issue as @Rub21. I'm using Dockerimage "tegola:latest" with mvt_postgis. The following does not work correctly (only one tile per zoom level). It seems to seed empty tiles for the wrong bbox.
Whereas this works like a charm:
|
@Rub21 and @callsumzg I appreciate the reports, but I'm still not sure exactly what the root cause of this issue is. In v0.20.0 there were some changes with how the Can you please try the v0.19.0 version of tegola and report back? cc @gdey |
@Rub21 Thank you for the quick reply. Can i help you any further to debug this? |
Ok nice!
Are you familiar with Go? The next step is hunting down the cause of the issue and developing a test case. Is this something you can help with? |
It looks like e5a7366 touched the tile seeding / purging code last. The commit is associated with some changes @gdey made to generating slippy tiles in the Here's the core math that needs to be looked at: https://github.com/go-spatial/geom/blob/master/slippy/maths.go#L55 |
@ARolek can you release v0.21.0? I believe those issues have since been addressed. The newest image with tag |
@ARolek Unfortunately, I have zero experience with Go. With Python, yes, but that probably won't help much with this project. |
That would be great. If I can’t contribute a code fix, at least I can help with testing. Just let me know when it is ready. |
I just looked at the draft release and you're right! this was fixed by @gdey in the upcoming release. I believe there's still an issue with the geoprocessing operations for providers other than I will cut a release this week. |
@callsumzg & @Rub21 I just cut v0.21.0 which should address this issue. Can you please watch the release page and when your respective build architecture is ready give it a test? Please report back your results. |
@ARolek Thank you for the release. I tried v0.21.0, but the issue persists. The following works perfectly with v0.19.0, but not in later versions:
The newer releases >v0.19.0 work only with the following cache seed command:
|
The command is borked as of this commit. We are attempting to resolve tiles on a webmercator grid with wgs84 bound coordinates still, are we not? |
Thanks for the help testing. I have pinged @gdey to investigate to see if we can get tile seeding with bounds working near term as we work towards getting some of the other geom processing fixed. |
It’s not the geom processing, just how it is being utilized in the seed_purge in my opinion. Either we allow bounds to be either webmercator or wgs coordinates and determine the correct grid for either, or we fix resolving tiles to one grid but communicate the correct bounds to use. |
What is the SRID of that map? I'm trying to figure out the new code is not working. I believe @iwpnd is correct. We are currently defaulting to SRID 3857, which I believe is what it was before. |
@iwpnd @ARolek @callsumzg @iwpnd @callsumzg Does this work? It would mean that bounds wound be called: docker exec -it tegola /opt/tegola cache seed \
--config /opt/tegola_config/config.toml \
--map hoehenkurven_1700 \
--bounds "5.9,45.8,10.5,47.8" \
--wgs84 \
--min-zoom 10 \
--max-zoom 16 \
--overwrite Help is now: tegola cache seed --help
command to seed or purge tiles from the cache
Usage:
tegola cache seed [flags]
tegola cache seed [command]
Aliases:
seed, purge
Examples:
tegola cache seed --bounds lng,lat,lng,lat
Available Commands:
tile-list operate on a list of tile names separated by new lines
tile-name operate on a single tile formatted according to --format
Flags:
--bounds string lng/lat bounds to seed the cache with in the format: minx, miny, maxx, maxy (default "-180,-85.0511,180,85.0511")
--concurrency int the amount of concurrency to use. defaults to the number of CPUs on the machine (default 12)
-h, --help help for seed
--log-threshold int during seeding, only log tiles that take this number of milliseconds or longer to render (default all tiles)
--map string map name as defined in the config
--max-zoom uint max zoom to seed cache to (default 22)
--min-zoom uint min zoom to seed cache from
--overwrite overwrite the cache if a tile already exists (default false)
--wgs84 the grid system for bounds. This flag indicates that the grid is WGS 84; otherwise it's assumed to be in Pseudo-Mercator
Global Flags:
--config string path or http url to a config file, or "-" for stdin (default "config.toml")
--log-level string set log level to: TRACE, DEBUG, INFO, WARN or ERROR (default "INFO")
--logger string set logger to: standard, zap - default: standard (default "standard")
Use "tegola cache seed [command] --help" for more information about a command. |
This code has landed in the
I'm going to close this issue, but please re-open if you're still having issues. |
I tried to docker pull the "edge" image, but somehow it does not work (or i am just not getting it...): i execute:
... i get this:
I tried to check if i pulled the correct image from dockerhub, so i did the following:
This SHA is not the same then the one from @ARolek URL:
What am I missing? |
I' sorry, after code review it was decided that the default was wrong and that it should be So you should be able to run it without specifying a flag. You should be able to run it via: docker exec -it tegola /opt/tegola cache seed \
--config /opt/tegola_config/config.toml \
--map hoehenkurven_1700 \
--bounds "5.9,45.8,10.5,47.8" \
--min-zoom 10 \
--max-zoom 16 \
--overwrite |
Without the specific flag, i get this and it still does not work yet.
Is it possible that the "edge" docker image does not include your code changes? |
Let me look that's weird. I tested this; i thought. I know the test case works i wonder if i messed up the command arg processing. |
Yes, I screwed up; I used the Supported Proj strings function from Proj, instead of the checking for the supported SRID's. I'm sorry, let me fix that. |
@callsumzg Here is a PR with the fix. #1027 I don't have caching setup on my test instance. So, I was not able to do a quick end to end test. If that's not hard for you do on this PR that would be great. |
@gdey Thanks! I just pulled your PR and built/started the docker container. The tiling command seems to work now, but when i try to access the tegola-GUI on my localhost, i just see the listing of a [.keep] file. That is very weird. But it is also late here, i give it another shot tomorrow. |
@callsumzg It sounds like when you built locally the UI didn't get embedded. Try using one of the artifacts on this Action: https://github.com/go-spatial/tegola/actions/runs/12659195670. |
@ARolek Thank you for the hint. I tried building it locally with the UI using the artifacts, but I've never done this before and unfortunately couldn't get it to work. I'll be happy to test it again once it's deployed on Docker Hub. However, I was able to briefly test the tiling process, and that seemed to work with @gdey's latest PR 1027, at least according to the stdout of my console: no errors anymore and the tiling process started. |
@callsumzg you can try the |
@callsumzg great news! I released version v0.21.2 yesterday which you can use if you want to pin your version for now. Keep us in the loop as you continue researching vector tile servers. Hopefully tegola will meet you needs. |
@callsumzg were you able to try the proof of concept solution in #668? The convo starts here: #668 (comment) |
I am trying to generate cache for tiles, but some are not being generated, without an error message.
It's not generating the files, and to not return issues, anything I should be looking at?
Thanks
The text was updated successfully, but these errors were encountered: