So begins the Python Computational Geomorphology Software System!
- Use the GEE Code Editor and
gee_scripts
to grab ya imagery - Use
make_jpges.py
to turn ya Earth Engine files into jpgs for Doodler. - Use Dash Doodler to label/segment ya imagery
- Use Segmentation Gym to segment unlabeled imagery
Perhaps the only time in history someone is putting a figure from an in-prep NSF proposal so as to say "Please, if you can do this instead of me, go ahead"
I have been compiling a guide to Python-based landscape analysis on my Notion site, but with the advent of PyCoGSS, I anticipate moving the guide to this repo.
This is a guide for accessing Doodleverse software in Dartmouth's HPC environment. Please consult the wikis of the Doodleverse software for help there.
You have to make an ssh tunnel to copy and paste the address that Doodler spits out:
- ssh to andes or polaris
- Do the instructions on the Github to install dash doolder. When installing Dash Doodler navigate to the
dash_doodler
directory withcd dash_doodler
. Don’t worry about conda version errors. It will take a while. - activate your
dashdoodler
environment you created when installing Doodler - Run
python doodler.py
after navigating to the directory withcd dash_doodler
- You have to make an ssh tunnel to copy and paste the address that Doodler spits out. Note the address: it should be
http://127.0.0.1:8050/
The server is 127.0.0.1 and the port is 8050.
- Open another Terminal. Do
ssh
like you normally would but add flags-NfL
(note capitals). The general syntax for ssh tunneling is:
ssh -NfL [port]:[server]:[port] [your net id]@[linux machine address]
so replicate the following but with your username
- Copy and paste or type the http address into your web browser of choice. It should pop us as Doodler!!
- Use the
utils/gen_images_and_labels.py
script in Doodler (in your Doodler environment!) to generate the labels and images folders that you can point segmentation gym to. It helps if you put all your results that you want to use in one directory. A dumb thing is that you have to click into the directory when the prompt comes up (rather than selecting the folder). - Log into Discovery
ssh [id]@discovery7.dartmouth.edu
- Start an interactive session on Discovery. when you type
k80:4
that means you are using 4 GPUs at once 😎 you do training in super-speed!! But if you aren’t doing any operations it could time out because those resources are sometimes high in demand.
srun -p gpuq --gres=gpu:k80:4 --pty /bin/bash
- Making sure you installed Segmentation Gym according to the GitHub, activate your
gym
environment
conda activate gym
- Follow the Segmentation Gym wiki and have fun!