Skip to content

Commit

Permalink
Update distributed_tuning.ipynb (#437)
Browse files Browse the repository at this point in the history
* Update distributed_tuning.ipynb

Link to Colab tutorial for Gemma distributed finetuning

* Update distributed_tuning.ipynb

Update Colab link
  • Loading branch information
windmaple authored May 26, 2024
1 parent 695b0fd commit 249a811
Showing 1 changed file with 6 additions and 2 deletions.
8 changes: 6 additions & 2 deletions site/en/gemma/docs/distributed_tuning.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,10 @@
"<table class=\"tfo-notebook-buttons\" align=\"left\">\n",
" <td>\n",
" <a target=\"_blank\" href=\"https://ai.google.dev/gemma/docs/distributed_tuning\"><img src=\"https://ai.google.dev/static/site-assets/images/docs/notebook-site-button.png\" height=\"32\" width=\"32\" />View on ai.google.dev</a>\n",
" </td>\n",
" <td>\n",
" <a target=\"_blank\" href=\"https://colab.research.google.com/github/googlecolab/colabtools/blob/main/notebooks/Gemma_Distributed_Fine_tuning_on_TPU.ipynb\"><img src=\"https://www.tensorflow.org/images/colab_logo_32px.png\" />Run in Google Colab</a>\n",
" </td>\n",
" <td>\n",
" <a target=\"_blank\" href=\"https://www.kaggle.com/code/nilaychauhan/keras-gemma-distributed-finetuning-and-inference\"><img src=\"https://www.kaggle.com/static/images/logos/kaggle-logo-transparent-300.png\" height=\"32\" width=\"70\"/>Run in Kaggle</a>\n",
" </td>\n",
Expand Down Expand Up @@ -89,8 +93,8 @@
"### Notes on TPU environments\n",
"\n",
"Google has 3 products that provide TPUs:\n",
"* [Colab](https://colab.sandbox.google.com/) provides TPU v2, which is not sufficient for this tutorial.\n",
"* [Kaggle](https://www.kaggle.com/) offers TPU v3 for free and they work for this tutorial.\n",
"* [Colab](https://colab.sandbox.google.com/) provides TPU v2 for free, which is sufficient for this tutorial.\n",
"* [Kaggle](https://www.kaggle.com/) offers TPU v3 for free and they also work for this tutorial.\n",
"* [Cloud TPU](https://cloud.google.com/tpu?hl=en) offers TPU v3 and newer generations. One way to set it up is:\n",
" 1. Create a new [TPU VM](https://cloud.google.com/tpu/docs/managing-tpus-tpu-vm#tpu-vms)\n",
" 2. Set up [SSH port forwarding](https://cloud.google.com/solutions/connecting-securely#port-forwarding-over-ssh) for your intended Jupyter server port\n",
Expand Down

0 comments on commit 249a811

Please sign in to comment.