Skip to content

Commit

Permalink
Fix typos
Browse files Browse the repository at this point in the history
  • Loading branch information
warner-benjamin committed Aug 3, 2022
1 parent 419fc2d commit 4965981
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 6 deletions.
6 changes: 3 additions & 3 deletions docs/callback.progresize.html
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@
<div class="text_cell_render border-box-sizing rendered_html">
<p><a href="/callback.progresize.html#ProgressiveResize"><code>ProgressiveResize</code></a> is inspired by MosaicML’s <a href="https://docs.mosaicml.com/en/stable/method_cards/progressive_resizing.html">Progressive Resizing algorithm for Composer</a> which in turn was inspired by <a href="https://github.com/fastai/fastbook/blob/780b76bef3127ce5b64f8230fce60e915a7e0735/07_sizing_and_tta.ipynb">fastai’s</a> manual progressive resizing.</p>
<p><img src="/images/progressive_resizing.png" alt="progressive resizing illustrated"></p>
<p>Progressive Resizing decreases model training time by training on smaller images then gradually increasing to the full image size. This allows training on more samples for the same compute budget, often leading to higher performance than training on full sized images.</p>
<p>Progressive Resizing decreases model training time by training on smaller images then gradually increasing to the full image size. This allows training on more samples for the same compute budget, often leading to higher performance then training on full sized images.</p>

</div>
</div>
Expand Down Expand Up @@ -228,7 +228,7 @@ <h2 id="Example">Example<a class="anchor-link" href="#Example"> </a></h2>
<div class="cell border-box-sizing text_cell rendered"><div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p>In this example, a ResNet50 is trained for 20 &amp; 25 epochs on Imagenette at an image size of 224 pixels on a SageMaker Studio Lab Tesla T4 instance. Due to the short training run, <code>start</code> and <code>final</code> are set to 0.2 and 0.8, respectively.</p>
<p>Despite increasing the image size early relative to the default hyperparamaters, <a href="/callback.progresize.html#ProgressiveResize"><code>ProgressiveResize</code></a> yields significant training time savings compared to training at full size. At a similar compute budget of roughly 14 minutes progressive resizing results with 88.8% accuracy compared to 86.2% accuracy with full sized training.</p>
<p>Despite increasing the image size early relative to the default hyperparameters, <a href="/callback.progresize.html#ProgressiveResize"><code>ProgressiveResize</code></a> yields significant training time savings compared to training at full size. At a similar compute budget of roughly 14 minutes progressive resizing results with 87.8% accuracy compared to 86.2% accuracy with full sized training.</p>
<table>
<thead><tr>
<th style="text-align:left">Mode</th>
Expand Down Expand Up @@ -260,7 +260,7 @@ <h2 id="Example">Example<a class="anchor-link" href="#Example"> </a></h2>
<td style="text-align:left">Progressive Batch</td>
<td style="text-align:center">25</td>
<td style="text-align:center">13.9</td>
<td style="text-align:center">88.8%</td>
<td style="text-align:center">87.8%</td>
</tr>
</tbody>
</table>
Expand Down
6 changes: 3 additions & 3 deletions nbs/callback.progresize.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@
"\n",
"![progressive resizing illustrated](images/progressive_resizing.png)\n",
"\n",
"Progressive Resizing decreases model training time by training on smaller images then gradually increasing to the full image size. This allows training on more samples for the same compute budget, often leading to higher performance than training on full sized images."
"Progressive Resizing decreases model training time by training on smaller images then gradually increasing to the full image size. This allows training on more samples for the same compute budget, often leading to higher performance then training on full sized images."
]
},
{
Expand Down Expand Up @@ -603,14 +603,14 @@
"source": [
"In this example, a ResNet50 is trained for 20 & 25 epochs on Imagenette at an image size of 224 pixels on a SageMaker Studio Lab Tesla T4 instance. Due to the short training run, `start` and `final` are set to 0.2 and 0.8, respectively.\n",
"\n",
"Despite increasing the image size early relative to the default hyperparamaters, `ProgressiveResize` yields significant training time savings compared to training at full size. At a similar compute budget of roughly 14 minutes progressive resizing results with 88.8% accuracy compared to 86.2% accuracy with full sized training.\n",
"Despite increasing the image size early relative to the default hyperparameters, `ProgressiveResize` yields significant training time savings compared to training at full size. At a similar compute budget of roughly 14 minutes progressive resizing results with 87.8% accuracy compared to 86.2% accuracy with full sized training.\n",
"\n",
"| Mode | Epochs | Time (Mins) | Accuracy |\n",
"|:----------------- |:------:|:-----------:|:--------:|\n",
"| Full Size | 20 | 14.3 | 86.2% |\n",
"| Progressive Batch | 20 | 11.5 | 85.8% |\n",
"| Progressive Epoch | 20 | 10.5 | 85.6% |\n",
"| Progressive Batch | 25 | 13.9 | 88.8% |"
"| Progressive Batch | 25 | 13.9 | 87.8% |"
]
},
{
Expand Down

0 comments on commit 4965981

Please sign in to comment.