Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Crashed while downloading kinetics #5372

Open
ChystovaK opened this issue Jan 10, 2025 · 0 comments
Open

[BUG] Crashed while downloading kinetics #5372

ChystovaK opened this issue Jan 10, 2025 · 0 comments
Labels
bug Bug fixes

Comments

@ChystovaK
Copy link

Describe the problem

I tried to download Kinetics-700-2020 dataset, but only for specific classes ('petting cat', 'petting animal (not cat)', 'vacuuming floor'). Two video files were downloaded but the program crashed later on because of a key error 'clay pottery making'

Code to reproduce issue

import fiftyone.zoo as foz
dataset = foz.load_zoo_dataset(
"kinetics-700-2020",
classes=['petting cat', 'petting animal (not cat)', 'vacuuming floor']
)

System information

  • Linux Ubuntu 22.04.4 LTS
  • Python 3.10
  • FiftyOne version 1.2.0
  • FiftyOne installed from pip

Other info/logs

Traceback (most recent call last):
File "", line 1, in
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/zoo/datasets/init.py", line 335, in load_zoo_dataset
info, dataset_dir = download_zoo_dataset(
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/zoo/datasets/init.py", line 215, in download_zoo_dataset
info = zoo_dataset.download_and_prepare(
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/zoo/datasets/init.py", line 1306, in download_and_prepare
) = self._download_and_prepare(split_dir, scratch_dir, split)
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/zoo/datasets/base.py", line 2282, in _download_and_prepare
num_samples, classes, downloaded = fouk.download_kinetics_split(
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/utils/kinetics.py", line 102, in download_kinetics_split
manager.download(download_config, downloader)
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/utils/kinetics.py", line 129, in download
self.download_partial_split(config, downloader)
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/utils/kinetics.py", line 134, in download_partial_split
self._download_entire_classes(config, downloader)
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/utils/kinetics.py", line 142, in _download_entire_classes
incomplete_classes = self.info.get_incomplete_classes()
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/utils/kinetics.py", line 575, in get_incomplete_classes
existing_ids = self._classwise_existing_sample_ids[c]
KeyError: 'clay pottery making'

dataset = foz.load_zoo_dataset(
...
... "kinetics-700-2020",
... classes=['petting cat', 'petting animal (not cat)', 'vacuuming floor'])
Downloading split 'train' to '/home/k.chystova/fiftyone/kinetics-700-2020/train' if necessary
Traceback (most recent call last):
File "", line 1, in
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/zoo/datasets/init.py", line 335, in load_zoo_dataset
info, dataset_dir = download_zoo_dataset(
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/zoo/datasets/init.py", line 215, in download_zoo_dataset
info = zoo_dataset.download_and_prepare(
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/zoo/datasets/init.py", line 1306, in download_and_prepare
) = self._download_and_prepare(split_dir, scratch_dir, split)
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/zoo/datasets/base.py", line 2282, in _download_and_prepare
num_samples, classes, downloaded = fouk.download_kinetics_split(
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/utils/kinetics.py", line 102, in download_kinetics_split
manager.download(download_config, downloader)
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/utils/kinetics.py", line 129, in download
self.download_partial_split(config, downloader)
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/utils/kinetics.py", line 134, in download_partial_split
self._download_entire_classes(config, downloader)
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/utils/kinetics.py", line 142, in _download_entire_classes
incomplete_classes = self.info.get_incomplete_classes()
File "/home/k.chystova/fifty_venv/lib/python3.10/site-packages/fiftyone/utils/kinetics.py", line 575, in get_incomplete_classes
existing_ids = self._classwise_existing_sample_ids[c]
KeyError: 'clay pottery making'

Willingness to contribute

The FiftyOne Community encourages bug fix contributions. Would you or another
member of your organization be willing to contribute a fix for this bug to the
FiftyOne codebase?

  • [] Yes. I can contribute a fix for this bug independently
  • [X ] Yes. I would be willing to contribute a fix for this bug with guidance
    from the FiftyOne community
  • [] No. I cannot contribute a bug fix at this time
@ChystovaK ChystovaK added the bug Bug fixes label Jan 10, 2025
@ChystovaK ChystovaK changed the title [BUG] [BUG] Crashed while downloading kinetics Jan 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bug fixes
Projects
None yet
Development

No branches or pull requests

1 participant