Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Results are black images #2

Open
Oguzhanercan opened this issue Dec 20, 2024 · 3 comments
Open

Results are black images #2

Oguzhanercan opened this issue Dec 20, 2024 · 3 comments

Comments

@Oguzhanercan
Copy link

Hi, thanks for your work. When I try to edit images with your settings with your examples (I only add a line, which is enable_sequential_offload) for both flux and SD3, I get a warning which is "invalid value encountered in cast images = (images*255).round().astype("uint8") and resulting images are black. Do you have any idea about how to fix or debug this?

@fallenshock
Copy link
Owner

Hi there, thanks for taking interest in our work.
I tried to reproduce your issue by commenting out # pipe = pipe.to(device) and adding pipe.enable_sequential_cpu_offload() for both flux and sd3. I don't seem to run into any issues on my part.
Try to comment out the line that sends to GPU and see if it helps? (line 43 in run_script.py).

@Oguzhanercan
Copy link
Author

I did but same problem, maybe the reason comes from the differences between some libraries. Can you share the output of "pip list" with me?

@matankleiner
Copy link
Collaborator

Our pip list:

Package                  Version
------------------------ --------------------
absl-py                  1.4.0
accelerate               0.33.0
aiohttp                  3.9.3
aiosignal                1.3.1
annotated-types          0.6.0
anykeystore              0.2
apex                     0.9.10.dev0
appdirs                  1.4.4
apturl                   0.5.2
asttokens                2.2.1
async-timeout            4.0.3
attr                     0.3.2
attrs                    23.2.0
audioread                3.0.0
backcall                 0.2.0
bcrypt                   3.1.7
beautifulsoup4           4.12.2
blinker                  1.4
blis                     0.7.11
Brlapi                   0.7.0
cachetools               5.3.0
catalogue                2.0.10
certifi                  2022.12.7
cffi                     1.15.1
chardet                  3.0.4
charset-normalizer       2.1.1
clarabel                 0.6.0
click                    8.1.3
clip                     0.2.0
clip-text-decoder        1.4.4
cloudpathlib             0.16.0
cmake                    3.25.0
colorama                 0.4.3
comm                     0.1.2
command-not-found        0.3
conda                    4.3.16
confection               0.1.4
contextlib2              21.6.0
contourpy                1.0.7
cryptacular              1.6.2
cryptography             2.8
cuda-python              12.1.0
cupshelpers              1.0
cvxpy                    1.4.2
cycler                   0.11.0
cymem                    2.0.8
Cython                   0.29.34
datasets                 2.18.0
dbus-python              1.2.16
debugpy                  1.6.6
decorator                5.1.1
defer                    1.0.6
defusedxml               0.7.1
diffusers                0.30.0
dill                     0.3.8
distlib                  0.3.6
distro                   1.4.0
distro-info              0.23+ubuntu1.1
docker-pycreds           0.4.0
duplicity                0.8.12.0
ecos                     2.0.13
einops                   0.6.1
entrypoints              0.3
et-xmlfile               1.1.0
ete3                     3.1.3
evaluate                 0.4.1
executing                1.2.0
fasteners                0.14.1
ffmpeg                   1.4
filelock                 3.9.0
fonttools                4.39.4
frozenlist               1.4.1
fsspec                   2024.6.1
ftfy                     6.1.1
future                   0.18.2
gdown                    4.7.1
gitdb                    4.0.10
GitPython                3.1.31
google-auth              2.18.1
google-auth-oauthlib     1.0.0
greenlet                 3.0.3
grpcio                   1.54.2
h5py                     3.10.0
httplib2                 0.14.0
huggingface-hub          0.24.5
hupper                   1.12.1
idna                     3.4
imageio                  2.30.0
importlib-metadata       6.0.0
importlib-resources      5.12.0
ipykernel                6.20.2
ipython                  8.9.0
ipywidgets               8.0.5
jedi                     0.18.2
Jinja2                   3.1.2
joblib                   1.2.0
jupyter_client           8.0.2
jupyter_core             5.2.0
jupyterlab-widgets       3.0.6
keyring                  18.0.1
kiwisolver               1.4.4
langcodes                3.3.0
language-selector        0.1
launchpadlib             1.10.13
lazr.restfulclient       0.14.2
lazr.uri                 1.0.3
lazy_loader              0.2
librosa                  0.9.2
lightning-utilities      0.11.0
lit                      15.0.7
llvmlite                 0.40.1rc1
lmdb                     1.4.0
lockfile                 0.12.2
loguru                   0.7.0
louis                    3.12.0
lpips                    0.1.4
macaroonbakery           1.3.1
Mako                     1.1.0
Markdown                 3.4.3
MarkupSafe               2.1.2
matplotlib               3.7.1
matplotlib-inline        0.1.6
ml-collections           0.1.1
monotonic                1.5
mpmath                   1.2.1
multidict                6.0.5
multiprocess             0.70.16
murmurhash               1.0.10
natsort                  8.2.0
nest-asyncio             1.5.6
netifaces                0.10.4
networkx                 3.0
numba                    0.57.0
numpy                    1.24.1
nvidia-cublas-cu11       11.10.3.66
nvidia-cuda-cupti-cu11   11.7.101
nvidia-cuda-nvrtc-cu11   11.7.99
nvidia-cuda-runtime-cu11 11.7.99
nvidia-cudnn-cu11        8.5.0.96
nvidia-cufft-cu11        10.9.0.58
nvidia-curand-cu11       10.2.10.91
nvidia-cusolver-cu11     11.4.0.1
nvidia-cusparse-cu11     11.7.4.91
nvidia-nccl-cu11         2.14.3
nvidia-nvtx-cu11         11.7.91
oauthlib                 3.1.0
olefile                  0.46
opencv-python            4.6.0.66
openpyxl                 3.1.0
osqp                     0.6.5
packaging                23.1
pandas                   2.0.2
paramiko                 2.6.0
parso                    0.8.3
PasteDeploy              3.1.0
pathtools                0.1.2
pbkdf2                   1.3
pexpect                  4.6.0
pickleshare              0.7.5
Pillow                   9.3.0
pip                      24.3.1
plaster                  1.1.2
plaster-pastedeploy      1.0.1
platformdirs             2.6.2
pooch                    1.7.0
preshed                  3.0.9
progressbar              2.5
promise                  2.3
prompt-toolkit           3.0.36
protobuf                 4.23.2
psutil                   5.9.5
pure-eval                0.2.2
pyarrow                  15.0.2
pyarrow-hotfix           0.6
pyasn1                   0.5.0
pyasn1-modules           0.3.0
pybind11                 2.11.1
pycairo                  1.16.2
pycosat                  0.6.6
pycparser                2.21
pycups                   1.9.73
pydantic                 2.6.4
pydantic_core            2.16.3
Pygments                 2.14.0
PyGObject                3.36.0
PyJWT                    1.7.1
pymacaroons              0.13.0
PyNaCl                   1.3.0
pyparsing                3.0.9
PyQt5                    5.15.7
PyQt5-Qt5                5.15.2
PyQt5-sip                12.11.0
pyramid                  2.0.2
pyramid-mailer           0.15.1
pyRFC3339                1.1
PySocks                  1.7.1
python-apt               2.0.1+ubuntu0.20.4.1
python-dateutil          2.8.2
python-debian            0.1.36+ubuntu1.1
python3-openid           3.2.0
pytorch-lightning        2.2.1
pytorch-pretrained-vit   0.0.7
pytz                     2023.3
PyWavelets               1.4.1
pyxdg                    0.26
PyYAML                   6.0
pyzmq                    25.0.0
qdldl                    0.1.7.post0
regex                    2019.8.19
reportlab                3.5.34
repoze.sendmail          4.4.1
requests                 2.28.1
requests-oauthlib        1.3.1
requests-unixsocket      0.2.0
resampy                  0.4.2
responses                0.18.0
rsa                      4.9
ruamel.yaml              0.18.5
ruamel.yaml.clib         0.2.8
safetensors              0.4.5
scikit-image             0.20.0
scikit-learn             1.2.2
scipy                    1.9.1
scs                      3.2.4.post1
seaborn                  0.12.2
SecretStorage            2.3.1
sentencepiece            0.2.0
sentry-sdk               1.24.0
setproctitle             1.3.2
setuptools               45.2.0
shortuuid                1.0.11
simplejson               3.16.0
six                      1.16.0
smart-open               6.4.0
smmap                    5.0.0
soundfile                0.12.1
soupsieve                2.4.1
spacy                    3.7.4
spacy-legacy             3.0.12
spacy-loggers            1.0.5
SQLAlchemy               2.0.31
srsly                    2.4.8
ssh-import-id            5.10
stack-data               0.6.2
sympy                    1.11.1
systemd-python           234
tensorboard              2.13.0
tensorboard-data-server  0.7.0
thinc                    8.2.3
threadpoolctl            3.1.0
tifffile                 2023.4.12
timm                     0.4.12
tokenizers               0.19.1
torch                    2.0.1
torch-fidelity           0.3.0
torchaudio               2.0.2
torchdata                0.7.1
torchmetrics             0.11.4
torchvision              0.15.2
tornado                  6.2
tqdm                     4.65.0
traitlets                5.9.0
transaction              4.0
transformers             4.44.2
translationstring        1.4
triton                   2.0.0
typer                    0.9.0
typing_extensions        4.8.0
tzdata                   2023.3
ubuntu-drivers-common    0.0.0
ubuntu-pro-client        8001
ufw                      0.36
unattended-upgrades      0.1
urllib3                  1.26.13
usb-creator              0.3.7
velruse                  1.1.1
venusian                 3.1.0
virtualenv               20.17.1
wadllib                  1.3.3
wandb                    0.15.3
wasabi                   1.1.2
wcwidth                  0.2.6
weasel                   0.3.4
WebOb                    1.8.7
Werkzeug                 2.3.4
wget                     3.2
wheel                    0.34.2
widgetsnbextension       4.0.6
WTForms                  3.1.2
wtforms-recaptcha        0.3.2
xkit                     0.0.0
xxhash                   3.4.1
yacs                     0.1.8
yarl                     1.9.4
zipp                     3.15.0
zope.deprecation         5.0
zope.interface           6.4.post2
zope.sqlalchemy          3.1

Note that it also includes many unnecessary packages.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants