Windows 11, RTX-4090, Gradio version and a request for more performant models for a 24GB card...it's unusable currently. #4
Description
nvcc --version reveals CUDA12.8 for me. (I also happen to have CUDA 12.1, 12.4, and 12.6 installed as well.)
Followed page install instructions, but had to also do these commands afterward to get it to work at all:
pip install sqlalchemy
pip uninstall torch torchvision torchaudio
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121
pip install protobuf
Then (with the help of Gemini), here is a App.py for using a Gradio page locally.
First install this:
pip install gradio
...Then you can run
python app.py
which is this code (place in your root folder for the app):
...but even lowered to 2048x2048 slider settings, it just sticks at 0% generation while taxing my RTX-4090 :-(