No problem with environmental configuration, but there is a problem with the server or downloading

[Matrixxxxxxxx]

environment install:
########################################
(omniparse-venv) ljh@spark:/data/ljh/omniparse$ pip install -e .
Obtaining file:///data/ljh/omniparse
Installing build dependencies ... done
Checking if build backend supports build_editable ... done
Getting requirements to build editable ... done
Preparing editable metadata (pyproject.toml) ... done
Requirement already satisfied: Pillow<11.0.0,>=10.1.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (10.2.0)
Requirement already satisfied: art<7.0,>=6.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (6.2)
Requirement already satisfied: beautifulsoup4<5.0.0,>=4.12.3 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (4.12.3)
Requirement already satisfied: fastapi<0.112.0,>=0.111.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (0.111.1)
Requirement already satisfied: filetype<2.0.0,>=1.2.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (1.2.0)
Collecting flash-attn<3.0.0,>=2.5.9 (from omniparse==0.0.1)
Using cached flash_attn-2.6.3-cp310-cp310-linux_x86_64.whl
Requirement already satisfied: ftfy<7.0.0,>=6.1.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (6.2.0)
Requirement already satisfied: gradio<5.0.0,>=4.37.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (4.39.0)
Requirement already satisfied: grpcio<2.0.0,>=1.63.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (1.65.1)
Requirement already satisfied: html2text<2025.0.0,>=2024.2.26 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (2024.2.26)
Requirement already satisfied: img2pdf<0.6.0,>=0.5.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (0.5.1)
Requirement already satisfied: marker-pdf<0.3.0,>=0.2.16 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (0.2.16)
Requirement already satisfied: matplotlib<4.0.0,>=3.9.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (3.9.1)
Requirement already satisfied: moviepy<2.0.0,>=1.0.3 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (1.0.3)
Requirement already satisfied: nltk<4.0.0,>=3.8.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (3.8.1)
Requirement already satisfied: numpy<2.0.0,>=1.26.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (1.26.3)
Requirement already satisfied: openai-whisper<20231118,>=20231117 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (20231117)
Requirement already satisfied: pdftext<0.4.0,>=0.3.10 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (0.3.10)
Requirement already satisfied: pydantic<3.0.0,>=2.4.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (2.8.2)
Requirement already satisfied: pydantic-settings<3.0.0,>=2.0.3 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (2.3.4)
Requirement already satisfied: pypdfium2<5.0.0,>=4.30.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (4.30.0)
Requirement already satisfied: python-dotenv<2.0.0,>=1.0.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (1.0.1)
Requirement already satisfied: pytube<16.0.0,>=15.0.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (15.0.0)
Requirement already satisfied: rapidfuzz<4.0.0,>=3.8.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (3.9.4)
Requirement already satisfied: regex<2025.0.0,>=2024.4.28 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (2024.7.24)
Requirement already satisfied: scikit-learn<2.0.0,>=1.3.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (1.4.2)
Requirement already satisfied: selenium<5.0.0,>=4.21.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (4.23.1)
Requirement already satisfied: surya-ocr<0.5.0,>=0.4.3 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (0.4.15)
Requirement already satisfied: tabulate<0.10.0,>=0.9.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (0.9.0)
Requirement already satisfied: texify<0.2.0,>=0.1.8 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (0.1.10)
Requirement already satisfied: timm<2.0.0,>=1.0.7 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (1.0.7)
Requirement already satisfied: torch<3.0.0,>=2.2.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (2.3.1)
Requirement already satisfied: tqdm<5.0.0,>=4.66.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (4.66.4)
Requirement already satisfied: transformers<5.0.0,>=4.41.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (4.43.3)
Requirement already satisfied: uvicorn<0.30.0,>=0.29.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (0.29.0)
Requirement already satisfied: webdriver-manager<5.0.0,>=4.0.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from omniparse==0.0.1) (4.0.2)
Requirement already satisfied: soupsieve>1.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from beautifulsoup4<5.0.0,>=4.12.3->omniparse==0.0.1) (2.5)
Requirement already satisfied: starlette<0.38.0,>=0.37.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (0.37.2)
Requirement already satisfied: typing-extensions>=4.8.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (4.9.0)
Requirement already satisfied: fastapi-cli>=0.0.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (0.0.4)
Requirement already satisfied: httpx>=0.23.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (0.27.0)
Requirement already satisfied: jinja2>=2.11.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (3.1.3)
Requirement already satisfied: python-multipart>=0.0.7 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (0.0.9)
Requirement already satisfied: email_validator>=2.0.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (2.2.0)
Requirement already satisfied: einops in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from flash-attn<3.0.0,>=2.5.9->omniparse==0.0.1) (0.8.0)
Requirement already satisfied: wcwidth<0.3.0,>=0.2.12 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from ftfy<7.0.0,>=6.1.1->omniparse==0.0.1) (0.2.13)
Requirement already satisfied: aiofiles<24.0,>=22.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (23.2.1)
Requirement already satisfied: anyio<5.0,>=3.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (4.4.0)
Requirement already satisfied: ffmpy in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (0.3.2)
Requirement already satisfied: gradio-client==1.1.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (1.1.1)
Requirement already satisfied: huggingface-hub>=0.19.3 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (0.24.2)
Requirement already satisfied: importlib-resources<7.0,>=1.3 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (6.4.0)
Requirement already satisfied: markupsafe~=2.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (2.1.5)
Requirement already satisfied: orjson~=3.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (3.10.6)
Requirement already satisfied: packaging in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (24.1)
Requirement already satisfied: pandas<3.0,>=1.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (2.2.2)
Requirement already satisfied: pydub in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (0.25.1)
Requirement already satisfied: pyyaml<7.0,>=5.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (6.0.1)
Requirement already satisfied: ruff>=0.2.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (0.5.5)
Requirement already satisfied: semantic-version~=2.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (2.10.0)
Requirement already satisfied: tomlkit==0.12.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (0.12.0)
Requirement already satisfied: typer<1.0,>=0.12 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (0.12.3)
Requirement already satisfied: urllib3~=2.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (2.2.2)
Requirement already satisfied: fsspec in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio-client==1.1.1->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (2024.2.0)
Requirement already satisfied: websockets<12.0,>=10.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from gradio-client==1.1.1->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (11.0.3)
Requirement already satisfied: pikepdf in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from img2pdf<0.6.0,>=0.5.1->omniparse==0.0.1) (9.1.0)
Requirement already satisfied: contourpy>=1.0.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from matplotlib<4.0.0,>=3.9.0->omniparse==0.0.1) (1.2.1)
Requirement already satisfied: cycler>=0.10 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from matplotlib<4.0.0,>=3.9.0->omniparse==0.0.1) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from matplotlib<4.0.0,>=3.9.0->omniparse==0.0.1) (4.53.1)
Requirement already satisfied: kiwisolver>=1.3.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from matplotlib<4.0.0,>=3.9.0->omniparse==0.0.1) (1.4.5)
Requirement already satisfied: pyparsing>=2.3.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from matplotlib<4.0.0,>=3.9.0->omniparse==0.0.1) (3.1.2)
Requirement already satisfied: python-dateutil>=2.7 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from matplotlib<4.0.0,>=3.9.0->omniparse==0.0.1) (2.9.0.post0)
Requirement already satisfied: decorator<5.0,>=4.0.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from moviepy<2.0.0,>=1.0.3->omniparse==0.0.1) (4.4.2)
Requirement already satisfied: requests<3.0,>=2.8.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from moviepy<2.0.0,>=1.0.3->omniparse==0.0.1) (2.32.3)
Requirement already satisfied: proglog<=1.0.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from moviepy<2.0.0,>=1.0.3->omniparse==0.0.1) (0.1.10)
Requirement already satisfied: imageio<3.0,>=2.5 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from moviepy<2.0.0,>=1.0.3->omniparse==0.0.1) (2.34.2)
Requirement already satisfied: imageio-ffmpeg>=0.2.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from moviepy<2.0.0,>=1.0.3->omniparse==0.0.1) (0.5.1)
Requirement already satisfied: click in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from nltk<4.0.0,>=3.8.1->omniparse==0.0.1) (8.1.7)
Requirement already satisfied: joblib in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from nltk<4.0.0,>=3.8.1->omniparse==0.0.1) (1.4.2)
Requirement already satisfied: triton<3,>=2.0.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from openai-whisper<20231118,>=20231117->omniparse==0.0.1) (2.3.1)
Requirement already satisfied: numba in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from openai-whisper<20231118,>=20231117->omniparse==0.0.1) (0.60.0)
Requirement already satisfied: more-itertools in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from openai-whisper<20231118,>=20231117->omniparse==0.0.1) (10.3.0)
Requirement already satisfied: tiktoken in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from openai-whisper<20231118,>=20231117->omniparse==0.0.1) (0.7.0)
Requirement already satisfied: annotated-types>=0.4.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.4.2->omniparse==0.0.1) (0.7.0)
Requirement already satisfied: pydantic-core==2.20.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.4.2->omniparse==0.0.1) (2.20.1)
Requirement already satisfied: scipy>=1.6.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from scikit-learn<2.0.0,>=1.3.2->omniparse==0.0.1) (1.14.0)
Requirement already satisfied: threadpoolctl>=2.0.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from scikit-learn<2.0.0,>=1.3.2->omniparse==0.0.1) (3.5.0)
Requirement already satisfied: trio~=0.17 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from selenium<5.0.0,>=4.21.0->omniparse==0.0.1) (0.26.0)
Requirement already satisfied: trio-websocket~=0.9 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from selenium<5.0.0,>=4.21.0->omniparse==0.0.1) (0.11.1)
Requirement already satisfied: certifi>=2021.10.8 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from selenium<5.0.0,>=4.21.0->omniparse==0.0.1) (2024.7.4)
Requirement already satisfied: websocket-client~=1.8 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from selenium<5.0.0,>=4.21.0->omniparse==0.0.1) (1.8.0)
Requirement already satisfied: opencv-python<5.0.0.0,>=4.9.0.80 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from surya-ocr<0.5.0,>=0.4.3->omniparse==0.0.1) (4.10.0.84)
Requirement already satisfied: torchvision in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from timm<2.0.0,>=1.0.7->omniparse==0.0.1) (0.18.1)
Requirement already satisfied: safetensors in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from timm<2.0.0,>=1.0.7->omniparse==0.0.1) (0.4.3)
Requirement already satisfied: filelock in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (3.13.1)
Requirement already satisfied: sympy in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (1.12)
Requirement already satisfied: networkx in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (3.2.1)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (12.1.105)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (12.1.105)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (12.1.105)
Requirement already satisfied: nvidia-cudnn-cu12==8.9.2.26 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (8.9.2.26)
Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (12.1.3.1)
Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (11.0.2.54)
Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (10.3.2.106)
Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (11.4.5.107)
Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (12.1.0.106)
Requirement already satisfied: nvidia-nccl-cu12==2.20.5 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (2.20.5)
Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from torch<3.0.0,>=2.2.2->omniparse==0.0.1) (12.1.105)
Requirement already satisfied: nvidia-nvjitlink-cu12 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch<3.0.0,>=2.2.2->omniparse==0.0.1) (12.4.99)
Requirement already satisfied: tokenizers<0.20,>=0.19 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from transformers<5.0.0,>=4.41.2->omniparse==0.0.1) (0.19.1)
Requirement already satisfied: h11>=0.8 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from uvicorn<0.30.0,>=0.29.0->omniparse==0.0.1) (0.14.0)
Requirement already satisfied: idna>=2.8 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from anyio<5.0,>=3.0->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (3.7)
Requirement already satisfied: sniffio>=1.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from anyio<5.0,>=3.0->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (1.3.1)
Requirement already satisfied: exceptiongroup>=1.0.2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from anyio<5.0,>=3.0->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (1.2.2)
Requirement already satisfied: dnspython>=2.0.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from email_validator>=2.0.0->fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (2.6.1)
Requirement already satisfied: httpcore==1.* in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from httpx>=0.23.0->fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (1.0.5)
Requirement already satisfied: setuptools in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from imageio-ffmpeg>=0.2.0->moviepy<2.0.0,>=1.0.3->omniparse==0.0.1) (71.0.4)
Requirement already satisfied: pytz>=2020.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from pandas<3.0,>=1.0->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (2024.1)
Requirement already satisfied: tzdata>=2022.7 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from pandas<3.0,>=1.0->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (2024.1)
Requirement already satisfied: six>=1.5 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from python-dateutil>=2.7->matplotlib<4.0.0,>=3.9.0->omniparse==0.0.1) (1.16.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from requests<3.0,>=2.8.1->moviepy<2.0.0,>=1.0.3->omniparse==0.0.1) (3.3.2)
Requirement already satisfied: attrs>=23.2.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from trio~=0.17->selenium<5.0.0,>=4.21.0->omniparse==0.0.1) (23.2.0)
Requirement already satisfied: sortedcontainers in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from trio~=0.17->selenium<5.0.0,>=4.21.0->omniparse==0.0.1) (2.4.0)
Requirement already satisfied: outcome in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from trio~=0.17->selenium<5.0.0,>=4.21.0->omniparse==0.0.1) (1.3.0.post0)
Requirement already satisfied: wsproto>=0.14 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from trio-websocket~=0.9->selenium<5.0.0,>=4.21.0->omniparse==0.0.1) (1.2.0)
Requirement already satisfied: shellingham>=1.3.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from typer<1.0,>=0.12->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (1.5.4)
Requirement already satisfied: rich>=10.11.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from typer<1.0,>=0.12->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (13.7.1)
Requirement already satisfied: pysocks!=1.5.7,<2.0,>=1.5.6 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from urllib3[socks]<3,>=1.26->selenium<5.0.0,>=4.21.0->omniparse==0.0.1) (1.7.1)
Requirement already satisfied: httptools>=0.5.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from uvicorn[standard]>=0.12.0->fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (0.6.1)
Requirement already satisfied: uvloop!=0.15.0,!=0.15.1,>=0.14.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from uvicorn[standard]>=0.12.0->fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (0.19.0)
Requirement already satisfied: watchfiles>=0.13 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from uvicorn[standard]>=0.12.0->fastapi<0.112.0,>=0.111.0->omniparse==0.0.1) (0.22.0)
Requirement already satisfied: llvmlite<0.44,>=0.43.0dev0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from numba->openai-whisper<20231118,>=20231117->omniparse==0.0.1) (0.43.0)
Requirement already satisfied: Deprecated in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from pikepdf->img2pdf<0.6.0,>=0.5.1->omniparse==0.0.1) (1.2.14)
Requirement already satisfied: lxml>=4.8 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from pikepdf->img2pdf<0.6.0,>=0.5.1->omniparse==0.0.1) (5.2.2)
Requirement already satisfied: mpmath>=0.19 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from sympy->torch<3.0.0,>=2.2.2->omniparse==0.0.1) (1.3.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from rich>=10.11.0->typer<1.0,>=0.12->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from rich>=10.11.0->typer<1.0,>=0.12->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (2.18.0)
Requirement already satisfied: wrapt<2,>=1.10 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from Deprecated->pikepdf->img2pdf<0.6.0,>=0.5.1->omniparse==0.0.1) (1.16.0)
Requirement already satisfied: mdurl~=0.1 in /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages (from markdown-it-py>=2.2.0->rich>=10.11.0->typer<1.0,>=0.12->gradio<5.0.0,>=4.37.1->omniparse==0.0.1) (0.1.2)
Building wheels for collected packages: omniparse
Building editable for omniparse (pyproject.toml) ... done
Created wheel for omniparse: filename=omniparse-0.0.1-py3-none-any.whl size=18537 sha256=075d15af35c4bcd3f3119cc286874d1db6fa52fcb30db94bca50e7fcc1487822
Stored in directory: /tmp/pip-ephem-wheel-cache-9_zrt72j/wheels/4d/bf/49/c70b3fef697930865303d6211c4d66673d6821c9f2b6eefd7e
Successfully built omniparse
Installing collected packages: flash-attn, omniparse
Attempting uninstall: flash-attn
Found existing installation: flash-attn 2.5.7
Uninstalling flash-attn-2.5.7:
Successfully uninstalled flash-attn-2.5.7
Attempting uninstall: omniparse
Found existing installation: omniparse 0.0.1
Uninstalling omniparse-0.0.1:
Successfully uninstalled omniparse-0.0.1
Successfully installed flash-attn-2.6.3 omniparse-0.0.1
#####################################################################

but, when I try to download models(for doc, web...), there will be a error:
####################################################################
(omniparse-venv) ljh@spark:/data/ljh/omniparse$ python server.py --host 0.0.0.0 --port 8000 --documents --media --web
Traceback (most recent call last):
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1586, in _get_module
return importlib.import_module("." + module_name, self.name)
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/models/mbart/modeling_mbart.py", line 52, in
from ...modeling_flash_attention_utils import _flash_attention_forward
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/modeling_flash_attention_utils.py", line 27, in
from flash_attn.bert_padding import index_first_axis, pad_input, unpad_input # noqa
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/flash_attn/init.py", line 3, in
from flash_attn.flash_attn_interface import (
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/flash_attn/flash_attn_interface.py", line 10, in
import flash_attn_2_cuda as flash_attn_cuda
ImportError: /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZNK3c105Error4whatEv

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/data/ljh/omniparse/server.py", line 6, in
from omniparse import load_omnimodel
File "/data/ljh/omniparse/omniparse/init.py", line 27, in
from marker.models import load_all_models
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/marker/models.py", line 10, in
from surya.model.recognition.model import load_model as load_recognition_model
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/surya/model/recognition/model.py", line 14, in
from surya.model.recognition.decoder import MBartMoE
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/surya/model/recognition/decoder.py", line 4, in
from transformers import MBartForCausalLM, MBartConfig
File "", line 1075, in _handle_fromlist
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1577, in getattr
value = getattr(module, name)
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1576, in getattr
module = self._get_module(self._class_to_module[name])
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1588, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.models.mbart.modeling_mbart because of the following error (look up to see its traceback):
/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZNK3c105Error4whatEv
######################################################################

when I try download.py for document or web, there will be a same error like above:
######################################################################
(omniparse-venv) ljh@spark:/data/ljh/omniparse$ python download.py --documents --media --web
Traceback (most recent call last):
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1586, in _get_module
return importlib.import_module("." + module_name, self.name)
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/models/mbart/modeling_mbart.py", line 52, in
from ...modeling_flash_attention_utils import _flash_attention_forward
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/modeling_flash_attention_utils.py", line 27, in
from flash_attn.bert_padding import index_first_axis, pad_input, unpad_input # noqa
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/flash_attn/init.py", line 3, in
from flash_attn.flash_attn_interface import (
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/flash_attn/flash_attn_interface.py", line 10, in
import flash_attn_2_cuda as flash_attn_cuda
ImportError: /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZNK3c105Error4whatEv

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/data/ljh/omniparse/download.py", line 5, in
from omniparse import load_omnimodel
File "/data/ljh/omniparse/omniparse/init.py", line 27, in
from marker.models import load_all_models
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/marker/models.py", line 10, in
from surya.model.recognition.model import load_model as load_recognition_model
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/surya/model/recognition/model.py", line 14, in
from surya.model.recognition.decoder import MBartMoE
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/surya/model/recognition/decoder.py", line 4, in
from transformers import MBartForCausalLM, MBartConfig
File "", line 1075, in _handle_fromlist
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1577, in getattr
value = getattr(module, name)
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1576, in getattr
module = self._get_module(self._class_to_module[name])
File "/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1588, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.models.mbart.modeling_mbart because of the following error (look up to see its traceback):
/data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZNK3c105Error4whatEv
##################################################################

troch+CUDA version:
##################################################################
omniparse-venv) ljh@spark:/data/ljh/omniparse$ nvcc -V
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Tue_Jun_13_19:16:58_PDT_2023
Cuda compilation tools, release 12.2, V12.2.91
Build cuda_12.2.r12.2/compiler.32965470_0
(omniparse-venv) ljh@spark:/data/ljh/omniparse$ pip show torch
Name: torch
Version: 2.3.1
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email: [email protected]
License: BSD-3
Location: /data/ljh/anaconda3/envs/omniparse-venv/lib/python3.10/site-packages
##################################################################