Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Installation issues #5

Open
DeevanshuGoyal opened this issue Feb 19, 2025 · 0 comments
Open

Installation issues #5

DeevanshuGoyal opened this issue Feb 19, 2025 · 0 comments

Comments

@DeevanshuGoyal
Copy link

Hello,

After setting up the environment for scgpt and cloning this repository, I am still unable to access the files due to an issue with flash-attn. Here's the error message:

---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
Cell In[7], line 1
----> 1 import scgpt_spatial

File ~/Deevanshu/scGPT-spatial/scgpt_spatial/__init__.py:6
      3 import sys
      5 logger = logging.getLogger("scGPT-spatial")
----> 6 from . import model, tokenizer, utils, tasks
      7 from .data_collator import DataCollator
      8 from .data_sampler import SubsetsBatchSampler

File ~/Deevanshu/scGPT-spatial/scgpt_spatial/model/__init__.py:1
----> 1 from .model import (
      2     TransformerModel,
      3     FlashTransformerEncoderLayer,
      4     GeneEncoder,
      5     AdversarialDiscriminator,
      6     MVCDecoder,
      7 )
      8 from .grad_reverse import *

File ~/Deevanshu/scGPT-spatial/scgpt_spatial/model/model.py:13
     11 from torch.nn import TransformerEncoder, TransformerEncoderLayer
     12 from torch.distributions import Bernoulli
---> 13 from flash_attn.flash_attention import FlashMHA
     14 from tqdm import trange
     16 from .grad_reverse import grad_reverse

File ~/miniconda3/envs/dg_scgpt/lib/python3.10/site-packages/flash_attn/__init__.py:3
      1 __version__ = "2.7.4.post1"
----> 3 from flash_attn.flash_attn_interface import (
      4     flash_attn_func,
      5     flash_attn_kvpacked_func,
      6     flash_attn_qkvpacked_func,
      7     flash_attn_varlen_func,
      8     flash_attn_varlen_kvpacked_func,
      9     flash_attn_varlen_qkvpacked_func,
     10     flash_attn_with_kvcache,
     11 )

File ~/miniconda3/envs/dg_scgpt/lib/python3.10/site-packages/flash_attn/flash_attn_interface.py:15
     13     from .flash_attn_triton_amd import interface_fa as flash_attn_gpu
     14 else:
---> 15     import flash_attn_2_cuda as flash_attn_gpu
     17 # isort: on
     19 def maybe_contiguous(x):

ImportError: /home/cardiaccrew2/miniconda3/envs/dg_scgpt/lib/python3.10/site-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZNK3c105Error4whatEv

There are open issue threads on the flash-attn git regarding the issue with flash_attn_2_cuda. How can I use the files with this issue? Any kind of help with be appreciated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant