ValueError: Unrecognized configuration class

#5
by simonschoe - opened

@sosahi Trying to follow your deployment example, but I get the following error:

ValueError: Unrecognized configuration class <class 'transformers_modules.model.llama_bidirectional_model.LlamaBidirectionalConfig'> for this kind of AutoModel: AutoModel.

I am using the current version of transformers. Any idea what could be the culprit here?

i'm also running into the same error, with current version of transformer. btw, its working with transformers==4.47.1

NVIDIA org

@simonschoe hello, please use transformers==4.47.1. The model card mentions about the specific transformers' version. thanks.

@simonschoe hello, please use transformers==4.47.1. The model card mentions about the specific transformers' version. thanks.

So the model is not supported using a higher minor versions of transformers (like the current 4.57.1)? It would be great if you could support the model on other versions as well.

In #11 we have extended support for more transformers versions. From 4.44 and including version 5

nvidia-oliver-holworthy changed discussion status to closed

Sign up or log in to comment