Unauthorized access error with Mistral 7B in Next.js despite successful huggingface-cli login"

[diegosalloumpro]

Model description

"Could not locate ONNX file error when trying to load Mistral 7B in Next.js"
"Authentication issues with gated models in Next.js server environment"

Prerequisites

• The model is supported in Transformers (i.e., listed here)
• The model can be exported to ONNX with Optimum (i.e., listed here)

Additional information

No response

Your contribution

"Could not locate ONNX file error when trying to load Mistral 7B in Next.js"
"Authentication issues with gated models in Next.js server environment"

[xenova]

Hi there 👋 the huggingface-cli is for the python library to log in. For Transformers.js, you should instead set the HF_TOKEN environment variable. See here for more information: https://huggingface.co/docs/transformers.js/en/guides/private