LLAMA 3.1 NOT WORKING!
# support
m
Hello, me and other users are getting this error when using LLAMA 3.1 - 405B for our assistants: [WARN] Model request failed (attempt #1, reason: (The model
llama-3.1-405b-reasoning
does not exist or you do not have access to it.)) Please, fix this issue asap.
v
message has been deleted
@Madame I'm sorry to hear that you're experiencing issues with the LLAMA 3.1 - 405B model. It seems like there might be a problem with the model's availability or access permissions. To assist you better, could you please provide me with more details about how you are trying to access the model? Are you using a specific API call or platform feature? This information will help me understand the context and guide you accordingly.
You can continue this conversation by mentioning me in the message.
Got it. Tagging @User for additional help.
m
Using it directly from VAPI.
s
call_id pls
m
df643c48-95b3-4ccc-94e2-094e27c0b1bb
d9df7477-018f-465e-97f4-a04de669b492
s
Checking with Groq Team.
d
same issue, 1bdc2947-8967-468a-8ecc-4bdd88c75385 c80494bd-70aa-4652-bc86-af83dbc883a1
s
Yeah, currently this model is not available on our account. I am getting in touch with their team to add it.
Just confirmed with the Groq team, they will be prioritizing HW for the 70B and 8B parameter models only. So, for now, the 405B model won't be available.
d
did they say if/when they would be offering it?
s
Nope.
2 Views