You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am using a CDN to load the models, as shown in the code below.
I filtered the models in HuggingFace the way you recommend (text-generation, transformers.js) and put the id of the model I looked up. As I understand it, to change the model, I only need to change the model id.
However, I get an error for each of the below models.
Uncaught (in promise) TypeError: Cannot read properties of undefined (reading 'model')
HuggingFaceTB/SmolLM2-135M-Instruct
Xenova/codegen-350M-mono
...
Uncaught (in promise) Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Deserialize tensor model.layers.4.mlp.gate_proj.MatMul.weight_Q4 failed.Failed to load external data file ""model_q4f16.onnx_data"", error: Module.MountedFiles is not available.
onnx-community/Phi-3.5-mini-instruct-onnx-web
...
I'm ultimately saying that I don't know what model will be available.
Additionally, I was wondering if there is a way to know 'in advance' which 'dtype' and 'device' can be supported.
Question
I am using a CDN to load the models, as shown in the code below.
I filtered the models in HuggingFace the way you recommend (text-generation, transformers.js) and put the id of the model I looked up. As I understand it, to change the model, I only need to change the model id.
However, I get an error for each of the below models.
Uncaught (in promise) TypeError: Cannot read properties of undefined (reading 'model')
...
Uncaught (in promise) Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Deserialize tensor model.layers.4.mlp.gate_proj.MatMul.weight_Q4 failed.Failed to load external data file ""model_q4f16.onnx_data"", error: Module.MountedFiles is not available.
...
I'm ultimately saying that I don't know what model will be available.
Additionally, I was wondering if there is a way to know 'in advance' which 'dtype' and 'device' can be supported.
The text was updated successfully, but these errors were encountered: