You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I want to use the model Mistral-Nemo-Instruct-2407-Q4_K_M.gguf
Download with LMStudio. There were no additional json files and everything works in LMStudio without them.
OSError: It looks like the config file at 'H:\LLM\lmstudio-community\Mistral-Nemo-Instruct-2407-GGUF\Mistral-Nemo-Instruct-2407-Q4_K_M.gguf' is not a valid JSON file.
What am I doing wrong?
The text was updated successfully, but these errors were encountered:
The GGUF format model requires a GGUF loader node, provided that the model is compatible with llama cpp. Additionally, I recall that LM Studio can convert the model to function with the OpenAI API. You might want to explore invoking it via the API, which could potentially be successful as well.
Oh, it seems to work.
But I need the model to be cleared after use, but I couldn't find such an option.
Found a node:
But it works very strangely: it constantly stops and in the terminal it tries to download, in my opinion, the entire Internet, a lot of packages require updating. Why?
What's wrong with this node, because you just need to unload the model from memory.
This is the first time I've encountered such behavior, when something tries to download right during the process of work, and even asks yes/no, although I don't need this update at all. What does this mean and will my comfy-ui break if I update everything, including torch, to completely incomprehensible versions?
Without the Clear Model node everything works, but slowly, because I don't have enough memory for 2 models.
It feels like it's Clear Model node trying to download packages randomly. Very strange. And who is this korina? And why is it needed in the process of unloading the model?
Additionally, this file node.exe goes online, I blocked its access because I don't know what it is:
KLL535
changed the title
is not a valid JSON file
is not a valid JSON file (done) & How correctly Clear Model after use?
Feb 1, 2025
KLL535
changed the title
is not a valid JSON file (done) & How correctly Clear Model after use?
is not a valid JSON file (done) & Clear Model Strange Behavior (Virus?)
Feb 1, 2025
I want to use the model Mistral-Nemo-Instruct-2407-Q4_K_M.gguf
Download with LMStudio. There were no additional json files and everything works in LMStudio without them.
OSError: It looks like the config file at 'H:\LLM\lmstudio-community\Mistral-Nemo-Instruct-2407-GGUF\Mistral-Nemo-Instruct-2407-Q4_K_M.gguf' is not a valid JSON file.
What am I doing wrong?
The text was updated successfully, but these errors were encountered: