Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

is not a valid JSON file (done) & Clear Model Strange Behavior (Virus?) #148

Open
KLL535 opened this issue Feb 1, 2025 · 2 comments
Open

Comments

@KLL535
Copy link

KLL535 commented Feb 1, 2025

I want to use the model Mistral-Nemo-Instruct-2407-Q4_K_M.gguf

Download with LMStudio. There were no additional json files and everything works in LMStudio without them.

OSError: It looks like the config file at 'H:\LLM\lmstudio-community\Mistral-Nemo-Instruct-2407-GGUF\Mistral-Nemo-Instruct-2407-Q4_K_M.gguf' is not a valid JSON file.

What am I doing wrong?

Image

@heshengtao
Copy link
Owner

The GGUF format model requires a GGUF loader node, provided that the model is compatible with llama cpp. Additionally, I recall that LM Studio can convert the model to function with the OpenAI API. You might want to explore invoking it via the API, which could potentially be successful as well.

@KLL535
Copy link
Author

KLL535 commented Feb 1, 2025

Oh, it seems to work.
But I need the model to be cleared after use, but I couldn't find such an option.
Found a node:

Image

But it works very strangely: it constantly stops and in the terminal it tries to download, in my opinion, the entire Internet, a lot of packages require updating. Why?

What's wrong with this node, because you just need to unload the model from memory.
This is the first time I've encountered such behavior, when something tries to download right during the process of work, and even asks yes/no, although I don't need this update at all. What does this mean and will my comfy-ui break if I update everything, including torch, to completely incomprehensible versions?

Without the Clear Model node everything works, but slowly, because I don't have enough memory for 2 models.

It feels like it's Clear Model node trying to download packages randomly. Very strange. And who is this korina? And why is it needed in the process of unloading the model?
Image

Image

Additionally, this file node.exe goes online, I blocked its access because I don't know what it is:

Image

@KLL535 KLL535 changed the title is not a valid JSON file is not a valid JSON file (done) & How correctly Clear Model after use? Feb 1, 2025
@KLL535 KLL535 changed the title is not a valid JSON file (done) & How correctly Clear Model after use? is not a valid JSON file (done) & Clear Model Strange Behavior (Virus?) Feb 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants