Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Eval bug: Segmentation fault on image encoder quantization #11683

Open
agNihit928 opened this issue Feb 5, 2025 · 0 comments
Open

Eval bug: Segmentation fault on image encoder quantization #11683

agNihit928 opened this issue Feb 5, 2025 · 0 comments

Comments

@agNihit928
Copy link

Name and Version

version: 4644 (d774ab3)
built with cc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0 for x86_64-linux-gnu

Operating systems

Linux

GGML backends

CUDA

Hardware

Intel CPU + T4

Models

Qwen2-VL

Problem description & steps to reproduce

Getting a segmentation fault when trying the newly updated quantization support the image encoder with this output on debugging:

First Bad Commit

This is new commit happened today only, which presented a newly added feature which is causing the bug

Relevant log output

Thread 1 "llama-llava-cli" received signal SIGSEGV, Segmentation fault.
0x00007ffff7cf6720 in quantize_row_q8_0_ref ()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant