You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
when I run Baichuan2-7B-base model ,meet the issue that "position_ids" is not defined. And I checked the code and did not find the declaration of position_ids in the code
pt-p26l37d2-worker-0 logs: File ''/root/home/AutoSmoothQuant/autosmoothquant/models/baichuan.py", line 146, in forward
pt-p26l37d2-worker-0 logs: query_states, key_states = apply_rotary_pos_emb(query_states, key_states, cos, sin, position_ids)
pt-p26l37d2-worker-0 logs: NameError: name 'position_ids' is not defined
The text was updated successfully, but these errors were encountered:
Sorry that the Baichuan model with RoPE might occurs to the issuse. I plan to fix this problem later next week. If you have figure out the problem, We would appreciate that you could contribute by making a PR.
when I run Baichuan2-7B-base model ,meet the issue that "position_ids" is not defined. And I checked the code and did not find the declaration of position_ids in the code
The text was updated successfully, but these errors were encountered: