Skip to content

Commit 9cf14eb

Browse files
OuadiElfaroukiggerganov
authored andcommitted
Fixing wrong VDR iq4nl value (llama/8812)
1 parent 8e39ee1 commit 9cf14eb

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

ggml/src/ggml-sycl/mmvq.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -902,7 +902,7 @@ static void mul_mat_vec_iq4_nl_q8_1_sycl(const void *vx, const void *vy,
902902
sycl::nd_range<3>(block_nums * block_dims, block_dims),
903903
[=](sycl::nd_item<3> item_ct1)
904904
[[intel::reqd_sub_group_size(WARP_SIZE)]] {
905-
mul_mat_vec_q_iq4_nl_q8_1<QK4_NL, QI4_NL, block_iq4_nl, 1>(
905+
mul_mat_vec_q_iq4_nl_q8_1<QK4_NL, QI4_NL, block_iq4_nl, 2>(
906906
vx, vy, dst, ncols, nrows, item_ct1);
907907
});
908908
});

0 commit comments

Comments
 (0)