Commit 4ee9d00
authored
[AWQ] Remove Code to obtain Merge Node (#3621)
### Changes
Remove Code to obtain Merge Node. Instead directly get the merge node
from the match nodes.
### Reason for changes
`Matmul1 -> mul -> Matmul2` pattern was causing an error when the
precision for `Matmul1` was FP32. The first matmul node was not being
found in `all_weight_params`.
According to my experiments, in both the conditions for patterns
`MatMul->Multiply->MatMul` and `Act->MatMul or Act->Multiply->MatMul` we
essentially do the same task of obtaining the first node from the
matched list of nodes.
### Tests
Category | Job | Status | Job Number | Notes
-- | -- | -- | -- | --
GH Examples | Examples | Pass| <a
href="https://github.com/openvinotoolkit/nncf/actions/runs/16972167283">382</a>
|
GH WC | Weights Compression | Pass | <a
href="https://github.com/openvinotoolkit/nncf/actions/runs/16972170869">137</a>
|
Perplexity Evaluation:
Compression Settings: Ratio=0.8, Hessian Input Activation, backup_mode
NONE
Evaluation Settings: limit 10(evaluate with only 10 samples in lm_eval)
Model: microsoft/Phi-3-mini-128k-instruct
| Branch | AWQ | Accuracy |
|--------|--------|--------|
Develop Branch | No | 11.157 |
Develop Branch | Yes | 11.0583 |
After Change | Yes | 11.0583 |
### Related tickets
1723261 parent 803b498 commit 4ee9d00
1 file changed
+1
-9
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
365 | 365 | | |
366 | 366 | | |
367 | 367 | | |
368 | | - | |
369 | | - | |
370 | | - | |
371 | | - | |
372 | | - | |
373 | | - | |
374 | | - | |
375 | | - | |
376 | | - | |
| 368 | + | |
377 | 369 | | |
378 | 370 | | |
379 | 371 | | |
| |||
0 commit comments