Skip to content

Conversation

@Jiang-Stan
Copy link
Collaborator

@Jiang-Stan Jiang-Stan commented Dec 21, 2022

  • Backend: virtual
  • W: Symmetric
    • ResNet18: MSE Observer
    • MobilenetV2: MinMax Observer
    • DeiT: MinMax Observer
  • A: layerwise 8bit, MinMax Observer, Symmetric
  • Eval num: 5000
Model configs weight granularity top1 top5 reported top1(from Adaround paper)
ResNet18 float - 69.86 89.4
ResNet18 4w8f layerwise 20.16 40.12 23.99
ResNet18 4w8f w/ BC layerwise 38.04 62.44 38.87
ResNet18 4w8f channelwise 53.86 76.02 -
ResNet18 4w8f w/ BC channelwise 59.60 82.96 -
DeiT float - 72.76 91.12 -
DeiT 8w8f channelwise 71.52 90.76 -
DeiT 8w8f w/ BC channelwise 71.58 90.42 -
DeiT 4w8f channelwise 64.18 86.42 -
DeiT 4w8f w/ BC channelwise 64.68 86.82 -
Model configs weight qscheme feature qscheme top1 top5
MobileNetV2 float - - 72.60 90.10
MobileNetV2 8w8f per-tensor-symmetric per-tensor-symmetric 67.56 87.44
MobileNetV2 8w8f w/ BC per-tensor-symmetric per-tensor-symmetric 70.10 88.98
MobileNetV2 8w8f per-tensor-symmetric per-tensor-affine 68.86 88.46
MobileNetV2 8w8f w/ BC per-tensor-symmetric per-tensor-affine 71.32 89.96
MobileNetV2 8w8f per-channel-symmetric per-tensor-symmetric 70.50 89.50
MobileNetV2 8w8f w/ BC per-channel-symmetric per-tensor-symmetric 70.58 89.44
MobileNetV2 8w8f per-channel-symmetric per-tensor-affine 71.44 89.64
MobileNetV2 8w8f w/ BC per-channel-symmetric per-tensor-affine 72.1 89.82

@Jiang-Stan Jiang-Stan force-pushed the add_bias_correction branch 2 times, most recently from 08c3ebf to 42cefff Compare December 23, 2022 06:53
@Jiang-Stan Jiang-Stan changed the title Test bias correction Add bias correction Dec 23, 2022
@Jiang-Stan Jiang-Stan requested a review from PeiqinSun December 23, 2022 06:59
@hych2020
Copy link
Collaborator

hych2020 commented Jan 3, 2023

加个mobilenetv2的bias correction结果(8w8f)

@Jiang-Stan Jiang-Stan force-pushed the add_bias_correction branch from 42cefff to fd322c8 Compare January 3, 2023 08:11
add bias correction

rectify

inprogressing

resnet18 ok

resnet18 ok

deit ok

deit ok

black

rebase

black

support non-fixed input

black
@Jiang-Stan Jiang-Stan force-pushed the add_bias_correction branch from fd322c8 to e15c4a6 Compare January 3, 2023 10:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants