Questions about the time-consuming of Mac & iOS

[YYX666660]

I want to ask a question about the time-consuming of opus_decode after compiling on the Mac & iOS platform.
Arm neon inference is in the existing code (vec_neon.h). I measured the time consumption of running opus_demo(with compiling --enable_deep_plc) on a mac m3pro laptop for the opus_decode function(only happens when losing the packet), and the average time consumption is about 0.3ms, while on an iOS device (iphone12pro max) the average time is 2.5ms, and the peak time is 7ms (only 1.5ms for without enable_deep_plc). Both are on the Release mode.
I've already used FARGAN. I add the -march=armv8.2-a+dotprod option.

Has anybody ever measure the time of using dnn network online?
Here I post my cmake compile configure shell. I didn't modify the CMakeLists.txt.
For mac m3pro:

SRC_DIR="../opus-1.5.2_cmake"
BUILD_DIR="./build"
LIB_DIR="./output"

printf "=== start config arm64 ===\n"
printf "cur dir: ${PWD}\n"

rm -rf $BUILD_DIR
cmake ${SRC_DIR} -B ${BUILD_DIR} \
      -DOPUS_DEEP_PLC=ON \
      -DOPUS_BUILD_PROGRAMS=ON \
      -DCMAKE_OSX_ARCHITECTURES="x86_64;arm64" \
      -DCMAKE_OSX_DEPLOYMENT_TARGET="10.15"\
      -DCMAKE_XCODE_ATTRIBUTE_ONLY_ACTIVE_ARCH=NO \
      -DCMAKE_BUILD_TYPE=Release \
cmake --build ${BUILD_DIR} --target opus

For iOS:

SRC_DIR="./opus-1.5.2"
BUILD_DIR="./build"
LIB_DIR="./libs_ios_load"

printf "cur dir: ${PWD}\n"
rm -rf $BUILD_DIR
cmake ${SRC_DIR} -B ${BUILD_DIR} \
      -DOPUS_DEEP_PLC=ON \
      -DCMAKE_BUILD_TYPE=Release \
      -DCMAKE_SYSTEM_NAME=iOS \
      -DCMAKE_OSX_ARCHITECTURES="arm64" \
      -DCMAKE_XCODE_ATTRIBUTE_ONLY_ACTIVE_ARCH=NO \
      -DCMAKE_C_FLAGS="-march=armv8.2-a+dotprod" \
      -DCMAKE_CXX_FLAGS="-march=armv8.2-a+dotprod" \
cmake --build ${BUILD_DIR} --target opus

Is my compile option wrong? Why is my opus_decode time consumption so high? Is "-march=armv8.2-a+dotprod" option the default in CMakeLists.txt?

[YYX666660]

Hi @jmvalin :)
I've checked the flags on the iOS device platform. I'm sure that I was running Neon/dotprod code instead of scalar code. When I was running on the xcode, I added some "printf" to check the status. And the results are as follows:

The average time consumption of opus_decode is about 2ms (iphone12pro max) and the peak time is 4.5-5ms. This duration is still long.
I tried to decrease PLC_BUF_SIZE ((CONT_VECTORS+10)*FRAME_SIZE) to PLC_BUF_SIZE ((CONT_VECTORS+5)*FRAME_SIZE) to decrease the while loop in lpcnet_plc_conceal. It could help a little, but the duration hasn't decreased significantly.

So what can I do for vec_neon.h?