Skip to content

MLPerf Mobile App v5.0

Latest
Latest
Compare
Choose a tag to compare
@anhappdev anhappdev released this 13 Mar 01:04
v5.0
d3d667f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Description

MLPerf Mobile Inference Benchmark is an open-source benchmark suite for measuring how fast mobile devices (e.g. phones, laptops) can run AI tasks. The benchmark is supported by the MLPerf Mobile App which currently supports Android and iOS. Please see the MLPerf Mobile Inference benchmark paper for a detailed description of the benchmarks along with the motivation and guiding principles behind the benchmark suite.

Release Notes

New Features

  • Download resources per task – Optimized resource management to improve performance and efficiency.
  • Auto-remove resources that failed checksum validation to ensure data integrity.

Bug fixes and other changes

  • Various UI layout fixes to enhance the user interface and usability.
  • Resolved security hotspots reported by Sonar Cloud to enhance app security.
  • Integrated CodeQL analysis for improved vulnerability detection.
  • Improved build validation by checking .pbtxt files during the build step.
  • Implemented a fallback mechanism to test single-backend APK when the unified-backend APK fails.

Full Changelog: v4.1...v5.0

Supported SOCs

Mediatek

  • Dimensity 9000 series (9000/9000+/9200/9200+/9300/9300+)
  • Dimensity 8000 series (8000/8020/8050/8100/8200)

Qualcomm

  • Snapdragon 8 Elite
  • Snapdragon 8 Gen 3
  • Snapdragon 8s Gen 3
  • Snapdragon 8 Gen 2
  • Snapdragon 7 Gen 3
  • Snapdragon 7s Gen 3
  • Snapdragon 4 Gen 2
  • Default fallback for all other Snapdragon Mobile Platforms

Samsung

  • Exynos 2400
  • Exynos 2300
  • Exynos 2200
  • Exynos 2100
  • Exynos 990

Google Pixel

  • Pixel 8 and Pixel 8 Pro (Tensor G3 SoC)
  • Pixel 7 and Pixel 7 Pro (Tensor G2 ScC)
  • Pixel 6 and Pixel 6 Pro (Tensor G1 ScC)

The MLPerf Mobile App will also run on a host of other devices via our default path, which uses TensorFlow Lite on Android devices.

Installation instructions

  1. Allow installation of unknown apps in Settings > Apps > Special Access.
  2. Download the MLPerf Mobile APK.
  3. Find the APK in 'Downloads' or file browser.
  4. Tap the APK file. Approve installation when prompted.
  5. Confirm 'Install'.
  6. Once installed, tap 'Open' to launch MLPerf Mobile.
# SHA256
2f7a0754f7405cac0cec856d838ce561f4007ebb4a6fb05cdb00cb4e3b5e7c0a  mlperfbench-v5.0-qsmgt.apk
Assets 3
Loading