Code

Save tensors in lower precision#273

Code

Merged

gsarti merged 16 commits intoinseq-team:maininseq-team/inseq:mainfrom LuukSuurmeijer:feature/score_precisionLuukSuurmeijer/inseq:feature/score_precisionCopy head branch name to clipboardJul 23, 2024

+171-24

Commits

Commits on May 10, 2024

• Save attribution tensors with a lower precision.

  Show description for 62298a2
  LuukSuurmeijer

  committed
  62298a2

  Copy full SHA for 62298a2

• Merge branch 'inseq-team:main' into feature/score_precision

  LuukSuurmeijer

  authored
  0e9828c

  Copy full SHA for 0e9828c

• Add support for device_map use (inseq-team#264)

  Show description for 5c7e10f
  

  gsarti

  authored and

  LuukSuurmeijer

  committed
  5c7e10f

  Copy full SHA for 5c7e10f

• Support Value Zeroing for non-eager attention types (inseq-team#267)

  

  gsarti

  authored and

  LuukSuurmeijer

  committed
  6133a50

  Copy full SHA for 6133a50

• Fix nans in attn, add pad if missing (inseq-team#269)

  

  gsarti

  authored and

  LuukSuurmeijer

  committed
  9168e39

  Copy full SHA for 9168e39

• Add transformers v4.40 models to config, update changelog

  

  gsarti

  authored and

  LuukSuurmeijer

  committed
  3c1627e

  Copy full SHA for 3c1627e

• run tests

  LuukSuurmeijer

  committed
  647c8b4

  Copy full SHA for 647c8b4

• Merge branch 'feature/score_precision' of github.com:LuukSuurmeijer/inseq into feature/score_precision

  LuukSuurmeijer

  committed
  96f9629

  Copy full SHA for 96f9629

Commits on May 11, 2024

• Minor fixes

  gsarti

  committed
  a682761

  Copy full SHA for a682761

Commits on Jul 18, 2024

• fixed json decode error

  LuukSuurmeijer

  committed
  56ed5c4

  Copy full SHA for 56ed5c4

Commits on Jul 23, 2024

• Merge remote-tracking branch 'origin' into feature/score_precision

  gsarti

  committed
  9389796

  Copy full SHA for 9389796

• Switched to torch-native float8_e4m3fn format

  gsarti

  committed
  38a3097

  Copy full SHA for 38a3097

• Fix style

  gsarti

  committed
  d90e064

  Copy full SHA for d90e064

• Fix reqs

  gsarti

  committed
  c3dfaff

  Copy full SHA for c3dfaff

• Fix safety

  gsarti

  committed
  5194db8

  Copy full SHA for 5194db8

• Add changelog

  gsarti

  committed
  189e968

  Copy full SHA for 189e968