Code

support camb device using dlinfer#28

Code

Draft

wanfengcxz wants to merge 14 commits intomainDeepLink-org/lmdeploy:mainfrom camb/dlinferDeepLink-org/lmdeploy:camb/dlinferCopy head branch name to clipboard

Commits

Commits on Nov 8, 2024

• [camb] support internlm2 using dlinfer

  wanfengcxz

  committed
  b43f3b1

  Copy full SHA for b43f3b1

• change

  

  root

  authored and

  wanfengcxz

  committed
  dc2d9e8

  Copy full SHA for dc2d9e8

• change

  

  wanfengcxz

  authored and

  wanfengcxz

  committed
  0010dcf

  Copy full SHA for 0010dcf

• [camb] add silu_and_mul

  wanfengcxz

  committed
  119781f

  Copy full SHA for 119781f

• refactor for multiple devices in dlinfer(camb)

  wanfengcxz

  committed
  fdfacb9

  Copy full SHA for fdfacb9

• refactor and remove pos_id in apply_rotary_emb

  wanfengcxz

  committed
  a4a31d3

  Copy full SHA for a4a31d3

• refactor(camb)

  wanfengcxz

  committed
  1fae399

  Copy full SHA for 1fae399

• support camb graph

  

  root

  authored and

  wanfengcxz

  committed
  3f8f2a7

  Copy full SHA for 3f8f2a7

• refactor(camb)

  wanfengcxz

  committed
  96d36a4

  Copy full SHA for 96d36a4

• change camb graph

  

  root

  authored and

  wanfengcxz

  committed
  fec0eb8

  Copy full SHA for fec0eb8

• change graph

  

  root

  authored and

  wanfengcxz

  committed
  b2e7df2

  Copy full SHA for b2e7df2

• support server test(camb)

  wanfengcxz

  committed
  48b91da

  Copy full SHA for 48b91da

• change

  wanfengcxz

  committed
  268d724

  Copy full SHA for 268d724

Commits on Nov 15, 2024

• support camb graph with dummpy input

  wanfengcxz

  committed
  68a72e3

  Copy full SHA for 68a72e3