Code

Mixed Precision and Resource Envs#65

Code

Open

dlwh wants to merge 30 commits intodevstanford-crfm/haliax:devfrom jampstanford-crfm/haliax:jampCopy head branch name to clipboard

+1,040-217

Commits

Commits on Jan 23, 2024

• wip compute_context.py

  dlwh

  committed
  e2f71bc

  Copy full SHA for e2f71bc

Commits on Jan 25, 2024

• wip

  dlwh

  committed
  1b7eb81

  Copy full SHA for 1b7eb81

Commits on Jan 26, 2024

• ok, current functionality still works

  dlwh

  committed
  8f3e2c8

  Copy full SHA for 8f3e2c8

Commits on Jan 27, 2024

• towards DTypeish

  dlwh

  committed
  b7798d9

  Copy full SHA for b7798d9

• use semantic dtypes in linear

  dlwh

  committed
  da76dd5

  Copy full SHA for da76dd5

• use semantic dtypes in nn layers where it makes sense

  dlwh

  committed
  d39c6e0

  Copy full SHA for d39c6e0

• rename compute_context->resource_env, mv mesh to end

  dlwh

  committed
  e5e20c7

  Copy full SHA for e5e20c7

• typo

  dlwh

  committed
  260627d

  Copy full SHA for 260627d

• fix imports

  dlwh

  committed
  2ea2878

  Copy full SHA for 2ea2878

• fix ordering of mesh again

  dlwh

  committed
  a652e9c

  Copy full SHA for a652e9c

Commits on Jan 28, 2024

• add a short mixed precision doc for new mixed precision stuff

  dlwh

  committed
  195b587

  Copy full SHA for 195b587

• fix some docs

  dlwh

  committed
  2972e31

  Copy full SHA for 2972e31

Commits on Jan 29, 2024

• wat

  dlwh

  committed
  acdece2

  Copy full SHA for acdece2

• cleanup the new ResourceEnv stuff, fix a few bugs related to threading

  dlwh

  committed
  8e7d4f3

  Copy full SHA for 8e7d4f3

Commits on Jan 31, 2024

• wip

  dlwh

  committed
  3bcd67b

  Copy full SHA for 3bcd67b

• rename to mixed-precision.md

  dlwh

  committed
  3a203ba

  Copy full SHA for 3a203ba

• modernizing the partitioning module

  dlwh

  committed
  3c886ea

  Copy full SHA for 3c886ea

• switch to not having a default jmp.policy

  dlwh

  committed
  cd6592a

  Copy full SHA for cd6592a

• wip

  dlwh

  committed
  637428d

  Copy full SHA for 637428d

• fix named_jit without a mesh

  dlwh

  committed
  21aa128

  Copy full SHA for 21aa128

• fixes for levanter migration

  dlwh

  committed
  e4dcf3a

  Copy full SHA for e4dcf3a

• use our own dtypelike when we need to

  dlwh

  committed
  a0dc5a8

  Copy full SHA for a0dc5a8

• str for ResourceEnv

  dlwh

  committed
  3a69dcf

  Copy full SHA for 3a69dcf

• add strenum

  dlwh

  committed
  9c86449

  Copy full SHA for 9c86449

Commits on Feb 1, 2024

• missed a function

  dlwh

  committed
  db00171

  Copy full SHA for db00171

• wip docs for ResourceEnv

  dlwh

  committed
  3b6deb0

  Copy full SHA for 3b6deb0

• fix tests with multiple devices

  dlwh

  committed
  e89b983

  Copy full SHA for e89b983

• use a mesh when we have it in shard

  dlwh

  committed
  cd83402

  Copy full SHA for cd83402

• factor out some loss functions

  dlwh

  committed
  5cf4d71

  Copy full SHA for 5cf4d71

Commits on Feb 6, 2024

• Merge remote-tracking branch 'origin/dev' into jamp

  dlwh

  committed
  bcc2ce0

  Copy full SHA for bcc2ce0