Add support for Float8ActivationInt4GroupwisePreshuffleTensor for fbgemm

[jerryzh168]

Stacked PRs:

• ->Add support for Float8ActivationInt4GroupwisePreshuffleTensor for fbgemm #2437
• Remove transpose_input from fbgemm configs #2422
• Add support for Int4GroupwisePreshuffleTensor for fbgemm #2421

---

Add support for Float8ActivationInt4GroupwisePreshuffleTensor for fbgemm

Summary:
Note: slice is not working yet, others are working

Test Plan:
python test/dtypes/test_float8_activation_int4_groupwise_preshuffle.py

Reviewers:

Subscribers:

Tasks:

Tags:

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/2437

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 13 New Failures, 1 Cancelled Job

As of commit 95856ed with merge base 5a50667 ():

NEW FAILURES - The following jobs have failed:

• PR Label Check / Check PR Labels (gh)
  Process completed with exit code 1.
• Run Float8 Tests / test (H100, linux.aws.h100, --pre torch torchvision torchaudio --index-url https://download.pytor... / linux-job (gh)
  RuntimeError: Command docker exec -t b667100979f55d1dae50ec60f8711269ece41786c1060df6e9babcece9cc5580 /exec failed with exit code 2
• Run Float8 Tests / test (SM-89, linux.g6.4xlarge.experimental.nvidia.gpu, --pre torch --index-url https://download.p... / linux-job (gh)
  RuntimeError: Command docker exec -t 2d04508599903cbc7c161292f7d4da7613a3a5f90d6b61207ca8a82898031cf8 /exec failed with exit code 2
• Run Regression Tests / test (CPU 2.5.1, linux.4xlarge, torch==2.5.1 --index-url https://download.pytorch.org/whl/cpu, cp... / linux-job (gh)
  RuntimeError: Command docker exec -t a9e8db25d471fb3b284d8a4fd7b525527374f05949df4587503ea04e1a4096b3 /exec failed with exit code 2
• Run Regression Tests / test (CPU 2.6, linux.4xlarge, torch==2.6.0 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  RuntimeError: Command docker exec -t 68b98c47fb5386a2605a8c10fb024941c710874f62c3c053bf2be7de8f48de73 /exec failed with exit code 2
• Run Regression Tests / test (CPU 2.7, linux.4xlarge, torch==2.7.0 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  RuntimeError: Command docker exec -t a94319595e0297cbac80f8bee569f2d7f4adedf551098e9ea15ba0e5209d4308 /exec failed with exit code 2
• Run Regression Tests / test (CUDA 2.5.1, linux.g5.12xlarge.nvidia.gpu, torch==2.5.1 --index-url https://download.pytorch... / linux-job (gh)
  RuntimeError: Command docker exec -t 99cb20b1d0ac25bffecdcd3bdd8d51067f1769957e550a4ed2182ea1bb8e0eab /exec failed with exit code 2
• Run Regression Tests / test (CUDA 2.6, linux.g5.12xlarge.nvidia.gpu, torch==2.6.0, cuda, 12.6) / linux-job (gh)
  RuntimeError: Command docker exec -t 7e62b8e4a0b9180ea295b9afad91ff232ddda96c8e3fb27db03e59a00aeb7ce5 /exec failed with exit code 2
• Run Regression Tests / test (CUDA 2.7, linux.g5.12xlarge.nvidia.gpu, torch==2.7.0, cuda, 12.6) / linux-job (gh)
  RuntimeError: Command docker exec -t 235a87bad3af051d6f05abd023c206ca85d4e125aca51769f8716f9411b2fa04 /exec failed with exit code 2
• Run Regression Tests / test-nightly (CPU Nightly, linux.4xlarge, --pre torch --index-url https://download.pytorch.org/wh... / linux-job (gh)
  RuntimeError: Command docker exec -t c0629d61da6c503e35b4bd515a07761f9f9a2016f953a0b186a28c3a9c89781e /exec failed with exit code 2
• Run Regression Tests / test-nightly (CUDA Nightly, linux.g5.12xlarge.nvidia.gpu, --pre torch --index-url https://downloa... / linux-job (gh)
  RuntimeError: Command docker exec -t 62f7ef8fb067e1d5230f805307b87c7282e93c8e3f23d2243f199fed93953479 /exec failed with exit code 2
• Run TorchAO Experimental Tests / test-cpu-ops (macos-14) (gh)
  Process completed with exit code 2.
• Run TorchAO Experimental Tests / test-mps-ops (macos-m1-stable) (gh)
  Process completed with exit code 127.

CANCELLED JOB - The following job was cancelled. Please retry:

• Run TorchAO Experimental Tests / test-cpu-ops (linux.arm64.2xlarge) (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.