Skip to content
@foundation-model-stack

Foundation Model Stack

IBM Research's home for incubating, advancing and upstreaming open source for foundation model development, training, tuning and inference.

Pinned Loading

  1. foundation-model-stack foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    Python 187 63

  2. fms-fsdp fms-fsdp Public

    🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

    Python 221 36

  3. fms-hf-tuning fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    Python 34 49

  4. fms-acceleration fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    Python 7 13

  5. fms-guardrails-orchestrator fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    Rust 6 24

  6. bamba bamba Public

    Train, tune, and infer Bamba model

    Python 84 13

Repositories

Showing 10 of 26 repositories
  • fm-training-estimator Public

    Estimate resources needed to train LLMs

    foundation-model-stack/fm-training-estimator’s past year of commit activity
    Python 12 Apache-2.0 8 3 1 Updated Feb 19, 2025
  • fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    foundation-model-stack/fms-hf-tuning’s past year of commit activity
    Python 34 Apache-2.0 49 29 (2 issues need help) 29 Updated Feb 19, 2025
  • multi-nic-cni Public
    foundation-model-stack/multi-nic-cni’s past year of commit activity
    Go 37 Apache-2.0 7 25 (1 issue needs help) 4 Updated Feb 18, 2025
  • fms-model-optimizer Public

    FMS Model Optimizer is a framework for developing reduced precision neural network models.

    foundation-model-stack/fms-model-optimizer’s past year of commit activity
    Python 13 Apache-2.0 9 7 (2 issues need help) 6 Updated Feb 17, 2025
  • fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    foundation-model-stack/fms-guardrails-orchestrator’s past year of commit activity
    Rust 6 Apache-2.0 24 30 (2 issues need help) 5 Updated Feb 17, 2025
  • fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    foundation-model-stack/fms-acceleration’s past year of commit activity
    Python 7 Apache-2.0 13 20 (11 issues need help) 2 Updated Feb 14, 2025
  • foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    foundation-model-stack/foundation-model-stack’s past year of commit activity
    Python 187 Apache-2.0 63 36 (4 issues need help) 39 Updated Feb 14, 2025
  • fastsafetensors Public

    High-performance safetensors model loader

    foundation-model-stack/fastsafetensors’s past year of commit activity
    Python 8 Apache-2.0 4 0 0 Updated Feb 13, 2025
  • vllm-detector-adapter Public

    Tiny adapter that runs on top of vllm and provides detector APIs

    foundation-model-stack/vllm-detector-adapter’s past year of commit activity
    Python 3 Apache-2.0 4 4 1 Updated Feb 13, 2025
  • aiu-fms-testing-utils Public

    Tests/Scripts for use with foundation-model-stack models running on AIU

    foundation-model-stack/aiu-fms-testing-utils’s past year of commit activity
    Python 1 3 0 3 Updated Feb 13, 2025
View all repositories

Top languages

Loading…

Most used topics

Loading…