Files

books
courses
datasets
frameworks
- LLM
  - imgs
    - 01_diagram-llm-basics_aspect_ratio.png
    - Megatron-LM-tensor-parallel.png
    - kv-cache.png
    - model_parallel.png
    - overview-of-llm-powered-agents.png
  - continuous-batching.md
  - deepspeed-ulysses.md
  - eval-methods.md
  - finetune-survey.md
  - inference-methods.md
  - llama.cpp.md
  - llm-powered-automous-agents.md
  - lmql.md
  - numbers-every-llm-developer-should-known.md
  - tensorrt-llm.md
  - text-generation-inference.md
  - transformer-inference-arithmetic.md
  - vLLM.md
- XLA
- alpa
- controlnet
- coreml
- deepspeed
- fairscale
- hystrix
- kserve
- lightning
- lightseq
- megatron-lm
- numpy
- oneflow
- pytorch
- tensorflow
- triton-inference-server
- alpa.md
- bagua.md
- compile.md
- hotline-profiler.md
- megatron.md
- on-device.md
- patrick-star.md
- training-vs-inference.md
hardware
imgs
memory-efficiency
network-communication
operators
package-management
papers
python
storage
videos
.gitignore
README.md
concepts.md
cplusplus-concepts.md
map.md
time-event-log.md