torch-llm.md

torch.compile

The initial call to torch.compile is slow because the model needs to be compiled. Subsequent calls to the compiled model are much faster because it doesn’t need to compile again.