Using DTensor to handle local num_heads change while TP is applied#3465

svekars merged 5 commits intopytorch:mainpytorch/tutorials:mainfrom

wwwjn:tp_tutorial_2wwwjn/tutorials:tp_tutorial_2Copy head branch name to clipboard