Skip to content

Commit 403c9c6

Browse files
romirdeslouie-tsai
authored andcommitted
adding emr cpu binding
Signed-off-by: louie-tsai <[email protected]>
1 parent 9974a9a commit 403c9c6

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

.cd/server/cpu_binding_emr.csv

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
model_id,input_length,output_length,world_size,data_type,num_allocated_cpu,binding_policy
2+
meta-llama/Llama-3.1-405B-Instruct,128,4096,8,bf16,24,0
3+
meta-llama/Llama-3.1-405B-Instruct,2048,2048,8,bf16,24,0
4+
meta-llama/Llama-3.1-405B-Instruct,4096,128,8,bf16,24,0
5+
meta-llama/Llama-3.1-70B-Instruct,128,4096,4,bf16,24,0
6+
meta-llama/Llama-3.1-70B-Instruct,2048,2048,4,bf16,24,0
7+
meta-llama/Llama-3.1-70B-Instruct,4096,128,4,bf16,24,0

0 commit comments

Comments
 (0)