We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent e7768f3 commit 4afd3f2Copy full SHA for 4afd3f2
recipes/A5000_24GB_x8/Mistral-7B-v0.1/coder-sql-en.yaml
@@ -13,6 +13,6 @@ lora_r: 8
13
lora_alpha: 16
14
lora_dropout: 0.05
15
train_claim_gpu_num: 8
16
-train_per_device_train_batch_size: 1
17
-train_gradient_accumulation_steps: 16
+train_per_device_train_batch_size: 4
+train_gradient_accumulation_steps: 4
18
train_num_train_epochs: 4
0 commit comments