We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 056ff4a commit 62598bbCopy full SHA for 62598bb
recipes/A5000_24GB_x8/i18n-ja-wikipedia-gozarinnemon.yaml
@@ -9,12 +9,12 @@ dataset_output_field_name: output
9
dataset_filter_field_value: 0
10
dataset_train_split_seed: 42
11
dataset_train_split_test_size: 0.2
12
-lora_r: 64
+lora_r: 8
13
lora_alpha: 16
14
-lora_dropout: 0.1
+lora_dropout: 0.05
15
train_claim_gpu_num: 3
16
train_per_device_train_batch_size: 8
17
-train_gradient_accumulation_steps: 16
+train_gradient_accumulation_steps: 4
18
train_num_train_epochs: 4
19
train_max_steps: 1000
20
train_fp16: True
0 commit comments