Skip to content

Commit 62598bb

Browse files
committed
Fix param of recipes/A5000_24GB_x8/i18n-ja-wikipedia-gozarinnemon.yaml
1 parent 056ff4a commit 62598bb

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

recipes/A5000_24GB_x8/i18n-ja-wikipedia-gozarinnemon.yaml

+3-3
Original file line numberDiff line numberDiff line change
@@ -9,12 +9,12 @@ dataset_output_field_name: output
99
dataset_filter_field_value: 0
1010
dataset_train_split_seed: 42
1111
dataset_train_split_test_size: 0.2
12-
lora_r: 64
12+
lora_r: 8
1313
lora_alpha: 16
14-
lora_dropout: 0.1
14+
lora_dropout: 0.05
1515
train_claim_gpu_num: 3
1616
train_per_device_train_batch_size: 8
17-
train_gradient_accumulation_steps: 16
17+
train_gradient_accumulation_steps: 4
1818
train_num_train_epochs: 4
1919
train_max_steps: 1000
2020
train_fp16: True

0 commit comments

Comments
 (0)