Skip to content

Commit c3119f4

Browse files
SvenKlaassenSvenKlaassen
committed
rerun quantile simulations
1 parent 3633062 commit c3119f4

15 files changed

+250
-0
lines changed

‎results/irm/cvar_Y0_coverage.csv

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
Learner g,Learner m,level,Coverage,CI Length,Bias,repetition
2+
LGBM Regr.,LGBM Clas.,0.9,0.85,0.5670142676988336,0.15380806524383983,200
3+
LGBM Regr.,LGBM Clas.,0.95,0.917142857142857,0.6756391725078731,0.15380806524383983,200
4+
LGBM Regr.,Logistic,0.9,0.7985714285714286,0.4385225256106473,0.13981066432860312,200
5+
LGBM Regr.,Logistic,0.95,0.8857142857142857,0.5225318183474872,0.13981066432860312,200
6+
Linear,LGBM Clas.,0.9,0.807142857142857,0.5780831437073561,0.16505729067291136,200
7+
Linear,LGBM Clas.,0.95,0.8778571428571429,0.6888285517757731,0.16505729067291136,200
8+
Linear,Logistic,0.9,0.7535714285714286,0.46127673668330255,0.14620789056223912,200
9+
Linear,Logistic,0.95,0.8271428571428571,0.5496451331545211,0.14620789056223912,200

‎results/irm/cvar_Y1_coverage.csv

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
Learner g,Learner m,level,Coverage,CI Length,Bias,repetition
2+
LGBM Regr.,LGBM Clas.,0.9,0.9214285714285714,0.1913460262511472,0.0431261794473061,200
3+
LGBM Regr.,LGBM Clas.,0.95,0.9592857142857143,0.22800285319744668,0.0431261794473061,200
4+
LGBM Regr.,Logistic,0.9,0.9192857142857143,0.18097901112163345,0.041041888975454605,200
5+
LGBM Regr.,Logistic,0.95,0.9614285714285714,0.2156497927499421,0.041041888975454605,200
6+
Linear,LGBM Clas.,0.9,0.9164285714285714,0.2132575331275393,0.046942310613367344,200
7+
Linear,LGBM Clas.,0.95,0.9621428571428571,0.2541120240203392,0.046942310613367344,200
8+
Linear,Logistic,0.9,0.9228571428571429,0.1968307741542601,0.04490834814057729,200
9+
Linear,Logistic,0.95,0.9557142857142857,0.23453833342391914,0.04490834814057729,200

‎results/irm/cvar_config.yml

Lines changed: 65 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,65 @@
1+
simulation_parameters:
2+
repetitions: 200
3+
max_runtime: 19800
4+
random_seed: 42
5+
n_jobs: -2
6+
dgp_parameters:
7+
n_obs:
8+
- 5000
9+
dim_x:
10+
- 5
11+
learner_definitions:
12+
linear: &id001
13+
name: Linear
14+
logit: &id002
15+
name: Logistic
16+
lgbmr: &id003
17+
name: LGBM Regr.
18+
params:
19+
n_estimators: 200
20+
learning_rate: 0.05
21+
num_leaves: 15
22+
max_depth: 5
23+
min_child_samples: 10
24+
subsample: 0.9
25+
colsample_bytree: 0.9
26+
reg_alpha: 0.0
27+
reg_lambda: 0.1
28+
random_state: 42
29+
lgbmc: &id004
30+
name: LGBM Clas.
31+
params:
32+
n_estimators: 200
33+
learning_rate: 0.05
34+
num_leaves: 15
35+
max_depth: 5
36+
min_child_samples: 10
37+
subsample: 0.9
38+
colsample_bytree: 0.9
39+
reg_alpha: 0.0
40+
reg_lambda: 0.1
41+
random_state: 42
42+
dml_parameters:
43+
tau_vec:
44+
- - 0.2
45+
- 0.3
46+
- 0.4
47+
- 0.5
48+
- 0.6
49+
- 0.7
50+
- 0.8
51+
trimming_threshold:
52+
- 0.01
53+
learners:
54+
- ml_g: *id001
55+
ml_m: *id002
56+
- ml_g: *id003
57+
ml_m: *id004
58+
- ml_g: *id003
59+
ml_m: *id002
60+
- ml_g: *id001
61+
ml_m: *id004
62+
confidence_parameters:
63+
level:
64+
- 0.95
65+
- 0.9

‎results/irm/cvar_effect_coverage.csv

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
Learner g,Learner m,level,Coverage,CI Length,Bias,Uniform Coverage,Uniform CI Length,repetition
2+
LGBM Regr.,LGBM Clas.,0.9,0.85,0.5796241888849147,0.15567372871154336,0.87,0.7009270285655491,200
3+
LGBM Regr.,LGBM Clas.,0.95,0.9292857142857143,0.6906648203634905,0.15567372871154336,0.92,0.8074443628687097,200
4+
LGBM Regr.,Logistic,0.9,0.8207142857142857,0.4505521904112434,0.1384841777144103,0.795,0.5426740272513005,200
5+
LGBM Regr.,Logistic,0.95,0.8928571428571429,0.5368660480740288,0.1384841777144103,0.88,0.6261735233895037,200
6+
Linear,LGBM Clas.,0.9,0.825,0.604031305594578,0.17336373457185203,0.78,0.7151775160876557,200
7+
Linear,LGBM Clas.,0.95,0.8971428571428571,0.719747693716827,0.17336373457185203,0.85,0.8269744576928215,200
8+
Linear,Logistic,0.9,0.775,0.4860331654639814,0.1489380406801104,0.74,0.5698020622218235,200
9+
Linear,Logistic,0.95,0.85,0.5791442375130592,0.1489380406801104,0.81,0.6599452421128806,200

‎results/irm/cvar_metadata.csv

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
2+
0.10.0,CVARCoverageSimulation,2025-06-05 12:27,9.002358218034109,3.12.9,scripts/irm/cvar_config.yml

‎results/irm/lpq_Y0_coverage.csv

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
Learner g,Learner m,level,Coverage,CI Length,Bias,repetition
2+
LGBM Clas.,LGBM Clas.,0.9,0.935,1.1830884138959616,0.24363577628567012,200
3+
LGBM Clas.,LGBM Clas.,0.95,0.966,1.4097367958876215,0.24363577628567012,200
4+
LGBM Clas.,Logistic,0.9,0.9470000000000001,1.1413178140016869,0.21854310075124617,200
5+
LGBM Clas.,Logistic,0.95,0.971,1.3599640561957957,0.21854310075124617,200
6+
Logistic,LGBM Clas.,0.9,0.932,1.1519919205445956,0.2330721806385721,200
7+
Logistic,LGBM Clas.,0.95,0.965,1.3726830386319526,0.2330721806385721,200
8+
Logistic,Logistic,0.9,0.9359999999999999,1.1121705811298108,0.21974489145697174,200
9+
Logistic,Logistic,0.95,0.9670000000000001,1.3252329860617573,0.21974489145697174,200

‎results/irm/lpq_Y1_coverage.csv

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
Learner g,Learner m,level,Coverage,CI Length,Bias,repetition
2+
LGBM Clas.,LGBM Clas.,0.9,0.927,1.6166365116884824,0.31220031423527045,200
3+
LGBM Clas.,LGBM Clas.,0.95,0.963,1.9263412178957202,0.31220031423527045,200
4+
LGBM Clas.,Logistic,0.9,0.943,1.563138831397548,0.2947145026308053,200
5+
LGBM Clas.,Logistic,0.95,0.971,1.8625948000329942,0.2947145026308053,200
6+
Logistic,LGBM Clas.,0.9,0.9420000000000001,1.567514402933319,0.2888227334203665,200
7+
Logistic,LGBM Clas.,0.95,0.971,1.867808615099192,0.2888227334203665,200
8+
Logistic,Logistic,0.9,0.94,1.514063009772447,0.28729535217904684,200
9+
Logistic,Logistic,0.95,0.9690000000000001,1.8041173517537936,0.28729535217904684,200

‎results/irm/lpq_config.yml

Lines changed: 48 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,48 @@
1+
simulation_parameters:
2+
repetitions: 200
3+
max_runtime: 19800
4+
random_seed: 42
5+
n_jobs: -2
6+
dgp_parameters:
7+
n_obs:
8+
- 5000
9+
dim_x:
10+
- 5
11+
learner_definitions:
12+
logit: &id001
13+
name: Logistic
14+
lgbmc: &id002
15+
name: LGBM Clas.
16+
params:
17+
n_estimators: 200
18+
learning_rate: 0.05
19+
num_leaves: 15
20+
max_depth: 5
21+
min_child_samples: 10
22+
subsample: 0.9
23+
colsample_bytree: 0.9
24+
reg_alpha: 0.0
25+
reg_lambda: 0.1
26+
random_state: 42
27+
dml_parameters:
28+
tau_vec:
29+
- - 0.3
30+
- 0.4
31+
- 0.5
32+
- 0.6
33+
- 0.7
34+
trimming_threshold:
35+
- 0.01
36+
learners:
37+
- ml_g: *id001
38+
ml_m: *id001
39+
- ml_g: *id002
40+
ml_m: *id002
41+
- ml_g: *id002
42+
ml_m: *id001
43+
- ml_g: *id001
44+
ml_m: *id002
45+
confidence_parameters:
46+
level:
47+
- 0.95
48+
- 0.9

‎results/irm/lpq_effect_coverage.csv

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
Learner g,Learner m,level,Coverage,CI Length,Bias,Uniform Coverage,Uniform CI Length,repetition
2+
LGBM Clas.,LGBM Clas.,0.9,0.872,1.6181705726529205,0.40951487126584607,0.845,2.1354108341964264,200
3+
LGBM Clas.,LGBM Clas.,0.95,0.9159999999999999,1.928169164280202,0.40951487126584607,0.9,2.415503519370637,200
4+
LGBM Clas.,Logistic,0.9,0.8740000000000001,1.5610121253821851,0.3740351656285603,0.85,2.0636125204752434,200
5+
LGBM Clas.,Logistic,0.95,0.922,1.860060673514064,0.3740351656285603,0.9,2.3356640837390916,200
6+
Logistic,LGBM Clas.,0.9,0.88,1.5741042679593236,0.3725851701898653,0.85,2.068634959359497,200
7+
Logistic,LGBM Clas.,0.95,0.924,1.8756609235978434,0.3725851701898653,0.9,2.3413181297561683,200
8+
Logistic,Logistic,0.9,0.867,1.517966599775595,0.37223450094097055,0.85,1.9954916237204523,200
9+
Logistic,Logistic,0.95,0.92,1.808768766135729,0.37223450094097055,0.92,2.260577010587138,200

‎results/irm/lpq_metadata.csv

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
2+
0.10.0,LPQCoverageSimulation,2025-06-05 13:42,14.852794400850932,3.12.9,scripts/irm/lpq_config.yml

0 commit comments

Comments
 (0)