Skip to content
This repository was archived by the owner on Feb 1, 2024. It is now read-only.

Python scripts for measurements 2023 #1

Open
wants to merge 139 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
139 commits
Select commit Hold shift + click to select a range
bf3642a
Add .py scripts to measure memory
atuchin-m May 23, 2023
0226b14
Memory measurements for windows
atuchin-m May 23, 2023
9d5f93f
browsertime support
atuchin-m May 25, 2023
61e18b1
Fix browsertime for win
atuchin-m May 25, 2023
00b14cc
Support benchmarks
atuchin-m May 25, 2023
6270588
Fix some issues
atuchin-m May 25, 2023
c354cec
more benches are supported
atuchin-m May 25, 2023
94a3318
Fix har encoding
atuchin-m May 26, 2023
90ca168
More encoding fixes just in case
atuchin-m May 26, 2023
a132077
refactor and browser lint
atuchin-m May 26, 2023
f767197
refactor and browser lint
atuchin-m May 26, 2023
a67bc6c
Merge branch 'python-scripts-for-measurements' of github.com:atuchin-…
atuchin-m May 26, 2023
498c865
add browsertime_utils.py
atuchin-m May 26, 2023
2578033
add loading_measurement.py
atuchin-m May 26, 2023
4ed61aa
Fix win memory
atuchin-m May 30, 2023
5aff8a1
Extended memory metrics
atuchin-m May 31, 2023
300abe1
Update the code, adds 2024 benchmark results
atuchin-m May 31, 2023
f448942
Fix .gitignore
atuchin-m May 28, 2024
48f7254
Fix some minor issues
atuchin-m May 30, 2024
19dd209
Fix start/stop some browsers
atuchin-m May 30, 2024
e9544ab
Fix error on unlink user_data_dir
atuchin-m May 31, 2024
4a31aaa
Fix append mode
atuchin-m May 31, 2024
f7f0c5c
write_csv on each iteration
atuchin-m May 31, 2024
978392e
Fix typing
atuchin-m May 31, 2024
7f0a19d
Change the order
atuchin-m May 31, 2024
840c226
Update memory metrics logic
atuchin-m May 31, 2024
33bc076
firefox no default options
atuchin-m May 31, 2024
73a4c26
add transfer_bytes for firefox
atuchin-m May 31, 2024
9486aeb
Update utils.js
atuchin-m Jun 3, 2024
aeffd30
Rename to script
atuchin-m Jun 3, 2024
3645f67
new memory&traffic measurement
atuchin-m Jun 3, 2024
8e19831
Add old-set.txt
atuchin-m Jun 3, 2024
c033c4d
retry-count=2 by default
atuchin-m Jun 4, 2024
5360c49
Add no-delay mode
atuchin-m Jun 4, 2024
a5aa578
Multipage support
atuchin-m Jun 5, 2024
d560b56
Add a new set
atuchin-m Jun 5, 2024
568c87d
Skip unsupported browsers
atuchin-m Jun 5, 2024
b5b39d1
Update termination logic
atuchin-m Jun 5, 2024
517ba40
Fix DDG win path
atuchin-m Jun 5, 2024
7e93c91
Update the list
atuchin-m Jun 5, 2024
cbf1575
Update win termination logic
atuchin-m Jun 5, 2024
e18ebe4
Case when there is no main process
atuchin-m Jun 5, 2024
c86ee13
edge.exe => msedge.exe
atuchin-m Jun 5, 2024
f9c0793
Fix process finding issues
atuchin-m Jun 5, 2024
600885e
Fix memory measurements
atuchin-m Jun 5, 2024
c2c5f43
Update delay and a test set
atuchin-m Jun 5, 2024
875c4be
Add open_url timeout
atuchin-m Jun 5, 2024
e599510
TranserSize for Firefox
atuchin-m Jun 5, 2024
ea78def
New logic for _Total metrics
atuchin-m Jun 5, 2024
12e5ac1
Alternative memory metrics
atuchin-m Jun 5, 2024
e6b69e3
setup startup delay
atuchin-m Jun 5, 2024
5946e5b
don't skip missed metrics
atuchin-m Jun 5, 2024
877d8b4
Replace 0 to run_time
atuchin-m Jun 5, 2024
de31ff2
Add DDG to default
atuchin-m Jun 5, 2024
15388e2
add units
atuchin-m Jun 6, 2024
ce7f36e
Add test scenario
atuchin-m Jun 6, 2024
cf783f2
Add win logging
atuchin-m Jun 6, 2024
456695f
use PrivateBytes
atuchin-m Jun 6, 2024
372b541
improme logging
atuchin-m Jun 6, 2024
fd69a25
Fix Safari
atuchin-m Jun 6, 2024
629a3c8
Support clearing Firefox cache
atuchin-m Jun 10, 2024
a38c241
Update the lists
atuchin-m Jun 10, 2024
4a14272
Remove Safari cache
atuchin-m Jun 10, 2024
989b8be
Fix Safari profile removal
atuchin-m Jun 11, 2024
4c3bf73
Fix --append
atuchin-m Jun 11, 2024
05b848a
Fix removing Safari cache
atuchin-m Jun 11, 2024
8d55dff
Fix expanding ~
atuchin-m Jun 13, 2024
2f07095
Loading 2024 results
atuchin-m Jun 14, 2024
9ee2441
update git ignore
atuchin-m Oct 14, 2024
88cf253
New list
atuchin-m Nov 6, 2024
3c42076
Fix list parsing
atuchin-m Dec 2, 2024
e3fb6a0
fix waiting before mem measurements
atuchin-m Dec 2, 2024
c189d03
Add run.py
atuchin-m Dec 4, 2024
2d1ddef
Use es modules
atuchin-m Dec 4, 2024
d84f9ca
fix execa
atuchin-m Dec 4, 2024
2c07573
Use .venv
atuchin-m Dec 4, 2024
419ad10
improve install
atuchin-m Dec 4, 2024
15edc91
Use new tab for firefox
atuchin-m Dec 4, 2024
6786b06
venv win support
atuchin-m Dec 4, 2024
78dc099
New list, reduce page delay to 10sec
atuchin-m Dec 4, 2024
5e4efde
Fix names
atuchin-m Dec 4, 2024
03956bb
update the lists
atuchin-m Dec 5, 2024
e61844e
Rework some code
atuchin-m Dec 5, 2024
ac3e642
rename the folder
atuchin-m Dec 5, 2024
6139172
update the list
atuchin-m Dec 5, 2024
fb3570d
Fix issues
atuchin-m Dec 5, 2024
ec2cc3c
Fix sp3 issue
atuchin-m Dec 5, 2024
2ae58e2
Fix some issues
atuchin-m Dec 5, 2024
872e38a
Add multipage
atuchin-m Dec 5, 2024
fb56362
Adjust delays
atuchin-m Dec 5, 2024
98cd16f
clarify the messages
atuchin-m Dec 6, 2024
b61baaa
update run.py
atuchin-m Dec 6, 2024
21f03a2
Add path to key
atuchin-m Dec 9, 2024
bd241da
Add indexes and reprocess.py
atuchin-m Dec 9, 2024
07ddd73
recalc the date
atuchin-m Dec 9, 2024
fb329ea
Randomize the order of URLs and browsers
atuchin-m Dec 12, 2024
68e43ef
add memory URLs shuffle
atuchin-m Dec 12, 2024
9f0315e
Add list v3
atuchin-m Dec 12, 2024
e81186b
Use only 20 URLS in memory measurements
atuchin-m Jan 8, 2025
43c7bf6
random shuffle tabs for DDG
atuchin-m Jan 8, 2025
8c03146
Fix typing
atuchin-m Jan 11, 2025
045ad55
update timings, disable random shuffle for loading
atuchin-m Jan 11, 2025
dd89940
Add totalTransferredBytes
atuchin-m Jan 12, 2025
41e2a44
Add more scenarious
atuchin-m Jan 13, 2025
f193361
Add spent_min metric
atuchin-m Jan 13, 2025
bacfb01
update run.py
atuchin-m Jan 13, 2025
c9ecfd6
limit the number of parallel tasks
atuchin-m Jan 14, 2025
1e005b2
Drop safari session
atuchin-m Jan 14, 2025
5588a67
skip broken pages in multipage
atuchin-m Jan 14, 2025
ed3de5a
Fix bytes calc
atuchin-m Jan 14, 2025
4b23ac1
Remove extra delay
atuchin-m Jan 14, 2025
ab6ad50
Set alias for browsertime
atuchin-m Jan 15, 2025
3cffcd4
reduce delay
atuchin-m Jan 15, 2025
ef0aad9
add ttfb
atuchin-m Jan 15, 2025
ac9cdc5
use another page complete strategy
atuchin-m Jan 15, 2025
a428ae3
remove clear cache, cleanup some code
atuchin-m Jan 15, 2025
131eb52
Try to hold more errors
atuchin-m Jan 15, 2025
3af231f
Remove vocabulary.com
atuchin-m Jan 15, 2025
561728f
add more logging
atuchin-m Jan 15, 2025
4b55ae9
Add extra wait after page is loaded
atuchin-m Jan 15, 2025
dcb6a64
Add a workaround for empty response
atuchin-m Jan 15, 2025
66530b3
Remove www.espn.co.uk page
atuchin-m Jan 15, 2025
fa4be76
Fix calc loading metrics
atuchin-m Jan 15, 2025
21063b5
Improve termination for safari & ff
atuchin-m Jan 15, 2025
ada5b58
adjust delays
atuchin-m Jan 15, 2025
2a70316
Fix killing ff
atuchin-m Jan 15, 2025
3b2964c
remove www.yelp.co.uk
atuchin-m Jan 15, 2025
673a355
remove https://cnet.com
atuchin-m Jan 15, 2025
f8262e3
Fix ff killing
atuchin-m Jan 15, 2025
073b280
Clean more broken sites
atuchin-m Jan 15, 2025
f4fb0fc
Kill safari
atuchin-m Jan 15, 2025
f68b53c
fix killing ff
atuchin-m Jan 15, 2025
ad4f4e3
set maxLoadTime
atuchin-m Jan 15, 2025
8cc1309
adjust delays
atuchin-m Jan 15, 2025
ddb2aac
update run.py
atuchin-m Jan 15, 2025
ddff3dc
Fix safari terminate
atuchin-m Jan 16, 2025
5a6186e
update run.py
atuchin-m Jan 20, 2025
668fedd
Adjust memory delay
atuchin-m Jan 20, 2025
8a7d607
Adjust jetstream init
atuchin-m Jan 20, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 7 additions & 2 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
*.csv
*.png
.DS_Store
*.tar.gz
*.csv
results/
browser_profiles*/
browsertime/
browsertime-results/
node_modules/
__pycache__
27 changes: 27 additions & 0 deletions add_results.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
#!/usr/bin/env python3
# Copyright (c) 2024 The Brave Authors. All rights reserved.
# This Source Code Form is subject to the terms of the Mozilla Public
# License, v. 2.0. If a copy of the MPL was not distributed with this file,
# You can obtain one at https://mozilla.org/MPL/2.0/.

import argparse
from components.result_map import ResultMap
def main():
parser = argparse.ArgumentParser()
parser.add_argument('csv_file', type=str)
parser.add_argument('browser', type=str)
parser.add_argument('browser_version', type=str)
parser.add_argument('metric', type=str)
parser.add_argument('value_list', type=str)
parser.add_argument('--key', type=str)
args = parser.parse_args()

values = args.value_list.split(',')
results = ResultMap()
for v in values:
value = float(v)
results.addValue(args.browser, args.browser_version, args.metric, args.key, value)

results.write_csv(args.csv_file, True)

main()
Loading