Skip to content

[Queue Time Histogram] Add Job Queue Time Lambda #6435

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 38 commits into from
Mar 19, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
38 commits
Select commit Hold shift + click to select a range
1da9088
add time
yangw-dev Mar 18, 2025
a774afb
rename function for consistency
yangw-dev Mar 18, 2025
32f77b8
replace mock patch
yangw-dev Mar 18, 2025
8fcc0e7
replace mock patch
yangw-dev Mar 18, 2025
871a646
replace mock patch
yangw-dev Mar 18, 2025
c2267bc
replace mock patch
yangw-dev Mar 18, 2025
35289aa
fix test
yangw-dev Mar 18, 2025
52dcbce
fix test
yangw-dev Mar 18, 2025
b6022f3
fix test
yangw-dev Mar 18, 2025
b1064c7
fix test
yangw-dev Mar 18, 2025
7a1b5aa
fix test version
yangw-dev Mar 18, 2025
3baa920
fix test version
yangw-dev Mar 18, 2025
ca24376
fix sync
yangw-dev Mar 19, 2025
c64762f
fix sync
yangw-dev Mar 19, 2025
2814b4b
fix sync
yangw-dev Mar 19, 2025
ec39f93
fix sync
yangw-dev Mar 19, 2025
893e719
fix sync
yangw-dev Mar 19, 2025
0288175
add tags
yangw-dev Mar 19, 2025
d3f4cf7
add tags
yangw-dev Mar 19, 2025
c80241a
add tags
yangw-dev Mar 19, 2025
ce3b8a5
add tags
yangw-dev Mar 19, 2025
7eefe8d
add tags
yangw-dev Mar 19, 2025
70542e1
add tags
yangw-dev Mar 19, 2025
b5d2a49
add tags
yangw-dev Mar 19, 2025
c3a6352
add tags
yangw-dev Mar 19, 2025
8c24747
ares
yangw-dev Mar 19, 2025
a60834e
typo
yangw-dev Mar 19, 2025
2f47298
typo
yangw-dev Mar 19, 2025
a6b8113
typo
yangw-dev Mar 19, 2025
aa1d08c
typo
yangw-dev Mar 19, 2025
b8a1086
typo
yangw-dev Mar 19, 2025
e91f959
typo
yangw-dev Mar 19, 2025
6b3b889
typo
yangw-dev Mar 19, 2025
4d8440f
reform code
yangw-dev Mar 19, 2025
3698aa6
comment
yangw-dev Mar 19, 2025
1d9c847
comment
yangw-dev Mar 19, 2025
dcc68fd
comment
yangw-dev Mar 19, 2025
f32924c
comment
yangw-dev Mar 19, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 18 additions & 0 deletions .github/workflows/tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,24 @@ jobs:
# Test tools
python3 -m unittest discover -vs tools/tests -p 'test_*.py'

test-aws-lambda:
name: Test aws lambda
if: ${{ github.repository == 'pytorch/test-infra' }}
uses: ./.github/workflows/linux_job_v2.yml
with:
docker-image: python:3.10-slim-bullseye
runner: linux.large
script: |
# Environment setup
echo ::group::setup Python environment
python -m venv .venv/
source .venv/bin/activate
pip install -r aws/lambda/tests/test_requirements.txt
echo ::endgroup::

# Test aws lambda
pytest -v aws/lambda/tests

test-github-scripts:
name: Test github scripts
if: ${{ github.repository == 'pytorch/test-infra' }}
Expand Down
1 change: 1 addition & 0 deletions .lintrunner.toml
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,7 @@ include_patterns = [
'torchci/**/*.py',
'torchci/**/*.pyi',
'.github/scripts/*.py',
'aws/lambda/oss-ci-job-queue-time/*.py',
'aws/lambda/whl_metadata_upload_pep658/**/*.py',
]
command = [
Expand Down
3 changes: 3 additions & 0 deletions aws/lambda/oss_ci_job_queue_time/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
*.zip
deployment/
venv/
19 changes: 19 additions & 0 deletions aws/lambda/oss_ci_job_queue_time/Makefile
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
all: run-local

clean:
rm -rf deployment
rm -rf venv
rm -rf deployment.zip

venv/bin/python:
virtualenv venv
venv/bin/pip install -r requirements.txt

deployment.zip:
mkdir -p deployment
cp lambda_function.py ./deployment/.
pip3.10 install -r requirements.txt -t ./deployment/. --platform manylinux2014_x86_64 --only-binary=:all: --implementation cp --python-version 3.10 --upgrade
cd ./deployment && zip -q -r ../deployment.zip .

.PHONY: create-deployment-package
create-deployment-package: deployment.zip
Loading