Skip to content

Commit d82e073

Browse files
authored
Git Job Error Handling (#6517)
# Overview Add logic to hand Git Job Handle: the handling only triggers when a configuration for a repo exists 1. find rows that represents the git job level failure 2. based on config, detect all related rows, and add Failure metric 3. skip failure job rows The ui renders it as normal failure handling # Demo the demo pr: #6516 mimic GIt_Job Failure in with `model: "edsr", backend: "qnn_q8", mode: "inference", device: "samsung_galaxy_s22"` [demo link with fake data in vercel](https://torchci-git-3jobfailure-fbopensource.vercel.app/benchmark/llms?startTime=Tue%2C%2001%20Apr%202025%2023%3A50%3A29%20GMT&stopTime=Tue%2C%2008%20Apr%202025%2023%3A50%3A29%20GMT&granularity=day&lBranch=main&lCommit=150cbe187bd95ca6847d9a9b9a104b012c8274e7&rBranch=main&rCommit=1e972325122c7f4050e67c2700ef316047be5d68&repoName=pytorch%2Fexecutorch&benchmarkName=&modelName=All%20Models&backendName=All%20Backends&modeName=All%20Modes&dtypeName=All%20DType&deviceName=All%20Devices&archName=All%20Platforms) ## UI snapshot ![image](https://github.com/user-attachments/assets/e31acdb6-c912-4f11-8263-a1684991fb19) # Others [BE] - wrap group logics for lcommit and rcommit into a method - wrap toTableRow method into a method
1 parent d8122ff commit d82e073

File tree

2 files changed

+322
-178
lines changed

2 files changed

+322
-178
lines changed

torchci/clickhouse_queries/oss_ci_benchmark_llms/query.sql

+7
Original file line numberDiff line numberDiff line change
@@ -56,6 +56,13 @@ WITH benchmarks AS (
5656
'false',
5757
-- Default to false
5858
tupleElement(o.benchmark, 'extra_info')['is_dynamic']
59+
),
60+
'failure_type',
61+
IF(
62+
tupleElement(o.benchmark, 'extra_info')['failure_type'] = '',
63+
'',
64+
-- Default to false
65+
tupleElement(o.benchmark, 'extra_info')['failure_type']
5966
)
6067
) AS extra
6168
FROM

0 commit comments

Comments
 (0)