Skip to content

[Debug][PaddleV3] 测试 inference 模型导入卡住的问题 #1077

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 28 commits into
base: develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
5a6729f
[Fix] version check
megemini Oct 13, 2024
ac2d866
Merge branch 'develop' of https://github.com/PaddlePaddle/X2Paddle in…
megemini Oct 17, 2024
6e985f8
[Fix] log_summary with black.list
megemini Oct 17, 2024
ac279ba
[Debug] test for black.list
megemini Oct 17, 2024
990ab2f
[Fix] make default result is Failed
megemini Oct 17, 2024
d8df85d
[Restore] black.list
megemini Oct 17, 2024
75312b9
[Fix] use logger instead of logging
megemini Oct 17, 2024
1eab32a
[Debug] make max_examples=1
megemini Oct 17, 2024
1068e83
Revert "[Debug] make max_examples=1"
megemini Oct 17, 2024
82eeca4
[Debug] add logger
megemini Oct 17, 2024
c907537
[Debug] print log
megemini Oct 17, 2024
2329907
[Debug] echo bash
megemini Oct 17, 2024
3b474a7
[Debug] echo output
megemini Oct 17, 2024
9370681
[Debug] logger
megemini Oct 17, 2024
1a677be
[Debug] logger onnx2paddle
megemini Oct 17, 2024
5cdf140
[Debug] logger after model converted
megemini Oct 17, 2024
70f75b8
[Debug] logger _mk_paddle_res
megemini Oct 17, 2024
c5ac74e
[Debug] logger _mk_paddle_res gpu memory
megemini Oct 17, 2024
c0c95dd
[Debug] logger _mk_paddle_res more
megemini Oct 17, 2024
7700a01
[Debug] force run dynamic
megemini Oct 18, 2024
657b372
[Debug] force run dynamic torhc
megemini Oct 18, 2024
4f487bd
[Debug] glog
megemini Oct 18, 2024
f94878c
Merge branch 'develop' of https://github.com/PaddlePaddle/X2Paddle in…
megemini Oct 20, 2024
8901c8b
[Debug] log
megemini Oct 21, 2024
2956b4e
[Debug] log
megemini Oct 21, 2024
0bfffe3
[Debug] config.DisableMKLDNN
megemini Oct 21, 2024
7ceff0a
[Debug] config.DisableMKLDNN
megemini Oct 21, 2024
01ba114
[Update] config.disable_mkldnn
megemini Nov 12, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 8 additions & 2 deletions test_autoscan/onnx/onnxbase.py
Original file line number Diff line number Diff line change
Expand Up @@ -224,7 +224,7 @@ def _mk_paddle_res(self, ver):
self.run_dynamic = True

# TODO(megemini): create_predictor stuck
self.run_dynamic = True
# self.run_dynamic = True

if self.run_dynamic:
logger.info(">>> self.run_dynamic...")
Expand Down Expand Up @@ -275,7 +275,13 @@ def _mk_paddle_res(self, ver):

logger.info(">>> config.disable_glog_info...")

config.disable_glog_info()
# TODO(megemini): debug
# config.disable_glog_info()
# TODO(megemini):
try:
config.disable_mkldnn()
except:
pass

logger.info(">>> config.pass_builder...")

Expand Down
8 changes: 6 additions & 2 deletions test_autoscan/run_autoscan_onnx.sh
Original file line number Diff line number Diff line change
Expand Up @@ -27,8 +27,9 @@ do

echo " >>> begin test ..."

python ${var} > ${log_name} 2>&1
# python ${var}
# TODO(megemini): debug
# GLOG_v=3 python ${var} > ${log_name} 2>&1
GLOG_v=3 python ${var}

done

Expand All @@ -48,6 +49,9 @@ do
cat ${log_name}
fi

# TODO(megemini): debug, only run one test
break

done

tar zcvf logs.tar.gz logs
Expand Down
8 changes: 7 additions & 1 deletion test_autoscan/run_autoscan_torch.sh
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,10 @@ for var in ${file_arr[@]}
do
log_name=${logs_path}/${var}.log
echo " Now start test: ${var}"
python ${var} > ${log_name} 2>&1

# TODO(megemini):
# python ${var} > ${log_name} 2>&1
GLOG_v=3 python ${var}

done

Expand All @@ -46,6 +49,9 @@ do
cat ${log_name}
fi

# TODO(megemini): debug, only run one test
break

done

tar zcvf logs.tar.gz logs
Expand Down
12 changes: 10 additions & 2 deletions test_autoscan/torch/torchbase.py
Original file line number Diff line number Diff line change
Expand Up @@ -181,7 +181,7 @@ def _mk_paddle_res(self, ):
self.run_dynamic = True

# TODO(megemini): create_predictor stuck
self.run_dynamic = True
# self.run_dynamic = True

if self.run_dynamic:
paddle_path = os.path.join(self.pwd, self.name,
Expand Down Expand Up @@ -213,7 +213,15 @@ def _mk_paddle_res(self, ):
config.enable_memory_optim()
# disable feed, fetch OP, needed by zero_copy_run
config.switch_use_feed_fetch_ops(False)
config.disable_glog_info()

# TODO(megemini): debug
# config.disable_glog_info()
# TODO(megemini):
try:
config.DisableMKLDNN()
except:
pass

pass_builder = config.pass_builder()
predictor = create_predictor(config)
input_names = predictor.get_input_names()
Expand Down