-
Notifications
You must be signed in to change notification settings - Fork 3.4k
Description
Related to Model/Framework(s)
Triton
Describe the bug
A clear and concise description of what the bug is.
when i run the scipt:
python3 triton/run_inference_on_triton.py
--server-url localhost:8001
--model-name ${MODEL_NAME}
--model-version 1
--output-dir ${SHARED_DIR}/accuracy_dump
--precision ${PRECISION}
--dataloader triton/dataloader.py
--data-dir ${DATASETS_DIR}/imagenet
--batch-size ${MAX_BATCH_SIZE}
--dump-labels
error:
2024-05-06 08:36:19,172 INFO dataloader Creating PIL dataloader on data_dir=/data/DeepLearningExamples/PyTorch/Classification/ConvNets/workspace/datasets_dir/imagenet #images=50000 image_size=(224, 224) batch_size=16
Exception in thread Thread-1:
Traceback (most recent call last):
File "/opt/conda/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
File "/opt/conda/lib/python3.8/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "triton/run_inference_on_triton.py", line 165, in req_loop
infer_input.set_data_from_numpy(data)
File "/opt/conda/lib/python3.8/site-packages/tritonclient/grpc/init.py", line 1441, in set_data_from_numpy
self._input.parameters.pop('shared_memory_region', None)
TypeError: pop() takes from 1 to 2 positional arguments but 3 were given
To Reproduce
follow the Guide:
DeepLearningExamples/PyTorch/Classification/ConvNets/triton/resnet50
/README.md Quick Start Guide
model_store
- resnet50
- config.pbtxt
- 1
- model.onnx
Expected behavior
no error in running the scirpt and have accuracy_metrics.csv
Environment
Please provide at least:
- Container version: nvcr.io/nvidia/tritonserver:21.02-py3 and resnet50:latest
- GPUs in the system: 1x NVIDIA A800 80GB PCIe):
- CUDA driver version :525.85.12
- triton_version:2.7.0