Skip to content

Commit d06eba7

Browse files
committed
doc: Update installation instructions based on ABI and platforms
Signed-off-by: Dheeraj Peri <[email protected]>
1 parent 93e4c4a commit d06eba7

File tree

2 files changed

+13
-5
lines changed

2 files changed

+13
-5
lines changed

README.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,7 @@ import torch_tensorrt
5656
5757
...
5858
59-
trt_ts_module = torch_tensorrt.compile(torch_script_module,
59+
trt_ts_module = torch_tensorrt.compile(torch_script_module,
6060
inputs = [example_tensor, # Provide example tensor for input shape or...
6161
torch_tensorrt.Input( # Specify input object with shape and dtype
6262
min_shape=[1, 3, 224, 224],
@@ -204,9 +204,10 @@ bazel build //:libtorchtrt --compilation_mode=dbg
204204
```
205205

206206
### Native compilation on NVIDIA Jetson AGX
207+
We performed end to end testing on Jetson platform using Jetpack SDK 4.6.
207208

208209
``` shell
209-
bazel build //:libtorchtrt --distdir third_party/dist_dir/aarch64-linux-gnu
210+
bazel build //:libtorchtrt --platforms //toolchains:jetpack_4.6
210211
```
211212

212213
> Note: Please refer [installation](docs/tutorials/installation.html) instructions for Pre-requisites

py/README.md

Lines changed: 10 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -31,9 +31,16 @@ results = compiled_trt_model(data.half())
3131

3232
## Installation
3333

34-
```
35-
python3 setup.py install
36-
```
34+
| ABI / Platform | Installation command |
35+
| --------------------------------------- | ------------------------------------------------------------ |
36+
| Pre CXX11 ABI (Linux x86_64) | python3 setup.py install --release |
37+
| CXX ABI (Linux x86_64) | python3 setup.py install --use-cxx11-abi --release |
38+
| Pre CXX11 ABI (Jetson platform aarch64) | python3 setup.py install --release --jetpack-version 4.6 |
39+
| CXX11 ABI (Jetson platform aarch64) | python3 setup.py install --release --jetpack-version 4.6 --use-cxx11-abi |
40+
41+
For Linux x86_64 platform, Pytorch libraries default to pre cxx11 abi. So, please use `python3 setup.py install --release`.
42+
43+
On Jetson platforms, NVIDIA hosts <a href="https://forums.developer.nvidia.com/t/pytorch-for-jetson-version-1-10-now-available/72048">pre-built Pytorch wheel files</a>. These wheel files are built with CXX11 ABI. So on jetson platforms, please use `python3 setup.py install --release --jetpack-version 4.6`
3744

3845
## Under the Hood
3946

0 commit comments

Comments
 (0)