diff --git a/README.md b/README.md index 78d6bf9..70e4347 100644 --- a/README.md +++ b/README.md @@ -20,7 +20,6 @@ Β· Cheng Wang

-

CVPR 2023

@@ -33,19 +32,118 @@ Project Page

-
+ + +
+ Logo +
+ + - ## News and Updates +- *More info is coming soon…* - **03/2023**: Initial release of the visualization Tool ([SMPL-Scene Viewer](https://github.com/climbingdaily/SMPL-Scene-Viewer)) (v1.0) +
+
+
+ +## Dataset +- 15 sequences of 12 human subjects in +- 10 scenes in urban environments (1k – 30k π‘š^2) +- 100k+ frames multi-source data (20 Hz) +- including 2D / 3D annotations and 3D scenes; +7 km+ human motions. + +*Every human subject signed permission to release their motion data for research purposes.* + + + +### Dataset breakdown +| Num | Sequence | Traj. length ($m$) | Area size ($m^2$) | Frames | Motions | +| --- | ------------ | ---------------- | ---------------- | ------ | -------------------------------------------- | +| 001 | campus_001 | 908 | 13,400 | 16,202 | Jogging downhill, tying shoelaces, jumping | +| 002 | football_002 | 221 | 200 | 4,665 | Juggling, passing, and shooting a football | +| 003 | street_002 | 291 | 1,600 | 6,496 | Taking photos, putting on/taking off a bag | +| 004 | library_001 | 440 | 2,300 | 9,949 | Borrowing books, reading, descending stairs | +| 005 | library_002 | 474 | 2,300 | 8,901 | Looking up, reading, returning a book | +| 006 | library_003 | 477 | 2,300 | 8,386 | Admiring paintings, throwing rubbish, greeting | +| 007 | garden_001 | 217 | 3,000 | 5,994 | Raising hand, sitting on bench, going upstairs | +| 008 | running_001 | 392 | 8,500 | 2,000 | Running | +| 009 | running_002 | 985 | 30,000 | 8,113 | Running | +| 010 | park_001 | 642 | 9,300 | 12,445 | Visiting a park, walking up a small hill | +| 011 | park_002 | 1,025 | 11,000 | 1,000 | Buying drinks, trotting, drinking | +| 012 | square_001 | 264 | 3,200 | 6,792 | Making phone calls, waving, drinking | +| 013 | sunlightRock001 | 386 | 1,900 | 10,116 | Climbing stairs, taking photos, walking | +| 014 | garden_002 | 209 | 4,200 | 5,604 | Stooping, crossing a bridge, sitting cross-legged | +| 015 | plaza_001 | 365 | 2,700 | 7,989 | Admiring sculptures, eating + +### **File structure** +``` bash +β”œβ”€β”€ seq{Num}_{Sequence}/ +| β”œβ”€β”€ lidar_data/ +| | β”œβ”€β”€ lidar_frames_rot/ +| | | └── '*.pcd' # n frames pcd +| | β”œβ”€β”€ 'lidar_trajectory.txt' +| | └── 'tracking_traj.txt' +| β”œβ”€β”€ mocap_data/ +| | └── '*.bvh' +| β”œβ”€β”€ rgb_data/ +| | β”œβ”€β”€ 'labels.pkl' +| | └── '*.MP4' +| └── 'dataset_params.json' +β”œβ”€β”€ ... +└── ... +``` +For more information on data processing, please see [data-processing/README.md](./data_processing/README.md). + +## More qualitative results +- Comparison between **IMU + ICP** and **our optimization** results. + +
+ Logo +
+
+Borrowing and reading a book on a sofa. +
+ +
+ Logo +
+
+Playing football. +
+ +- Comparison between *original extrinsic parameters* and *our optimization results*. +
+ Logo +
+ + +### Cross-Dataset Evaluation +- LiDAR-based human pose estimation (HPE) + +
+ Logo +
+ +- Camera-based HPE +
+ Logo +
+ + +- Global Human Pose Estimation Comparison +
+ Logo +
+ ## Citation ``` @inproceedings{dai2023sloper4d, diff --git a/assets/0_pipeline_202332215830.gif b/assets/0_pipeline_202332215830.gif new file mode 100644 index 0000000..0e24bb0 Binary files /dev/null and b/assets/0_pipeline_202332215830.gif differ diff --git a/assets/1_data_intro_202332215833.gif b/assets/1_data_intro_202332215833.gif new file mode 100644 index 0000000..3289001 Binary files /dev/null and b/assets/1_data_intro_202332215833.gif differ diff --git a/assets/1_data_intro_2_202332215837.gif b/assets/1_data_intro_2_202332215837.gif new file mode 100644 index 0000000..0338554 Binary files /dev/null and b/assets/1_data_intro_2_202332215837.gif differ diff --git a/assets/1_hardware.gif b/assets/1_hardware.gif new file mode 100644 index 0000000..ec0a185 Binary files /dev/null and b/assets/1_hardware.gif differ diff --git a/assets/2_compare_202332215842.gif b/assets/2_compare_202332215842.gif new file mode 100644 index 0000000..8e2512d Binary files /dev/null and b/assets/2_compare_202332215842.gif differ diff --git a/assets/2_compare_extrinsic_202332215849.gif b/assets/2_compare_extrinsic_202332215849.gif new file mode 100644 index 0000000..bb45aa6 Binary files /dev/null and b/assets/2_compare_extrinsic_202332215849.gif differ diff --git a/assets/2_compare_football_202332215855.gif b/assets/2_compare_football_202332215855.gif new file mode 100644 index 0000000..ef981bd Binary files /dev/null and b/assets/2_compare_football_202332215855.gif differ diff --git a/assets/3_compare_lidarcap_20233221594.gif b/assets/3_compare_lidarcap_20233221594.gif new file mode 100644 index 0000000..f06b89f Binary files /dev/null and b/assets/3_compare_lidarcap_20233221594.gif differ diff --git a/assets/3_compare_vibe_20233221598.gif b/assets/3_compare_vibe_20233221598.gif new file mode 100644 index 0000000..b2fd965 Binary files /dev/null and b/assets/3_compare_vibe_20233221598.gif differ diff --git a/assets/4_compare_ghpe_glamr_202332215913.gif b/assets/4_compare_ghpe_glamr_202332215913.gif new file mode 100644 index 0000000..aa8ab40 Binary files /dev/null and b/assets/4_compare_ghpe_glamr_202332215913.gif differ diff --git a/assets/teaser.gif b/assets/teaser.gif index 50130c5..4600c98 100644 Binary files a/assets/teaser.gif and b/assets/teaser.gif differ diff --git a/assets/teaser.mp4 b/assets/teaser.mp4 deleted file mode 100644 index 2db7af6..0000000 Binary files a/assets/teaser.mp4 and /dev/null differ diff --git a/data_processing/README.md b/data_processing/README.md new file mode 100644 index 0000000..e69de29