Skip to content

Commit de06ed3

Browse files
Merge branch 'deployment' of https://github.com/Project-Babble/BabbleDocs into deployment
2 parents 86ce089 + 8e03e08 commit de06ed3

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

70 files changed

+3733
-16830
lines changed

.github/workflows/deploy.yml

+1-1
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ jobs:
2121
cache: yarn
2222

2323
- name: Install dependencies
24-
run: yarn install --frozen-lockfile
24+
run: yarn install
2525
- name: Build website
2626
run: yarn build
2727

CNAME

+1-1
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
www.babble.diy
1+
docs.babble.diy

blog/authors.yml

+2-2
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
dfgHiatus:
2-
name: Benjamin M. Evans
2+
name: dfgHiatus
33
title: Maintainer of the Project Babble docs
44
url: https://github.com/dfgHiatus
5-
image_url: https://avatars.githubusercontent.com/u/51272212?s=400&u=cff33bfb7d514d6b56bd99c08bd50402a7189c56&v=4
5+
image_url: https://avatars.githubusercontent.com/u/51272212?s=400&u=cff33bfb7d514d6b56bd99c08bd50402a7189c56&v=4

blog/reverse-engineering-the-vive-facial-tracker.mdx

+396
Large diffs are not rendered by default.

docs/CNAME

+1-1
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
www.babble.diy
1+
docs.babble.diy
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,56 @@
1+
---
2+
sidebar_position: 2
3+
title: Official Babble Tracker
4+
---
5+
6+
# Official Babble Tracker
7+
8+
Hi there! If you're in this section, you've purchaced a Babble Mouth Tracker V1!
9+
10+
## Here's how to use the tracker:
11+
12+
### 1) Plug your tracker into your PC!
13+
- This is pretty simple! There is a USB C port on your tracker! Plug it in and you should hear a windows connection sound when plugged in!
14+
- IMPORTANT: Make sure the switch is in the "ON" position! (see image below)
15+
- There should be two very bright green lights on the back of the trackers!
16+
17+
![switch](/img/setup_switch.jpg)
18+
19+
### 2) Look at device manager for the COM port of the tracker!
20+
- Press the windows key, then type "Device Manager" and press enter.
21+
- In the device manager, look for "Ports (COM & LPT)" and expand it.
22+
- You should see a new COM port listed under "Ports (COM & LPT)" listed as "USB Serial Device". This is the COM port of your tracker.
23+
24+
![device manager](/img/setup_comm.png)
25+
26+
### 3) Download the lastest version of the Babble Tracker software on our github!
27+
- You can find the latest version of the software here: https://drive.google.com/file/d/1KmMBYSmAGlqDeTEjgnOOCX8YpWeeBgPb/view?usp=drive_link
28+
- Download the Project_Babble-Setup-vX.X.X.exe file and run it to install the software.
29+
30+
:::warning
31+
Warning, the software is still in beta and may have bugs!
32+
:::
33+
34+
35+
### Open the Project Babbble software and select the COM port of your tracker.
36+
- In the Project Babble software, click on the dropdown next to the "Camera Address" text.
37+
- Click the on the desired camera Address.
38+
39+
![camera address](/img/setup_dropdown_comm_select.png)
40+
41+
### 4) Getting a camera feed running!
42+
- Now click the "Save and Restart Tracking" button to connect.
43+
- IMPORTANT: You won't see a video until you set a crop area. So click on "cropping mode" and click and drag to set a crop area.
44+
- For actual use make sure to make a box around your mouth!
45+
- After this go back to "Tracking Mode" and you should see a video feed from your camera!
46+
47+
![camera working](/img/setup_working_V.png)
48+
49+
### 5) Finished!
50+
- To click on one of the links down below to get started in game!
51+
- For people who want to hop in game, click here for [VRChat](docs\software\integrations\vrc.mdx), [Resonite](docs\software\integrations\resonite.mdx), or here for [something else](docs\software\integrations\integrations.mdx).
52+
53+
## But I want WiFi!
54+
55+
If you want WiFi, please look at our [Firmware Guide](docs\hardware\Firmware\firmware.mdx).
56+

docs/developers/developerHE/developersHE.mdx

-1
This file was deleted.

docs/developers/developerSE/developersSE.mdx

-19
This file was deleted.

docs/developers/developers.mdx

-9
This file was deleted.

docs/hardware/Firmware/firmware.mdx

+117
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,117 @@
1+
---
2+
title: Firmware
3+
sidebar_position: 2
4+
---
5+
6+
# Firmware
7+
8+
:::info
9+
If you purchased a Babble PCB (by itself, as part of the Base Kit, or the Supporter Kit) you do *NOT* need to follow the directions below IF YOU ARE USING IT IN WIRED MODE.
10+
11+
The following instructions are for users who have assembled their own hardware or people who wish to use the wireless mode of their Babble Kit.
12+
:::
13+
14+
## Setup
15+
16+
Now that you've assembled your DIY Babble Tracker, you need to flash the firmware for it. This guide uses the wired/wireless `wroom` setup, although the setup process is similar for other boards.
17+
18+
:::info
19+
At present moment wireless and wired firmware can only be used mutually exclusively, IE you can't switch them out on the fly.
20+
:::
21+
22+
### Step 1
23+
In order to flash your firmware, you'll need a copy of [VSCode](https://code.visualstudio.com/).
24+
25+
### Step 2
26+
Once VSCode has installed, you'll need to download the [platformio-ide extension](https://platformio.org/install/ide?install=vscode). You can get it from this link or by searching for it in VSCode's extension tab.
27+
28+
:::warning
29+
In testing, sister projects like [VSCodium](https://vscodium.com/) do not support platformio-ide. If you can find a workaround for this let us know!
30+
:::
31+
32+
### Step 3
33+
Download/Clone the [OpenIrirs repo](https://github.com/RamesTheGeneric/OpenIris) from EyeTrackVR's Github.
34+
35+
### Step 4
36+
Open the OpenIris repo inside of VSCode. You may get a prompt to open to an ESP workspace, if you do click on it!
37+
You should now see something along the lines of this:
38+
39+
<img src={require("@site/static/img/firmware_Start.png").default}/>
40+
41+
### Step 5
42+
At this point, click on the platformio-ide extension on the left toolbar. It's the icon with a bug!
43+
44+
At the bottom, you'll see an `env:` field followed by the firmware to build and upload. You must select the env appropriate to both your board type **and** wired/wireless type.
45+
46+
For a `wroom` board:
47+
- `env:Babble_USB-wrooms-s3` for wired
48+
- `env:Babble-wrooms-s3` for wireless
49+
50+
For Xiao Sense S3:
51+
- `env:xiaosenses3_USB_release` for wired
52+
- `env:xiaosenses3_release` for wireless
53+
54+
Other supported boards will appear in the selector in wired/wireless variants. Make sure you select the appropriate env for your board.
55+
56+
<details>
57+
<summary>If flashing wireless firmware, you'll need to set your wifi's `ssid`, `password` and `mdnsname`.</summary>
58+
59+
You can change these under the `user_config.ini` file.
60+
61+
<div style={{
62+
width: '90%',
63+
height: 'auto',
64+
margin: 'auto',
65+
display: 'block'
66+
}}>
67+
</div>
68+
<img src={require("@site/static/img/firmware_WifiConfig.png").default}/>
69+
70+
Where the `mdnsname` corresponds to the name of the device on the network. IE, a value of `babbletracker` would show up as `http://babbletracker.local`.
71+
</details>
72+
73+
Platformio-ide will then download all the needed dependencies for your selected firmware. This might take a minute!
74+
75+
<img src={require("@site/static/img/firmware_Download.png").default}/>
76+
77+
### Step 6
78+
Now, get ready to plug in your device. You'll need to put it in *Boot Mode* to write firmware to it. To do this, hold down the boot mode button on your board as you plug it in. You'll feel a *click* as the button presses in and out. On the `wroom` board, the button is pictured here:
79+
80+
Once you've plugged in the device, you can release this button.
81+
82+
<img src={require("@site/static/img/firmware_WROOM.jpg").default}/>
83+
84+
### Step 7
85+
86+
Once the above download has completed you're ready for upload! Click on the right-arrow button on the bottom ribbon, between the check mark and trash button. You'll see terminal output during the upload, if there are any errors or if the upload was successful.
87+
88+
<img src={require("@site/static/img/firmware_Upload.png").default}/>
89+
90+
### Step 8
91+
92+
To use your device, unplug it and plug it back in again to get it out of boot mode. It should work now!
93+
94+
## Troubleshooting
95+
96+
### Step 1
97+
To pull logs from your device, first download [EyeTrackVR's firmware flashing tool](https://github.com/EyeTrackVR/FirmwareFlashingTool/releases) from their Github.
98+
99+
Before moving onto the next steps, make sure your device is plugged in and/or connected (non-boot mode this time).
100+
101+
### Step 2
102+
103+
Open EyeTrackVR's firmware flashing tool. Select any firmware here, it doesn't matter. Just go to the next page.
104+
105+
<img src={require("@site/static/img/firmware_ETVR_1.png").default}/>
106+
107+
If prompted for wifi, just enter anything to move on. You don't need to deal with this either.
108+
109+
<img src={require("@site/static/img/firmware_ETVR_2.png").default}/>
110+
111+
### Step 3
112+
113+
Select your device on the corresponding COM port. Then, click on the left arrow next to the "Downloading logs..." button. Or you can download the logs and look at them in the text editor of your choice.
114+
115+
<img src={require("@site/static/img/firmware_ESP32.png").default}/>
116+
117+
For more information on how to use EyeTrackVR's firmware flashing tool, please refer to their [documentation](https://docs.eyetrackvr.dev/firmware_guide/flashing_tool).

docs/hardware/components/ESP32s.mdx

+39
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,39 @@
1+
---
2+
title: Tracker Boards
3+
---
4+
5+
# Tracker Boards
6+
7+
### Recommended:
8+
9+
- **XIAO ESP32-S3 Sense Modules**
10+
- Compact size with both wireless and wired support.
11+
- No need for an additional programmer or separate antennas.
12+
- [Buy on SeedStudio](https://seeedstudio.com/XIAO-ESP32S3-Sense-p-5639.html)
13+
14+
### Alternative Option:
15+
16+
- **Freenove ESP 32-S3 WROOM**
17+
- Slightly larger and potentially more expensive than the XIAO.
18+
- Supports both wired and wireless connections.
19+
- Does not require a separate programmer.
20+
- Lacks support for an external antenna.
21+
- [Buy on AliExpress](https://www.aliexpress.us/item/3256807112147121.html?)
22+
23+
### Budget-Friendly, Wireless-Only Option:
24+
25+
- **ESPCAM32 Modules**
26+
- A more affordable choice.
27+
- Requires a separate programmer board for flashing firmware.
28+
- Supports only wireless streaming.
29+
- May need soldering to attach external antennas.
30+
- [Buy on AliExpress](https://www.aliexpress.us/item/3256806346200289.html)
31+
32+
**Note:** The ESPCAM32 module often requires a special programmer board to flash the firmware. While our listing includes it, be sure to check if it's included when purchasing from other sources.
33+
34+
### External Antennas for ESP Modules:
35+
36+
- **External Antennas:** Recommended if you're using Vive/Tundra full body tracking or facing issues with wireless streaming.
37+
- **Small Antenna:** [Buy on AliExpress](https://www.aliexpress.us/item/3256806201357624.html)
38+
- **Large Antenna:** [Buy on AliExpress](https://www.aliexpress.us/item/3256804672416898.html)
39+
- **PCB Antenna:** [Buy on Digi-Key](https://www.digikey.com/en/products/detail/taoglas-limited/FXP72.07.0053A/2332702)

docs/hardware/components/Lighting.mdx

+48
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,48 @@
1+
---
2+
title: Lighting
3+
---
4+
5+
For Project Babble, you can use either Infrared or visible light. Each has its advantages and considerations:
6+
7+
- **Infrared Lighting:**
8+
- Less distracting as the light is not visible to the naked eye.
9+
- Susceptible to flicker from base stations if not sufficiently bright.
10+
11+
- **Visible Lighting:**
12+
- Immune to base station flicker.
13+
- Potential for distraction if the headset doesn't block light effectively.
14+
15+
Consider these factors when choosing the type of lighting for your setup
16+
17+
### Additional Note About Voltage
18+
Either 3.3V or 5V can be used to power the LEDs, however the resistors used will be different. 5V can only be used when powered over USB while 3.3V can be used with both USB and battery power.
19+
20+
## Sourcing
21+
22+
- **IR Emitters:**
23+
- 2x 5mm 850nm IR Through Hole LEDS
24+
- *(Choose "F5mm 850nm")* [AliExpress](https://www.aliexpress.us/item/3256803759925241.html?)
25+
26+
- **Resistors for IR Emitters:**
27+
- 2x 160ohm 1/4w Resistors (If using 5V)
28+
- *(Choose "160R")* [AliExpress](https://www.aliexpress.us/item/3256806544238902.html?)
29+
- 2x 82ohm 1/4w Resistors (If using 3.3V)
30+
- *(Choose "82R")* [AliExpress](https://www.aliexpress.us/item/3256806544238902.html?)
31+
32+
33+
### Visible Light Alternative:
34+
35+
- **White LEDs**
36+
- 2x 5mm White Through Hole LED (Visible Light)
37+
- *(Choose "50pcs-white") [AliExpress](https://www.aliexpress.us/item/3256807891285585.html)
38+
39+
- **Resistors for White LEDs:**
40+
- 2x 150ohm 1/4w Resistors (If using 5V)
41+
- *(Choose "150R")* [AliExpress](https://www.aliexpress.us/item/3256806544238902.html?)
42+
- 2x 68ohm 1/4w Reistors (If using 3.3V)
43+
- *(Choose "68R")* [AliExpress](https://www.aliexpress.us/item/3256806544238902.html?)
44+
45+
46+
### Additional Components:
47+
- 1x Wire to power IR emitters (28 AWG stranded wire is good general size)
48+
- [AliExpress](https://www.aliexpress.us/item/3256807801296902.html?)

docs/hardware/components/Usb Hubs.mdx

+21
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
---
2+
title: USB Hubs
3+
---
4+
5+
# USB Hubs
6+
7+
- **1x USB 3.0+ Hub**
8+
- The hub should support **Multi-TT (MTT)** if you plan to use other high-bandwidth devices along with the ESPs. **Single-TT (STT)** hubs may work if they are only used with ESP devices (e.g., Babble + ETVR).
9+
- Ensure the hub is of good quality, lightweight, compact, and has at least three ports—one for the face tracker and two for the ESP32-S3 boards.
10+
- [Buy on Amazon](https://www.amazon.com/)
11+
12+
- **USB-A to USB-C Adapters**
13+
- Make sure to have the necessary adapters if required. For instance, the Valve Index only has one USB-A port.
14+
- [Buy on Amazon](https://www.amazon.com/)
15+
16+
- **1x USB-C Cables** (as short as possible) to connect both ESPs.
17+
- Since the ESP32-S3 uses USB-C connectors, you might need USB-C to USB-A cables, depending on your USB hub configuration.
18+
19+
:::warning
20+
**Note:** USB hubs are not required if you only plan on using Projet Babble, you might need a USB hub if you also plan on using for example: [EyeTrackVR](https://docs.eyetrackvr.dev/).
21+
:::

docs/hardware/components/Wiring.mdx

+30
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
---
2+
title: Wiring Guide
3+
---
4+
5+
# Wiring Guide
6+
7+
Follow these steps to wire LEDs to the Seeed XIAO ESP32-S3 safely and effectively:
8+
9+
- **Power Options for LEDs**:
10+
- Either **3.3V** or **5V** can be used to power the LEDs.
11+
- **3.3V** is compatible with both USB and battery power.
12+
- **5V** can only be used when the ESP32 is powered via USB.
13+
14+
- **Resistor Requirements**:
15+
- For **3.3V** power: Use **82-ohm resistors** in series with the LEDs.
16+
- For **5V** power: Use **160-ohm resistors** in series with the LEDs.
17+
18+
- **Steps to Wire the LEDs**:
19+
1. Connect the **GND pin** on the ESP32 to the cathode (short leg) of the LED.
20+
2. Add an appropriate resistor (82 ohms for 3.3V, 160 ohms for 5V) in series with the anode (long leg) of the LED.
21+
3. Connect the other end of the resistor to either:
22+
- **3.3V pin** (if using 3.3V power), or
23+
- **5V pin** (if using 5V power).
24+
4. Repeat the process for additional LEDs, ensuring each has its own resistor.
25+
26+
- **Important Notes**:
27+
- Do not connect LEDs directly to the ESP32 pins without a resistor, as it may damage the LEDs or the microcontroller.
28+
- Ensure the ESP32 is correctly powered based on your selected voltage (USB or battery).
29+
30+
![Babble Wiring Guide](/img/babbleWiringGuide.png)

0 commit comments

Comments
 (0)