WebRTC stream with Firebase SDP exchange and Python Computer Vision. pyRTCvison works with firepub, firemtx-server to apply Machine Learning / Computer Vision to live stream.
- pip install inference-gpu
- pip install firebase_admin
- (if needed) pip install torch or torchvision
Detects dog, cats, person per frame/image basis. Calculates a rolling average of detections for an approximation of activity of each during video stream. Machine learning algorithms from roboflow.
Microsoft coco model is used for predicton.
Dockerfile there to create image to upload and run from your favorite cloud service provider’s VM. Recommend checkout out firepub and firemtx-server.