One-Touch-Sign-to-Sign-Translation

Table of Contents

• Description
• Prerequisites
• Getting Started
• How to Run
• Demo

Description

One-Touch-Sign-to-Sign Translation is an API service for enabling Sign-to-Sign Language Translation and Sign-to-Text Interpretation for inclusive global communication.

Prerequisites

Before you begin, ensure that you have the following prerequisites:

• Azure AI Translation Credentials
• Azure Speech Credentials
• gcloud CLI
• gcloud SDK

Getting Started

To get started with the One-Touch-Sign-to-Sign-Translation project, follow these steps:

1. Install required python libraries:

pip install -r requirements.txt

2. Modify .env file for Azure AI services

Open the .env file and add the required credentials for Azure AI Translation in the SUBSCRIPTION_KEY and SUBSCRIPTION_REGION. Then add the required credentials for the Azure Text-to-Speech service in SPEECH_KEY and SPEECH_REGION

3. Add gcloud credentials for authentication to action recognition service

• Copy the limited access service_account details provided for demoing to gkey.json

4. Add gcloud to ~/.bash_profile

source '[path-to-my-home]/google-cloud-sdk/path.bash.inc'

source '[path-to-my-home]/google-cloud-sdk/completion.bash.inc'

How to Run

Start the One Touch flask web service:

python sign_translation.py

Now you can utilize the web service to enable Sign-to-Sign and Sign-to-Text following the notebook demo

Demo

You can watch a demo of our service here