Lip-Speech to Text for the Hearing Impaired: Multi-Modal Approach Using Vision-and-Language Transformer

A Project for CNIT 581 - Introduction to Assistive Technology and Robotics Fall 2022
Instructor: Prof. Byung-Cheol Min, Ph.D. Team: Nadine, Srushti, Yi

Week 16: Blog Post #6

Fine-tuning Results & Final Demo Video!

Posted by Nadine on December 9, 2022

Week 15: Blog Post #5

Further Preprocessing & Zero-Shot Results

Posted by Nadine on December 2, 2022

Week 12: Blog Post #4

Model Architecture

Posted by Yi on November 10, 2022

Week 10: Blog Post #3

Data Preprocessing & Augmentation

Posted by Nadine on October 27, 2022

Week 8: Blog Post #2

Project Introduction

Posted by Nadine on October 14, 2022

Week 6: Blog Post #1

Launching our Project Blog!

Posted by Yi on September 27, 2022