Lip Reading Using Convolutional Neural Networks with and without Pre-Trained Models

Authors : Tayyip OZCAN, Alper BASTURK

Pages : 195-201

Doi:10.17694/bajece.479891

View : 14 | Download : 7

Publication Date : 2019-04-30

Article Type : Research Paper

Abstract :Lip reading has become a popular topic recently. There is a widespread literature studies on lip reading in human action recognition. Deep learning methods are frequently used in this area. In this paper, lip reading from video data is performed using self designed convolutional neural networks insert ignore into journalissuearticles values(CNNs);. For this purpose, standard and also augmented AvLetters dataset is used train and test stages. To optimize network performance, minibatchsize parameter is also tuned and its effect is investigated. Additionally, experimental studies are performed using AlexNet and GoogleNet pre-trained CNNs. Detailed experimental results are presented.
Keywords : deep learning, convolutional neural networks, lip reading, transfer learning, human action recognition, human computer interaction, data augmentation