International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Open Access | Fully Refereed | Peer Reviewed

ISSN: 2319-7064




Downloads: 142

Case Studies | Computer Science & Engineering | India | Volume 8 Issue 4, April 2019


Video Description and Collision Detection for Visually Impaired

Vinay Kumar Saini, Hitesh Kwatra, Himanshu Narang


Abstract: Using Deep learning techniques, find a new approach that analyses a video and then present it in understandable language using NLP techniques. For most people, watching a brief video and describing what happened is an easy task. For machines, extracting the meaning from video pixels and generating natural-sounding language is a very complex problem. Solutions have been proposed for narrow domains with a small set of known actions and objects We plan to extract features for each frame, mean pool the features across the entire video and input this at every time step to the LSTM network. The LSTM outputs one word at each time step, based on the video features until it picks the end-of-sentence tag and extends them to generate sentences describing events in videos. They then use a sequence model, specifically a Recurrent Neural Network (RNN), to decode the vector into a sentence. In this work, we plan to show that interpreting a visual vector into a set of English words will work same for videos as well as static images. We did this in all the experiments, and it did help quite a lot in terms of generalization. Another set of weights that could be sensibly initialized are We, the word embeddings. We tried initializing them from a large news corpus, but no significant gains were observed, and we decided to just leave them uninitialized for simplicity. Lastly, we did some model level overfitting-avoiding techniques. We tried dropout and ensembling models, as well as exploring the size (i. e. , capacity) of the model by trading off number of hidden units versus depth. We also propose collision detection system so that along with getting what is happening around the person, it also gets a collision warning if the distance between the object and the person become smaller than a certain threshold.


Keywords: NLP, Computer Vision, Deep Learning, RNN, LSTM, Collision Detection, Object Detection


Edition: Volume 8 Issue 4, April 2019,


Pages: 1306 - 1308


How to Cite this Article?

Vinay Kumar Saini, Hitesh Kwatra, Himanshu Narang, "Video Description and Collision Detection for Visually Impaired", International Journal of Science and Research (IJSR), https://www.ijsr.net/get_abstract.php?paper_id=ART20197124, Volume 8 Issue 4, April 2019, 1306 - 1308

How to Share this Article?

Enter Your Email Address


Similar Articles with Keyword 'NLP'

Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 11, November 2021

Pages: 1220 - 1223

Emotion Detector and Counsellor Chatbox

Lingamgunta Nikhilesh

Share this Article

Downloads: 102

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 1772 - 1776

A Survey on Facilitating Document Annotation Techniques

Priyanka C. Ghegade, Vinod S. Wadne

Share this Article

Similar Articles with Keyword 'Computer Vision'

Downloads: 1

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 6, June 2021

Pages: 1017 - 1020

Human Computer Interface for Physically Impaired

Aayush Bhansali, Shivani Vhatkar, Shamoil Arsiwala, Aditi Srivastava, M. K. Nivangune

Share this Article

Downloads: 42

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 2, February 2021

Pages: 1673 - 1677

Convolution Neural Network Based Image Recognition

Sofia Hamid, Mrigana Walia

Share this Article

Similar Articles with Keyword 'Deep Learning'

Downloads: 1

Student Project, Computer Science & Engineering, India, Volume 10 Issue 6, June 2021

Pages: 1717 - 1724

Krashi Prabhandak (Agricultural Manager)

Prafful Mundra, A V Pavan Krishna, Swarnalatha P, Venkata Sumanth Kakollu

Share this Article

Downloads: 1

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 10, October 2021

Pages: 1137 - 1146

Time Series Visualization using Transformer for Prediction of Natural Catastrophe

Shivam Pandey, Mahek Jain

Share this Article

Similar Articles with Keyword 'RNN'

Downloads: 2 | Weekly Hits: ⮙2 | Monthly Hits: ⮙2

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 12, December 2021

Pages: 158 - 161

MLP and RNN Based Intrusion Detection System Using Machine Learning with Stochastic Optimization

Mithlesh Kumar, Gargishankar Verma

Share this Article

Downloads: 26

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 3, March 2021

Pages: 1720 - 1723

Key Phrase Extraction Using Recurrent Neural Network

Aakib Jabbar, Preeti Sondhi

Share this Article

Similar Articles with Keyword 'LSTM'

Downloads: 26

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 3, March 2021

Pages: 1720 - 1723

Key Phrase Extraction Using Recurrent Neural Network

Aakib Jabbar, Preeti Sondhi

Share this Article

Downloads: 115

Survey Paper, Computer Science & Engineering, India, Volume 9 Issue 4, April 2020

Pages: 874 - 877

Generation of Indian Classical Music using Artificial Intelligence: A Survey

Bharavi U. Desai, Kunjal I. Tandel, Rahul M. Patel

Share this Article

Similar Articles with Keyword 'Collision Detection'

Downloads: 3

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 2406 - 2408

Optimizing the Ad-Hoc Applications in Vehicular Network: A Study

Sumeet Sekhon, Dinesh Kumar

Share this Article

Downloads: 112

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 2301 - 2305

Tweaking the CSMA/CD Protocal using a System Buffer

Nishant Kumar Singh

Share this Article

Similar Articles with Keyword 'Object Detection'

Downloads: 1

Survey Paper, Computer Science & Engineering, India, Volume 10 Issue 5, May 2021

Pages: 948 - 951

Survey on Various Image Segmentation Techniques

Babita Chauhan

Share this Article

Downloads: 1

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 6, June 2021

Pages: 1017 - 1020

Human Computer Interface for Physically Impaired

Aayush Bhansali, Shivani Vhatkar, Shamoil Arsiwala, Aditi Srivastava, M. K. Nivangune

Share this Article
Top