Downloads: 142
Case Studies | Computer Science & Engineering | India | Volume 8 Issue 4, April 2019
Video Description and Collision Detection for Visually Impaired
Vinay Kumar Saini, Hitesh Kwatra, Himanshu Narang
Using Deep learning techniques, find a new approach that analyses a video and then present it in understandable language using NLP techniques. For most people, watching a brief video and describing what happened is an easy task. For machines, extracting the meaning from video pixels and generating natural-sounding language is a very complex problem. Solutions have been proposed for narrow domains with a small set of known actions and objects We plan to extract features for each frame, mean pool the features across the entire video and input this at every time step to the LSTM network. The LSTM outputs one word at each time step, based on the video features until it picks the end-of-sentence tag and extends them to generate sentences describing events in videos. They then use a sequence model, specifically a Recurrent Neural Network (RNN), to decode the vector into a sentence. In this work, we plan to show that interpreting a visual vector into a set of English words will work same for videos as well as static images. We did this in all the experiments, and it did help quite a lot in terms of generalization. Another set of weights that could be sensibly initialized are We, the word embeddings. We tried initializing them from a large news corpus, but no significant gains were observed, and we decided to just leave them uninitialized for simplicity. Lastly, we did some model level overfitting-avoiding techniques. We tried dropout and ensembling models, as well as exploring the size (i. e. , capacity) of the model by trading off number of hidden units versus depth. We also propose collision detection system so that along with getting what is happening around the person, it also gets a collision warning if the distance between the object and the person become smaller than a certain threshold.
Keywords: NLP, Computer Vision, Deep Learning, RNN, LSTM, Collision Detection, Object Detection
Edition: Volume 8 Issue 4, April 2019
Pages: 1306 - 1308
How to Cite this Article?
Vinay Kumar Saini, Hitesh Kwatra, Himanshu Narang, "Video Description and Collision Detection for Visually Impaired", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=ART20197124, Volume 8 Issue 4, April 2019, 1306 - 1308
Similar Articles with Keyword 'NLP'
Downloads: 102
Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015
Pages: 1772 - 1776A Survey on Facilitating Document Annotation Techniques
Priyanka C. Ghegade, Vinod S. Wadne
Downloads: 103
Research Paper, Computer Science & Engineering, India, Volume 5 Issue 3, March 2016
Pages: 1687 - 1690An Algorithm of Word Indexing Model for Document Summarization based on Perspective of Document
Meha Shah, Chetna Chand
Downloads: 105 | Weekly Hits: ⮙4
Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015
Pages: 2095 - 2097Trust Evaluation by Mining of E-commerce Feedback Comments
Priyanka Kumbhar, Manjushri Mahajan
Downloads: 107
Research Paper, Computer Science & Engineering, India, Volume 5 Issue 5, May 2016
Pages: 1954 - 1957Proposed Techniques to Remove Flaming Problems from Social Networking Sites and outcome of Na?ve Bayes Classifier for Detection of Flames
Vishakha Mal, Dr. A. J. Agrawal
Downloads: 110 | Weekly Hits: ⮙3
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 5 Issue 6, June 2016
Pages: 1121 - 1125An Efficient Framework for Spam Mail Detection in Attachments using NLP
Amol Malge, Dr. S. M. Chaware
Similar Articles with Keyword 'Computer Vision'
Downloads: 40 | Monthly Hits: ⮙1
Research Paper, Computer Science & Engineering, India, Volume 10 Issue 2, February 2021
Pages: 1673 - 1677Convolution Neural Network Based Image Recognition
Sofia Hamid, Mrigana Walia
Downloads: 103
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014
Pages: 1295 - 1299Video Analysis to Detect and Track Road Ahead for Safety
Laxmi, Dr. Neelam Srivastava
Downloads: 104
Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 8, August 2016
Pages: 1259 - 1261Survey on Edge-Preserving Decomposition-Based Single Image Haze Removal
Neha Beegam P E, Sunena Aboobakar
Downloads: 105 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 7, July 2014
Pages: 1602 - 1605Usability of Cluster Based Co-Saliency in Video Foreground Detection
Merin Joseph, Anil A. R.
Downloads: 107
Review Papers, Computer Science & Engineering, India, Volume 6 Issue 1, January 2017
Pages: 1246 - 1248Study of Content Based Image Retrieval Techniques
Rakhee M, Indu M T, Baiju Karun
Similar Articles with Keyword 'Deep Learning'
Downloads: 2 | Weekly Hits: ⮙1 | Monthly Hits: ⮙2
Research Paper, Computer Science & Engineering, India, Volume 10 Issue 5, May 2021
Pages: 720 - 724Review on Deep Learning and IoT Techniques on Corono Virus
Mansi Kambli
Downloads: 36
Student Project, Computer Science & Engineering, India, Volume 10 Issue 3, March 2021
Pages: 1677 - 1680Detecting Pneumonia from X-Ray Images using Deep Learning
Deep Piyushkumar Patel
Downloads: 40 | Monthly Hits: ⮙1
Research Paper, Computer Science & Engineering, India, Volume 10 Issue 2, February 2021
Pages: 1673 - 1677Convolution Neural Network Based Image Recognition
Sofia Hamid, Mrigana Walia
Downloads: 104
Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015
Pages: 2294 - 2297Disease Inference and Community-based Health Services
Asif Akram, Rekha Jadhav
Downloads: 115
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014
Pages: 1220 - 1226A Deep Learning Kernel K-Means Method for Change Detection in Satellite Image
Harikrishnan V, Anu Paulose
Similar Articles with Keyword 'RNN'
Downloads: 25
Research Paper, Computer Science & Engineering, India, Volume 10 Issue 3, March 2021
Pages: 1720 - 1723Key Phrase Extraction Using Recurrent Neural Network
Aakib Jabbar, Preeti Sondhi
Downloads: 114
Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014
Pages: 1270 - 1272A Literature Survey on Recurrent Neural Network and Various Techniques for Speech Recognition
Amitkumar Panchal, Ompriya Kale
Downloads: 115
Survey Paper, Computer Science & Engineering, India, Volume 9 Issue 4, April 2020
Pages: 874 - 877Generation of Indian Classical Music using Artificial Intelligence: A Survey
Bharavi U. Desai, Kunjal I. Tandel, Rahul M. Patel
Downloads: 137
Research Paper, Computer Science & Engineering, India, Volume 6 Issue 11, November 2017
Pages: 36 - 39Modified Long Short-Term Memory Recurrent Neural Network Architectures
Manish Rana, Shubham Mishra
Downloads: 142
Case Studies, Computer Science & Engineering, India, Volume 8 Issue 4, April 2019
Pages: 1306 - 1308Video Description and Collision Detection for Visually Impaired
Vinay Kumar Saini, Hitesh Kwatra, Himanshu Narang
Similar Articles with Keyword 'LSTM'
Downloads: 25
Research Paper, Computer Science & Engineering, India, Volume 10 Issue 3, March 2021
Pages: 1720 - 1723Key Phrase Extraction Using Recurrent Neural Network
Aakib Jabbar, Preeti Sondhi
Downloads: 115
Survey Paper, Computer Science & Engineering, India, Volume 9 Issue 4, April 2020
Pages: 874 - 877Generation of Indian Classical Music using Artificial Intelligence: A Survey
Bharavi U. Desai, Kunjal I. Tandel, Rahul M. Patel
Downloads: 118
Research Paper, Computer Science & Engineering, India, Volume 8 Issue 5, May 2019
Pages: 965 - 969Improvements in Enhancing Bi-Lingual Machine Translation Approach
Manish Rana, Mohammad Atique
Downloads: 137
Research Paper, Computer Science & Engineering, India, Volume 6 Issue 11, November 2017
Pages: 36 - 39Modified Long Short-Term Memory Recurrent Neural Network Architectures
Manish Rana, Shubham Mishra
Downloads: 140 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Research Paper, Computer Science & Engineering, India, Volume 7 Issue 10, October 2018
Pages: 840 - 844Forecasting Volatility with LSTM Techniques
Hemanth Kumar P, S. Basavaraj Patil
Similar Articles with Keyword 'Collision Detection'
Downloads: 2
Review Papers, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014
Pages: 2406 - 2408Optimizing the Ad-Hoc Applications in Vehicular Network: A Study
Sumeet Sekhon, Dinesh Kumar
Downloads: 111 | Weekly Hits: ⮙5
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014
Pages: 2301 - 2305Tweaking the CSMA/CD Protocal using a System Buffer
Nishant Kumar Singh
Downloads: 112 | Weekly Hits: ⮙3 | Monthly Hits: ⮙16
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 9, September 2014
Pages: 2157 - 2160Study of Packet Delivery Ratio, Collision Detection Ratio, End To End Delay during Mobility in Various Wireless Techniques Using NS2
Anju Sangwan, Harish Bedi
Downloads: 142
Case Studies, Computer Science & Engineering, India, Volume 8 Issue 4, April 2019
Pages: 1306 - 1308Video Description and Collision Detection for Visually Impaired
Vinay Kumar Saini, Hitesh Kwatra, Himanshu Narang
Similar Articles with Keyword 'Object Detection'
Downloads: 1 | Monthly Hits: ⮙1
Survey Paper, Computer Science & Engineering, India, Volume 10 Issue 5, May 2021
Pages: 948 - 951Survey on Various Image Segmentation Techniques
Babita Chauhan
Downloads: 40 | Weekly Hits: ⮙2
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014
Pages: 2623 - 2629Object Detection and Pose Tracking In Augmented Reality
Vipul P.Chauhan, Dr. Manish M. Kayasth
Downloads: 110 | Monthly Hits: ⮙8
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 5 Issue 5, May 2016
Pages: 2333 - 2338Identifying Semantic Category of Distorted Images along with Text Recognition
Anu E, Anu K S
Downloads: 112
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014
Pages: 1173 - 1177Real Time Object Detection and 3D Modeling Using Fuzzy Logic
Prerna Dahiya, Kamal Kumar Ranga
Downloads: 112 | Weekly Hits: ⮙1 | Monthly Hits: ⮙13
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015
Pages: 2613 - 2617Improved Intelligence Surveillance System for Object Detection, Classification of Human Behaviour using GMM and Open CV
Rajkumar Bhimrao Pawar, Praveen R. Barapatre