Video Description and Collision Detection for Visually Impaired
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Open Access | Fully Refereed | Peer Reviewed International Journal

ISSN: 2319-7064

Downloads: 142

Case Studies | Computer Science & Engineering | India | Volume 8 Issue 4, April 2019

Video Description and Collision Detection for Visually Impaired

Vinay Kumar Saini, Hitesh Kwatra, Himanshu Narang

Using Deep learning techniques, find a new approach that analyses a video and then present it in understandable language using NLP techniques. For most people, watching a brief video and describing what happened is an easy task. For machines, extracting the meaning from video pixels and generating natural-sounding language is a very complex problem. Solutions have been proposed for narrow domains with a small set of known actions and objects We plan to extract features for each frame, mean pool the features across the entire video and input this at every time step to the LSTM network. The LSTM outputs one word at each time step, based on the video features until it picks the end-of-sentence tag and extends them to generate sentences describing events in videos. They then use a sequence model, specifically a Recurrent Neural Network (RNN), to decode the vector into a sentence. In this work, we plan to show that interpreting a visual vector into a set of English words will work same for videos as well as static images. We did this in all the experiments, and it did help quite a lot in terms of generalization. Another set of weights that could be sensibly initialized are We, the word embeddings. We tried initializing them from a large news corpus, but no significant gains were observed, and we decided to just leave them uninitialized for simplicity. Lastly, we did some model level overfitting-avoiding techniques. We tried dropout and ensembling models, as well as exploring the size (i. e. , capacity) of the model by trading off number of hidden units versus depth. We also propose collision detection system so that along with getting what is happening around the person, it also gets a collision warning if the distance between the object and the person become smaller than a certain threshold.

Keywords: NLP, Computer Vision, Deep Learning, RNN, LSTM, Collision Detection, Object Detection

Edition: Volume 8 Issue 4, April 2019

Pages: 1306 - 1308

Share this Article

How to Cite this Article?

Vinay Kumar Saini, Hitesh Kwatra, Himanshu Narang, "Video Description and Collision Detection for Visually Impaired", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=ART20197124, Volume 8 Issue 4, April 2019, 1306 - 1308

Enter Your Email Address




Similar Articles with Keyword 'NLP'

Downloads: 102

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 1772 - 1776

A Survey on Facilitating Document Annotation Techniques

Priyanka C. Ghegade, Vinod S. Wadne

Share this Article

Downloads: 103

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 3, March 2016

Pages: 1687 - 1690

An Algorithm of Word Indexing Model for Document Summarization based on Perspective of Document

Meha Shah, Chetna Chand

Share this Article

Downloads: 105 | Weekly Hits: ⮙4

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2095 - 2097

Trust Evaluation by Mining of E-commerce Feedback Comments

Priyanka Kumbhar, Manjushri Mahajan

Share this Article

Downloads: 107

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 5, May 2016

Pages: 1954 - 1957

Proposed Techniques to Remove Flaming Problems from Social Networking Sites and outcome of Na?ve Bayes Classifier for Detection of Flames

Vishakha Mal, Dr. A. J. Agrawal

Share this Article

Downloads: 110 | Weekly Hits: ⮙3

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 5 Issue 6, June 2016

Pages: 1121 - 1125

An Efficient Framework for Spam Mail Detection in Attachments using NLP

Amol Malge, Dr. S. M. Chaware

Share this Article

Similar Articles with Keyword 'Computer Vision'

Downloads: 40 | Monthly Hits: ⮙1

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 2, February 2021

Pages: 1673 - 1677

Convolution Neural Network Based Image Recognition

Sofia Hamid, Mrigana Walia

Share this Article

Downloads: 103

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 1295 - 1299

Video Analysis to Detect and Track Road Ahead for Safety

Laxmi, Dr. Neelam Srivastava

Share this Article

Downloads: 104

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 8, August 2016

Pages: 1259 - 1261

Survey on Edge-Preserving Decomposition-Based Single Image Haze Removal

Neha Beegam P E, Sunena Aboobakar

Share this Article

Downloads: 105 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 7, July 2014

Pages: 1602 - 1605

Usability of Cluster Based Co-Saliency in Video Foreground Detection

Merin Joseph, Anil A. R.

Share this Article

Downloads: 107

Review Papers, Computer Science & Engineering, India, Volume 6 Issue 1, January 2017

Pages: 1246 - 1248

Study of Content Based Image Retrieval Techniques

Rakhee M, Indu M T, Baiju Karun

Share this Article

Similar Articles with Keyword 'Deep Learning'

Downloads: 2 | Weekly Hits: ⮙1 | Monthly Hits: ⮙2

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 5, May 2021

Pages: 720 - 724

Review on Deep Learning and IoT Techniques on Corono Virus

Mansi Kambli

Share this Article

Downloads: 36

Student Project, Computer Science & Engineering, India, Volume 10 Issue 3, March 2021

Pages: 1677 - 1680

Detecting Pneumonia from X-Ray Images using Deep Learning

Deep Piyushkumar Patel

Share this Article

Downloads: 40 | Monthly Hits: ⮙1

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 2, February 2021

Pages: 1673 - 1677

Convolution Neural Network Based Image Recognition

Sofia Hamid, Mrigana Walia

Share this Article

Downloads: 104

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2294 - 2297

Disease Inference and Community-based Health Services

Asif Akram, Rekha Jadhav

Share this Article

Downloads: 115

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 1220 - 1226

A Deep Learning Kernel K-Means Method for Change Detection in Satellite Image

Harikrishnan V, Anu Paulose

Share this Article

Similar Articles with Keyword 'RNN'

Downloads: 25

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 3, March 2021

Pages: 1720 - 1723

Key Phrase Extraction Using Recurrent Neural Network

Aakib Jabbar, Preeti Sondhi

Share this Article

Downloads: 114

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 1270 - 1272

A Literature Survey on Recurrent Neural Network and Various Techniques for Speech Recognition

Amitkumar Panchal, Ompriya Kale

Share this Article

Downloads: 115

Survey Paper, Computer Science & Engineering, India, Volume 9 Issue 4, April 2020

Pages: 874 - 877

Generation of Indian Classical Music using Artificial Intelligence: A Survey

Bharavi U. Desai, Kunjal I. Tandel, Rahul M. Patel

Share this Article

Downloads: 137

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 11, November 2017

Pages: 36 - 39

Modified Long Short-Term Memory Recurrent Neural Network Architectures

Manish Rana, Shubham Mishra

Share this Article

Downloads: 142

Case Studies, Computer Science & Engineering, India, Volume 8 Issue 4, April 2019

Pages: 1306 - 1308

Video Description and Collision Detection for Visually Impaired

Vinay Kumar Saini, Hitesh Kwatra, Himanshu Narang

Share this Article

Similar Articles with Keyword 'LSTM'

Downloads: 25

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 3, March 2021

Pages: 1720 - 1723

Key Phrase Extraction Using Recurrent Neural Network

Aakib Jabbar, Preeti Sondhi

Share this Article

Downloads: 115

Survey Paper, Computer Science & Engineering, India, Volume 9 Issue 4, April 2020

Pages: 874 - 877

Generation of Indian Classical Music using Artificial Intelligence: A Survey

Bharavi U. Desai, Kunjal I. Tandel, Rahul M. Patel

Share this Article

Downloads: 118

Research Paper, Computer Science & Engineering, India, Volume 8 Issue 5, May 2019

Pages: 965 - 969

Improvements in Enhancing Bi-Lingual Machine Translation Approach

Manish Rana, Mohammad Atique

Share this Article

Downloads: 137

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 11, November 2017

Pages: 36 - 39

Modified Long Short-Term Memory Recurrent Neural Network Architectures

Manish Rana, Shubham Mishra

Share this Article

Downloads: 140 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Research Paper, Computer Science & Engineering, India, Volume 7 Issue 10, October 2018

Pages: 840 - 844

Forecasting Volatility with LSTM Techniques

Hemanth Kumar P, S. Basavaraj Patil

Share this Article

Similar Articles with Keyword 'Collision Detection'

Downloads: 2

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 2406 - 2408

Optimizing the Ad-Hoc Applications in Vehicular Network: A Study

Sumeet Sekhon, Dinesh Kumar

Share this Article

Downloads: 111 | Weekly Hits: ⮙5

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 2301 - 2305

Tweaking the CSMA/CD Protocal using a System Buffer

Nishant Kumar Singh

Share this Article

Downloads: 112 | Weekly Hits: ⮙3 | Monthly Hits: ⮙16

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 9, September 2014

Pages: 2157 - 2160

Study of Packet Delivery Ratio, Collision Detection Ratio, End To End Delay during Mobility in Various Wireless Techniques Using NS2

Anju Sangwan, Harish Bedi

Share this Article

Downloads: 142

Case Studies, Computer Science & Engineering, India, Volume 8 Issue 4, April 2019

Pages: 1306 - 1308

Video Description and Collision Detection for Visually Impaired

Vinay Kumar Saini, Hitesh Kwatra, Himanshu Narang

Share this Article

Similar Articles with Keyword 'Object Detection'

Downloads: 1 | Monthly Hits: ⮙1

Survey Paper, Computer Science & Engineering, India, Volume 10 Issue 5, May 2021

Pages: 948 - 951

Survey on Various Image Segmentation Techniques

Babita Chauhan

Share this Article

Downloads: 40 | Weekly Hits: ⮙2

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 2623 - 2629

Object Detection and Pose Tracking In Augmented Reality

Vipul P.Chauhan, Dr. Manish M. Kayasth

Share this Article

Downloads: 110 | Monthly Hits: ⮙8

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 5 Issue 5, May 2016

Pages: 2333 - 2338

Identifying Semantic Category of Distorted Images along with Text Recognition

Anu E, Anu K S

Share this Article

Downloads: 112

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 1173 - 1177

Real Time Object Detection and 3D Modeling Using Fuzzy Logic

Prerna Dahiya, Kamal Kumar Ranga

Share this Article

Downloads: 112 | Weekly Hits: ⮙1 | Monthly Hits: ⮙13

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015

Pages: 2613 - 2617

Improved Intelligence Surveillance System for Object Detection, Classification of Human Behaviour using GMM and Open CV

Rajkumar Bhimrao Pawar, Praveen R. Barapatre

Share this Article



Top