International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Since Year 2012 | Open Access | Double Blind Reviewed

ISSN: 2319-7064




Downloads: 128

Dissertation Chapters | Computer Science & Engineering | India | Volume 3 Issue 4, April 2014


Mining Contents in Web Pages and Ranking of Web Pages Using Cosine Similarity

Divya C.


Abstract: Now a days internet has become a part of life because of which web pages have became a key communication and information medium for various organizations. Web pages typically contain a large amount of information that is not part of the main contents of the pages, e. g. ; banner ads, navigation bars, copy right and privacy notices, advertisements which are not related to the main content (relevant information). In this paper the system use HTML Parser to construct DOM (Document Object Model) tree from which Content Structure Tree (CST) is constructed which can easily separate the main content blocks from the other blocks. The paper also introduces a method for calculating the rank of a web page based on the content similarity between the web documents and the user query, since usually when the user searches for web pages using a key word many web pages are retrieved the user might not be knowing which web pages are most relevant to overcome this problem the web pages are ranked using Cosine Similarity and Jaccard Similarity. The Cosine Similarity and Jaccard Similarity are implemented with the stop word removal algorithm. Many experiments were conducted for both Cosine Similarity and Jaccard Similarity. The obtained results have been compared to decide which one work best. The result was that Cosine Similarity retrieved most relevant pages to the user than the Jaccard Similarity.


Keywords: Content mining, DOM tree, CST tree, TF-IDF, Cosine Similarity


Edition: Volume 3 Issue 4, April 2014,


Pages: 178 - 184


How to Cite this Article?

Divya C., "Mining Contents in Web Pages and Ranking of Web Pages Using Cosine Similarity", International Journal of Science and Research (IJSR), Volume 3 Issue 4, April 2014, pp. 178-184, https://www.ijsr.net/get_abstract.php?paper_id=20131317

How to Share this Article?






Similar Articles with Keyword 'Content mining'

Downloads: 114

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 5, May 2017

Pages: 1467 - 1471

Improve an Enhanced-Ratio Rank Algorithm based on Reading Time

Jinal V. Patel | Rimi Gupta

Share this Article

Downloads: 119 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Review Papers, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 1990 - 1993

The Recommendation System for User Interest on Web

Priyanka D. Khawale | V. S. Nandedkar [7]

Share this Article


Top