# Allow All Search Engines User-agent: * Crawl-delay: 5 # 5 seconds between requests Disallow: # Block Known Website Rippers User-agent: HTTrack Disallow: / User-agent: WebCopier Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: wget Disallow: / User-agent: curl Disallow: / User-agent: python-requests Disallow: / User-agent: libwww-perl Disallow: / Disallow: /images/ Disallow: /members/photo/ Disallow: /icons/ Disallow: /logo/ sitemap: https://www.ijsr.net/sitemap.xml Sitemap: https://www.ijsr.net/sitemap_video.xml