gloose.com  
Web    Images    Directory    More »
  Crawler  --»» English                Gloose is Hobby Site and free for everyone    
Thank you for your interest in Gloose.org. gloose.comgloose.com Sponsor
In General

Index Your Website : One Yourdomainname.xxx and 10 Sub-URL's.


  • Ignore Crawled Items that doesn't have a Meta Description
    Gloose Category
  • Option 2 : Max: 10000 URL's.

    Block or remove your entire website using a robots.txt file

    • To prevent robots from crawling your site, place the following robots.txt file in your server root:

    • User-agent: *
      Disallow: /

    • User-agent: *
      Allow: /

    • For your http protocol (http://yourserver.com/robots.txt):

    • User-agent: *
      Allow: /

    • For the https protocol (https://yourserver.com/robots.txt):

    • User-agent: *
      Disallow: /

    Gloose.org Advice and Tips

    • Please do not forget the title in the main index.html of your web site.
      <html>
      <head>
      <title> GLOOSE SEARCH ENGINE
      </title>
      <META http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
      <META name="description" content="Search Engine and Web directory">
      <META name="keywords" content="search engine, search, engine, directory, web">
      <META name="robot" content="all,follow">
      </head>
      <body>
      </body>
      </html>


    Copyright © 2003-