MathesonBuckingham855

Many folks believe that by employing a robots.txt file on their website they are defending pages and folders from thieves and hackers. In truth it is completely the opposite! robots.txt opens up an enormous security hole that hackers and theives will use to very easily obtain access to the parts of your site that you do not want them to.

What is robots.txt?

robots.txt is a file that you create and up...

robots.txt is possibly the most miss understood file that a site can contain.

Several individuals think that by utilizing a robots.txt file on their site they are safeguarding pages and folders from thieves and hackers. In reality it is absolutely the opposite! robots.txt opens up an huge safety hole that hackers and theives will use to very easily gain access to the parts of your website that you do not want them to.

What is robots.txt?

robots.txt is a file that you produce and upload to your websites root directory that is utilized by search engine spiders to determine which parts of your web site they really should index and which folders/pages that you, the web site owner,

don't want listed in search engine indexes.

Why would not want pages indexed?

There are many causes why you may not want search engines to index pages on your website, such as private membership pages or exclusive training pages and such like.

If you are an Internet Marketer selling your own ebook or other digital item, you wouldn't want your thank you pages indexed either!

And this is where the misunderstanding comes to the fore, and robots.txt becomes your foe.

Several on-line marketers who supply ebooks or other digital items for instant download will list their download thank you pages in the robots.txt file due to the fact they naturally do not want these pages indexed in search engines.

By employing robots.txt this way even though, you will be opening up your product to anyone who has a slight bit of knowledge about how the file functions.

robots.txt is easily readable by any human that opens a browser and types in and if you have listed your thank you pages, all they have to do is go to that url and take your product(s)!

It is that simple!

And I am residing proof that this performs, as this is specifically what happened to me. I had listed my thank you pages in robots.txt and thought that they were risk-free from hackers and thieves, then 1 day I was checking my internet website stats and BAM, an individual had been to each single thank you page, and taken every little thing.

The moral is, don't list any URL in robots.txt that you do not want humans to have free of charge access to. Use robots.txt with excellent caution and secure your thank you pages making use of committed software. fleetwood manufacturing