RabbHoeft763

Numerous folks assume that by using a robots.txt file on their site they are protecting pages and folders from thieves and hackers. In fact it is completely the opposite! robots.txt opens up an enormous security hole that hackers and theives will use to effortlessly gain access to the parts of your site that you don't want them to.

What is robots.txt?

robots.txt is a file that you generate and up...

robots.txt is possibly the most miss understood file that a website can contain.

A lot of individuals think that by utilizing a robots.txt file on their web site they are safeguarding pages and folders from thieves and hackers. In truth it is entirely the opposite! robots.txt opens up an enormous security hole that hackers and theives will use to effortlessly gain access to the parts of your site that you don't want them to.

What is robots.txt?

robots.txt is a file that you produce and upload to your web sites root directory that is utilized by search engine spiders to figure out which parts of your internet site they must index and which folders/pages that you, the website owner,

do not want listed in search engine indexes.

Why would not want pages indexed?

There are a lot of causes why you could not want search engines to index pages on your web site, such as private membership pages or exclusive education pages and such like.

If you are an Internet Marketer selling your own ebook or other digital item, you would not want your thank you pages indexed either!

And this is exactly where the misunderstanding comes to the fore, and robots.txt becomes your foe.

Several online marketers who supply ebooks or other digital items for instant download will list their download thank you pages in the robots.txt file because they clearly don't want these pages indexed in search engines.

By using robots.txt this way although, you will be opening up your product to any individual who has a slight bit of information about how the file functions.

robots.txt is effortlessly readable by any human that opens a browser and types in and if you have listed your thank you pages, all they have to do is go to that url and take your item(s)!

It really is that simple!

And I am residing proof that this functions, as this is exactly what happened to me. I had listed my thank you pages in robots.txt and believed that they were protected from hackers and thieves, then one particular day I was checking my web internet site stats and BAM, someone had been to each and every single thank you web page, and taken every thing.

The moral is, do not list any URL in robots.txt that you do not want people to have free of charge access to. Use robots.txt with excellent caution and secure your thank you pages using dedicated computer software. air conveying systems