VelasquezBarreras936

Many individuals think that by employing a robots.txt file on their web site they are protecting pages and folders from thieves and hackers. In reality it is absolutely the opposite! robots.txt opens up an enormous safety hole that hackers and theives will use to easily acquire access to the parts of your site that you do not want them to.

What is robots.txt?

robots.txt is a file that you produce and up...

robots.txt is possibly the most miss understood file that a site can contain.

Numerous men and women assume that by using a robots.txt file on their internet site they are guarding pages and folders from thieves and hackers. In fact it is completely the opposite! robots.txt opens up an enormous safety hole that hackers and theives will use to easily obtain access to the parts of your site that you don't want them to.

What is robots.txt?

robots.txt is a file that you produce and upload to your sites root directory that is utilized by search engine spiders to decide which parts of your internet site they should index and which folders/pages that you, the website owner,

do not want listed in search engine indexes.

Why would not want pages indexed?

There are several reasons why you could not want search engines to index pages on your internet site, such as private membership pages or exclusive education pages and such like.

If you are an World wide web Marketer selling your own ebook or other digital item, you wouldn't want your thank you pages indexed either!

And this is where the misunderstanding comes to the fore, and robots.txt becomes your foe.

Several online marketers who offer ebooks or other digital goods for instant download will list their download thank you pages in the robots.txt file because they clearly don't want individuals pages indexed in search engines.

By using robots.txt this way although, you will be opening up your product to anybody who has a slight bit of understanding about how the file functions.

robots.txt is effortlessly readable by any human that opens a browser and kinds in and if you have listed your thank you pages, all they have to do is go to that url and take your item(s)!

It really is that easy!

And I am residing proof that this functions, as this is specifically what occurred to me. I had listed my thank you pages in robots.txt and thought that they had been safe from hackers and thieves, then one day I was checking my web website stats and BAM, someone had been to each single thank you page, and taken anything.

The moral is, do not list any URL in robots.txt that you do not want humans to have free access to. Use robots.txt with excellent caution and safe your thank you pages utilizing committed software. air conveyor system