Comparing Robots.txt Files From Obama’s New Site and Bush’s Old Site

Comparing Robots.txt Files From Obama’s New Site and Bush’s Old Site

For those of you not aware, the Robots.txt is a file that lies on the server of a website and tells search engines which parts of a site they can index and which parts they can’t.

Have a look at a comparison of Obama’s new site in comparison to Bush’s:

Obama:

picture-26

Bush:

picture-29

 and Bush’s continues to here….

Hopefully a sign of greater transparency & change indeed.

via Codeulate.

Read next: Magento team Europe tour: Netherlands, France and Germany

Shh. Here's some distraction

Comments