For those of you not aware, the Robots.txt is a file that lies on the server of a website and tells search engines which parts of a site they can index and which parts they can’t.

Have a look at a comparison of Obama’s new site in comparison to Bush’s:

Obama:

picture 26 Comparing Robots.txt Files From Obamas New Site and Bushs Old Site

Bush:

picture 29 600x851 Comparing Robots.txt Files From Obamas New Site and Bushs Old Site

 and Bush’s continues to here….

Hopefully a sign of greater transparency & change indeed.

via Codeulate.