Crypto & fintech

This article was published on January 20, 2009

Comparing Robots.txt Files From Obama’s New Site and Bush’s Old Site


Comparing Robots.txt Files From Obama’s New Site and Bush’s Old Site
Zee
Story by

Zee

Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos, designing, listening to good music and making lurrrve.

For those of you not aware, the Robots.txt is a file that lies on the server of a website and tells search engines which parts of a site they can index and which parts they can’t.

Have a look at a comparison of Obama’s new site in comparison to Bush’s:

Obama:

picture-26

Bush:

picture-29

 and Bush’s continues to here….

Hopefully a sign of greater transparency & change indeed.

via Codeulate.