The party is ON! Join us at TNW Conference 2021 in Amsterdam for face-to-face business!

Inside money, markets, and Big Tech

This article was published on January 20, 2009

    Comparing Robots.txt Files From Obama’s New Site and Bush’s Old Site

    Comparing Robots.txt Files From Obama’s New Site and Bush’s Old Site
    Zee
    Story by

    Zee

    Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos, designing, listening to good music and making lurrrve.

    For those of you not aware, the Robots.txt is a file that lies on the server of a website and tells search engines which parts of a site they can index and which parts they can’t.

    Have a look at a comparison of Obama’s new site in comparison to Bush’s:

    Obama:

    picture-26

    Bush:

    picture-29

     and Bush’s continues to here….

    Hopefully a sign of greater transparency & change indeed.

    via Codeulate.