Join us at TNW Conference 2022 for insights into the future of tech →

The heart of tech

This article was published on July 27, 2010

    Quite possibly the best Robots.txt file ever.

    Quite possibly the best Robots.txt file ever.
    Zee
    Story by

    Zee

    Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos, designing, listening to good music and making lurrrve.

    Courtesy of Last.fm, h/t Nick Halstead.