Rub shoulders with leading experts and industry disruptors at TNW Conference →

The heart of tech

This article was published on July 27, 2010


    Quite possibly the best Robots.txt file ever.

    Quite possibly the best Robots.txt file ever.
    Zee
    Story by

    Zee

    Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos, designing, listening to good music and making lurrrve.

    Courtesy of Last.fm, h/t Nick Halstead.