Save over 40% when you secure your tickets today to TNW Conference 💥 Prices will increase on November 22 →

This article was published on July 27, 2010

Quite possibly the best Robots.txt file ever.


Quite possibly the best Robots.txt file ever.

Courtesy of Last.fm, h/t Nick Halstead.

Get the TNW newsletter

Get the most important tech news in your inbox each week.