Quite possibly the best Robots.txt file ever.

Courtesy of Last.fm, h/t Nick Halstead.

Story by Zee

Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos (show all) Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos, designing, listening to good music and making lurrrve.

Get the TNW newsletter

Get the most important tech news in your inbox each week.

Quite possibly the best Robots.txt file ever.

Get the TNW newsletter

This app lets you experience Mac OS like it was the 90s all over again

Finally, a dating app for Tesla owners and Elon Musk bootlickers⚡️

Discover TNW All Access

Why skin tone modifiers don’t work for ?, explained by an emoji historian

This online school turned stolen MasterClass courses into a wikiHow — and it’s exactly what you need