Early bird prices are coming to an end soon... ⏰ Grab your tickets before January 17

This article was published on July 27, 2010

Shareables

Quite possibly the best Robots.txt file ever.

July 27, 2010 - 5:13 pm

Courtesy of Last.fm, h/t Nick Halstead.

Story by Zee

Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos (show all) Former CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos, designing, listening to good music and making lurrrve.

Get the TNW newsletter

Get the most important tech news in your inbox each week.

Quite possibly the best Robots.txt file ever.

Get the TNW newsletter

This annoying Call of Duty: Warzone bug is absolutely killing me

Why skin tone modifiers don’t work for ?, explained by an emoji historian

Discover TNW All Access

It’s official: YouTube has canceled Rewind 2020

Bully Maguire bringing back ’emo Spiderman’ is the internet at its best