This Week in Media, from Apple TVs to Vevo
Google Acquires Online Business Reputation Provider KikScore
Someone Help Get This iPhone Alarm Clock Design on Kickstarter

Channels
- Apple
- Apps
- Daily Dose
- Design & Dev
- Entrepreneur
- Events
- Facebook
- Gadgets
- Google
- Insider
- LifeHacks
- Media
- Microsoft
- Mobile
- Sessions
- Shareables
- Social Media
- Twitter
- Video

Editions
- Africa
- Asia
- Australia
- Canada
- Deutschland
- Europe
- India
- Latin America
- Middle East
- UK
- United States

Languages
- France
- Nederland
- Polska
- Portugal
- Romania
- Russia

Quite possibly the best Robots.txt file ever.

27th July 2010 by Zee

Courtesy of Last.fm, h/t Nick Halstead.

Picture 1433 Quite possibly the best Robots.txt file ever.

Join TNW Shareables on: Follow @shareables OR rss

About the Author

CEO of The Next Web. A fan of startups, entrepreneurship, getting things done faster, penning the occasional blog post, taking photos, designing, listening to good music and making lurrrve.

	A Day in the Life of a Developer Evangelist
	10 'Instagram for Video' Apps to Watch
	23snaps: A Private Social Network App for Parents
	This Week in Media, from Apple TVs to Vevo
	E-Commerce in the Middle East grew 300% in the Past Year
	5th Annual Over the Air Event Celebrates Turing
	Google Acquires Online Business Reputation Provider KikScore
	Thinking Digital: The UK's Answer to TED

	Facebook Pages Get Administrator Roles and Scheduled Posts
	Foursquare's New App Coming Next Week
	Funniest Ventriloquist Act Ever. Dying Laughing.
	The interesting secret stories behind 10 Apple icons
	You Might not buy the Facebook Phone, and That's Fine
	Safari Fastest Growing Browser
	Facebook Rumored To Buy Face.com For Up To $100 Million
	A Day in the Life of a Developer Evangelist

	Google Chrome Leapfrogs Internet Explorer as the Web's Top Browser
	Abraham Lincoln Filed a Patent For Facebook First
	Facebook Pages Get Administrator Roles and Scheduled Posts
	Facebook To Buy Opera? Maybe. Here's What We Hear.
	Apple's Siri: Nokia Lumia 900 Is The Best Smartphone Ever
	This Inspiring Note Greets Apple's New Hires on Their First Day
	55,000 Twitter Accounts Hacked
	Apple Linked With $113m Bid for German TV Maker Loewe

	23snaps: A Private Social Network App for Parents
	Thinking Digital: The UK's Answer to TED
	10 'Instagram for Video' Apps to Watch
	A Day in the Life of a Developer Evangelist
	Google Acquires Online Business Reputation Provider KikScore
	This Week in Media, from Apple TVs to Vevo
	Someone Help Get This iPhone Alarm Clock Design on Kickstarter
	Last Week in Asia: Googles Fights China Censors, Thai Webmaster Guilty

	The Social Media Bubble has Popped
	Facebook Pages Get Administrator Roles and Scheduled Posts
	Will Apple fill secret WWDC sessions with Siri API, Apple TV apps, Facebook or something else?
	What Happens When You Apply Every Instagram Filter To One Photo?
	Microsoft Accidentally Announces Windows 8 Release Preview Early
	This Site is a Museum of the Electronic Sounds of the Past
	Your Digital Privacy and the US Gov's Watchlist
	You Might not buy the Facebook Phone, and That's Fine

Quite possibly the best Robots.txt file ever.

About the Author

New and notable from across TNW

Samsung confirms the Galaxy S3 will launch with 5 US carriers this month

Someone Help Get This iPhone Alarm Clock Design on Kickstarter

Chicago's Catapult

This Week in Media, from Apple TVs to Vevo

Google Acquires Online Business Reputation Provider KikScore

Developers: Check Out the Latest Release of openFrameworks

23snaps: A Private Social Network App for Parents

A Day in the Life of a Developer Evangelist

5th Annual Over the Air Event Celebrates Turing

10 'Instagram for Video' Apps to Watch

E-Commerce in the Middle East grew 300% in the Past Year

Thinking Digital: The UK's Answer to TED

Partners



Save to read later		or copy the link
		Copy-paste link