Well am I ever surprised! I would have thought that inserting a robots.txt file that tells googlebot to “go away” would cause it to “not index the site.”
User-agent: *
Disallow: /
Instead, I discovered that the googlebot may still spot the site and then put up a message saying that the site exists but is not indexed. i.e. the Googlebot still publicizes the existence of the site. It makes Google look like the good guys and us look like the bad guys for putting up a robots.txt. Yay for Google liberating all online information! Boo for us trying to keep our site un-indexed until we’re ready to make it public. [Read more…]
This is a way geeky night for us engineers, and somewhat akin to the 1969 moon landing in many ways. I’m watching the Mars rover Curiosity landing right now (14 minutes delayed, of course, due to the speed of light). “Parachute deploy!” they say just now. And a minute or two later I’m watching as the JPL engineers report “Touchdown confirmed, we are safe on Mars … and … Now to see where Curiosity will take us.” The
comes thru! They’re in the 21st century now!
For almost two months I’ve been quite aware of how the US Congress wants to impose their will on the Internet as a whole. Aw, comeon—e
I wrote about this – a few months ago in “