I'd like to "hide" my Drupal 6.X site /node/... pages from the search engines, because I am using custom paths. There seem to be several ways of doing this:
(1) robots.txt: adding "Disallow: /node$"
(2) global redirect to 301 the pages
(3) removing node pages from menu system programmatically or making them admin access only?
(4) htaccess?
I'm not sure what the pros and cons are here. My preference is using robots.txt, since I could then still maintain admin access to node/ pages by changing the access callback in the menu system
Any help much appreciated!
Doug