# this should not allow a polite robot from looking into, or indexing, the # [.private] subdirectory User-agent: * Disallow: /private/ Disallow: /misc/ Disallow: /htdig/ Disallow: /prv/ Disallow: /fam/ Disallow: /texts/ Disallow: /bib/auth/ Disallow: /corpus/ Disallow: /blog/