Submitted by kalabro on Wed, 04/16/2014 - 9:05am

Both robots.txt and sitemap.xml are recommendations. Usually you need to configure 403 HTTP status for non-public data.

The content of this field is kept private and will not be shown publicly.
About text formats

Plain text

  • Lines and paragraphs break automatically.
  • Web page addresses and email addresses turn into links automatically.