# NOTE: Disallow: /*? means the bot should ignore any pages with a ? in them. # Google User-agent: Googlebot # Crawl-delay: 30 -- Googlebot ignores crawl-delay Disallow: /*? # Yahoo! User-agent: Slurp Crawl-delay: 30 Disallow: /*? # Microsoft User-agent: msnbot Crawl-delay: 30 Disallow: /*? # Any other robots that might consider this file. User-agent: * Crawl-delay: 30 Disallow: /*?