# Don't crawl any archive pages, except for the main archive page User-agent: * Disallow: /?archive=1& Disallow: /index.cgi?archive=1& Disallow: /archive