User-agent: * Disallow: /cgi-bin Disallow: /? Disallow: /author/ Disallow: */embed Disallow: */page/