User-agent: * Disallow: /assets/ Disallow: /logs/ Disallow: /body_index.html Disallow: /footer_index.html Disallow: /left_index.html