user-agent: * disallow: * allow: /$ allow: *.html allow: *.xml disallow: /*/*