User-Agent: * Disallow: /xyf/. Disallow: /gb/ Disallow: /crack/. Disallow: /history/. Disallow: /software/. Disallow: /phpMyAdmin/. Allow: / Disallow: /ad/. Disallow: /clone/. #Disallow: /robots.txt