User-agent: Googlebot User-agent: google User-agent: bingbot User-agent: bing User-agent: Mediapartners-Google User-agent: googleweblight User-agent: YandexBot User-agent: Facebook User-agent: applebot Disallow: /down-file/ Disallow: /check_file/ Disallow:/get_description/ Disallow:/get_permissions/ User-agent: * Disallow: /