User-agent: Scrapy Disallow: / User-agent: * Disallow: /app/ Disallow: /Shared/ Disallow: /shared/ Disallow: /igra/ Disallow: /Search Disallow: /Mobile/Index/* Disallow: /Article/RecommendArticle/ Allow: /tv/$ Disallow: /tv/* Sitemap: https://www.24chasa.bg/sitemap.xml Sitemap: https://www.24chasa.bg/sitemap-rubrics.xml Sitemap: https://www.24chasa.bg/sitemap-static.xml