## robots.txt for Magento Community and Enterprise ## GENERAL SETTINGS ## Enable robots.txt rules for all crawlers User-agent: * ## Crawl-delay parameter: number of seconds to wait between successive requests to the same server. ## Set a custom crawl rate if you're experiencing traffic problems with your server. # Crawl-delay: 30 ## Magento sitemap: uncomment and replace the URL to your Magento sitemap file Sitemap: https://www.funcart.in/sitemap.xml ## DEVELOPMENT RELATED SETTINGS ## Do not crawl development files and folders: CVS, svn directories and dump files Disallow: /CVS Disallow: /*.svn$ Disallow: /*.idea$ Disallow: /*.sql$ Disallow: /*.tgz$ Disallow: /*.zip$ ## GENERAL MAGENTO SETTINGS ## Do not crawl Magento admin page Disallow: /admin/ ## Do not crawl common Magento technical folders Disallow: /index.php/ Disallow: /*? Disallow: /*.php$ Disallow: /app/ Disallow: /report/ Disallow: /wishlist/ Disallow: /sendfriend/ Disallow: /review/ Disallow: /*SID= Disallow: /downloader/ Disallow: /errors/ Disallow: /fanbook Disallow: /includes/ #Disallow: /js/ Disallow: /lib/ Disallow: /pkginfo/ Disallow: /shell/ Disallow: /var/ Disallow: /vestempcp/* Disallow: /quickview/* Disallow: /ajax/* #Disallow: /skin/ ## Do not crawl common Magento files Disallow: /api.php Disallow: /cron.php Disallow: /cron.sh Disallow: /get.php Disallow: /error_log ## MAGENTO SEO IMPROVEMENTS ## Do not crawl sub category pages that are sorted or filtered. Disallow: /*?dir* Disallow: /*?dir=desc Disallow: /*?dir=asc Disallow: /*?limit=all Disallow: /*?mode* Disallow: /*?p Disallow: /*&p Disallow: /*?color Disallow: /*&order Disallow: /*?dir Disallow: /*&dir Disallow: /*?cat Disallow: /*?mode Disallow: /*&mode Disallow: /*?limit Disallow: /*&limit Disallow: /*?price Disallow: /*&price Disallow: /*___from_store Disallow: /*?type_of_ballon Disallow: /*?gender Disallow: /*?stock Disallow: /*?in-stock=1 Disallow: /*?in-stock=0 Disallow: /*?price= Disallow: /*?gender= Disallow: /*?product_list_limit Disallow: /*?product_list_order Disallow: /*?&stock Disallow: /*?size Disallow: /*?type_sunglass Disallow: /*?pattern Disallow: /*?filter Disallow: /*?type_of_barware Disallow: /*?type_of_lantern Disallow: /*?___SID Disallow: /*?bar_mats Disallow: /*?type_of_bags Disallow: /*?SID ## Do not crawl 2-nd home page copy (example.com/index.php/). Uncomment it only if you activated Magento SEO URLs. Disallow: /index.php/ ## Do not crawl links with session IDs Disallow: /*?SID= ## Do not crawl checkout and user account pages Disallow: /checkout/ Disallow: /onestepcheckout/ Disallow: /customer/ Disallow: /customer/account/ Disallow: /customer/account/login/ ## Do not crawl seach pages and not-SEO optimized catalog links Disallow: /catalog/ Disallow: /catalogsearch/ Disallow: /catalogsearch/result/ Disallow: /catalog/product/gallery/ Disallow: /catalog/product_compare/ Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ Disallow: /home-new ## SERVER SETTINGS ## Do not crawl common server technical folders and files Disallow: /cgi-bin/ Disallow: /cleanup.php Disallow: /apc.php Disallow: /memcache.php Disallow: /phpinfo.php Disallow: /test.php ## IMAGE CRAWLERS SETTINGS ## Extra: Uncomment if you do not wish Google and Bing to index your images #User-agent: Googlebot-Image #Disallow: Sitemap: https://www.funcart.in/sitemap.xml