# This script specifies the files and folders the website that shouldn't # be indexed by search engine spiders. #User-agent field specifies the robot, for example googlebot. In this case all robots User-agent: * #Disallow prevents the robot from indexing/downloading the specified folders Disallow: /css/ Disallow: /assets/ Disallow: /images/ Disallow: /js/ Disallow: /img/ Disallow: /emediacms/ Disallow: /lib/ Disallow: /menus/ Disallow: /plugins/ Disallow: /languages/ Disallow: /compat/ Disallow: /schema/ Disallow: /schemaPresets/ Disallow: /icons/ Disallow: /themes/ #Disallow prevents the robot from indexing any dynamic urls Disallow: /? Sitemap: http://www.rvrentalsusa.com/sitemap.xml