June 2017 ~ SEO Tips & Technologies - SEO Freelancer

Monday, 19 June 2017

Why Your Site Might Not Get Indexed

Posted by Siva on 02:29 with 9 comments
Typically these kinds of issues are caused by one or more of the following reasons: Robots.txt - This text file which sits in the root of your website's folder communicates a certain number of guidelines to search engine crawlers. For instance, if your robots.txt file has this line in it; User-agent: * Disallow: / it's basically telling every crawler on the web to take a hike and not index ANY of your site's content. .htaccess - This is an invisible file which also resides in your WWW or public_html folder. You can toggle visibility...