You should definitely have a clean up robots.txt file so serps understand what to have a look at. Use XML sitemaps to tell them about your critical pages. Check for mistakes like Meta Tags that say NOINDEX or Mistaken Directions during the robots.txt file that might continue to keep research https://these-common-local-seo-mi91456.shoutmyblog.com/27969899/not-known-facts-about-avoid-these-common-seo-mistakes