Changes with Google Webmaster
More Efficient Search Bots
Tips for Optimized Indexing
To help with these changes, Google has offered some tips to get the most out of the new indexing system:
Use only the most common systems and technologies on your server to ensure that everything operates smoothly between different web browsers.
Use the updated Fetch and Render as Google feature in webmaster tools to see how their system renders your pages. With it, you’ll be able to identify indexing issues.
How to Test for Optimized Indexing Using Fetch As Google
Select “Fetch” under the Crawl tools, and enter your webpage URL. (If you want to render your homepage, just leave it blank). Then press “Fetch and Render,” and Google bots will begin to crawl in the webpage.
Click “Submit to Index” once the crawling is complete. Results will appear, each one labeled as “complete, “partial,” “unreachable,” or another term according to the test. (You can find more descriptions and details of Fetch as Google diagnostics here.)
Click on the results to check the blocked scripts and files. Doing so will help you see what is intentionally and unintentionally blocked by you and your server. From there, you can follow tips listed above for optimized indexing on all of your necessary web pages.
photo by Roland Molnar via Flickr.
Comments are closed.Tags: robot.txt tips, set up robot.txt