First published on Sep 08, 2014 - Last updated on Sep 08, 2014
Verify if your website follows the proper rules
Today I found about the website www.feedthebot.com.
It provides general advice that I find to be very down to earth.
I found out that I should add in the robots.txt nofollow links for the paid adds, so that bots and spiders should not "click" on these links, generating false clicks.
Also, I need to add a "if modified since" guideline, to instruct search engines about changes in content on pages.
For the ease of use of human users (which are in fact the ones that count), I should provide a map of the website, to allow easy access to all areas of the website. At the moment the website structure is very simple so presumably this feature is not required yet.