Google’s recent declaration makes robots.txt all the more important. John Muller from Google informed that in case Google bot requests for robots.txt...