Test passes if a robots.txt file can be located and is correctly marked up.