Robots.txt Tester

Fetch and inspect the robots.txt file of any domain.