# All robots will spider the domain

User-agent: *
Disallow:/admin/
Disallow:/mt-static/
Disallow:/scripts/