User-agent:* Disallow:/admin Disallow:/web_file Disallow:/config Disallow:/DB_Connect Disallow:/Scripts Allow:/webpage Allow:/employers Allow:/applican