User-agent: * Disallow: /admin/ Disallow: /engine/ Disallow: /mdb-database/db/ Disallow: /public/media/