# The robots.txt file is used to control how search engines index your live URLs. # See http://www.robotstxt.org/wc/norobots.html for more information. User-agent: * Disallow: /api/ Disallow: /admin/ Disallow: /images/ Disallow: /account/ # Sitemap: http:/bylawyers.com.au/sitemap/sitemap.xml user-agent: AhrefsBot disallow: / User-agent: TurnitinBot Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: MJ12bot Disallow: / User-agent: UnwindFetchor Disallow: / User-agent: MetaURI Disallow: / User-agent: BLEXBot Disallow: / User-agent: Yandex Disallow: / User-agent: Baiduspider Disallow: /