User-agent: * Disallow: /auth/* Disallow: /admin/* Disallow: /test/* Disallow: /api/* Disallow: /static/*