16 lines
270 B
Plaintext
16 lines
270 B
Plaintext
// app/robots.txt
|
|
User-agent: *
|
|
Allow: /
|
|
Disallow: /api/
|
|
Disallow: /_next/
|
|
Disallow: /private/
|
|
|
|
Sitemap: https://aramejan.com/sitemap.xml
|
|
Sitemap: https://aramejan.com/blog/sitemap.xml
|
|
|
|
# Iranian search engines
|
|
User-agent: YoozBot
|
|
Allow: /
|
|
|
|
User-agent: Parsijoo
|
|
Allow: / |