4 lines
37 B
Plaintext
4 lines
37 B
Plaintext
User-agent: *
|
|
Allow: /
|
|
Crawl-delay:3
|
User-agent: *
|
|
Allow: /
|
|
Crawl-delay:3
|