How to add `nofollow, noindex` all pages in robots.txt? -


i want add nofollow , noindex site whilst it's being built. client has request use these rules.

i aware of

<meta name="robots" content="noindex,nofollow">

but have access robots.txt file.

does know correct format can use apply noindex, nofollow rules via robots.txt file?

noindex , nofollow means not want site crawl in search engine.

so put code in robots.txt user-agent: * disallow: /

it means noindex , nofollow.


Comments

Popular posts from this blog

python - Operations inside variables -

Generic Map Parameter java -

arrays - What causes a java.lang.ArrayIndexOutOfBoundsException and how do I prevent it? -