How to add `nofollow, noindex` all pages in robots.txt? -
i want add nofollow
, noindex
site whilst it's being built. client has request use these rules.
i aware of
<meta name="robots" content="noindex,nofollow">
but have access robots.txt
file.
does know correct format can use apply noindex, nofollow
rules via robots.txt
file?
noindex , nofollow means not want site crawl in search engine.
so put code in robots.txt user-agent: * disallow: /
it means noindex , nofollow.
Comments
Post a Comment