Un-necessary pages are present on search engines ?

Question

Hi

There are some un-necessary are present in google search results for my website such as 

• Author Pages
• Category pages
• Pages like this - www.example.com/?show=137, www.example.com/?show=356

In short how can I force search engines to crawl only question pages ?

Vote this question !

 

Answer 1

Personally I would not recommend blocking any pages as they all contribute to your overall site popularity. Just give Google a bit longer to find the questions.

You can use meta robots tags (inside a custom theme) to block certain sections/pages. See related question: http://www.question2answer.org/qa/12827/recommended-robots-reduntant-indexing-search-engines-google

The other method is to block URLs with robots.txt, for example:

User-agent: *
Disallow: /users
Disallow: /user/
Disallow: /yourcategory
Disallow: /questions/yourcategory