Got it! :)
I only had to remove the category feature from Admin i.e the sample categories.
But let me know please if it has any SEO advantages? or some other important features? I am thinking not to go with Categories feature and only the tags feature...