Hello friends...
I have a problem in my website, I have found that some of my pages became non indexed, and the number of these pages still increasing, the problem is these pages are not only tags, they are articles pages in my website.
And when I tried to test the robot text of my website on google search console I also found there is no robot txt in my search console because I always depend on the automated Google's robots to index what it wants and no index what it doesn't want, without using any other robots.
So please if you have any recommended codes for robots txt that most of people use it share with me and tell me where I can put the robot txt step by step.
