If you have a little website (under ten internet pages), then I wouldn’t fret too much about both of such files. Having said that, in case you’re working with WordPress, You should utilize a plugin like Yoast Search engine optimisation to develop both of those a robots.txt file and https://knoxwuoze.blogstival.com/53477368/the-9-second-trick-for-full-seo-campaign