A robots.txt file helps engines like google crawl your website far more competently. It does this by steering the crawlers clear of cumbersome media or useful resource files that aren’t applicable to SEO.If you would like an in-depth think about the difference between social media and Web optimization, have a look at our put up on Search engine m