.Google confines robots.txt support to 4 fields, clarifying its own viewpoint on unsupported directives.Google merely sustains 4 certain robots.txt areas.In need of support regulations in robots.txt will certainly be neglected.Take into consideration bookkeeping your robots.txt data in light of this upgrade.