Build and manage your own htaccess file for Apache servers.
Build and manage a robots.txt file to direct crawlers.
Build and manage a sitemap.xml file to direct robots.
See your website how a robot or crawler would see it.
How fast does your site load to the entire world?