The Noun Project. Favicon.ico Generator. HTML EMAIL BOILERPLATE v 0.5 updated 11/5. Initializr - Start an HTML5 Boilerplate project in 15 seconds! Email Standards Project. The Web Robots Pages. In a nutshell Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol.
It works likes this: a robot wants to vists a Web site URL, say Before it does so, it firsts checks for and finds: User-agent: * Disallow: / The "User-agent: *" means this section applies to all robots. A simple set of templates for any project. HTML5 Boilerplate: The web's most popular front-end template. Modernizr: the feature detection library for HTML5/CSS3. Create your Google Sitemap Online - XML Sitemaps Generator.