Web crawler is nothing but an important work to bring your page in-front of google. Yes, it is software run automatedly and indexed your web-page for google or other search engines. If you work SEO to bring your website on the google ranking then you must have to know about the Web Crawler. Crawler list is also known google bots, spider and many other names too.