The Industry Cortex Web Crawler is designed to aggregate information about companies and organizations involved with industrial manufacturing and distribution. It typically crawls the following types of websites:
These data are used to help our users more easily find the right manufacturing companies to contact about their industrial needs. This information is used in the same way that other major search engines use publicly available web data.
The Industry Cortex web crawler is designed to follow all robots.txt file instructions. If you believe our crawler is misbehaving, please contact us to let us know via email.