Keyword Crawler > Version History
Version History
Keyword Crawler
This shows you how often Keyword Crawler was updated with us over the past few months. Whenever available, we also include additional information for each update (new features, changes etc.).
version 1.1 - posted on Sep 26, 2005
- Keyword Crawler 1.1 now follow robots.txt file and meta robot file rules when found. It use HTTP Header `Content-Type` to determine document nature.
