The default crawl limit is now set at 5 million URLs in the SEO Spider, but it isn’t a hard limit, the SEO Spider is capable of crawling significantly more (with the right hardware). This is why version 9.0 now allows users to choose to save to disk in a database, which enables the SEO Spider to crawl at truly unprecedented scale for any desktop application while retaining the same, familiar real-time reporting and usability. However, storing data in memory also has downsides, notably crawling at scale. The SEO Spider has traditionally used RAM to store data, which has enabled it to have some amazing advantages helping to make it lightning fast, super flexible, and providing real-time data and reporting, filtering, sorting and search, during crawls. In our last update, we released a new user interface, in this release we have a new and extremely powerful hybrid storage engine. Our team have been busy in development working on exciting new features. I’m delighted to announce the release of Screaming Frog SEO Spider 9.0, codenamed internally as ‘8-year Monkey’.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |