web pages are crawled by being loaded into browser using multiple tabs parallellyWATCH OUT: more tabs you use, more computer resources (CPU, memory) will be used, and each page costs a bit disk to save the content (in IndexedDb, accessible from extensions -> Inspect views: background page).
The "spider" works in this way:
1) The current url is used as the starting point, and it's loaded again in a new tab.
2) After this page is loaded, fetch all the links on the page.
3) Get all the links on the page, including relative urls.
4) Open the extracted link parallelly in all the tabs used (by default 3, set in eventPage).
5) repeat 2-4
All source code at: https://github.com/nobodxbodon/ChromeCrawlerWildSpider
Why Download Wild Spider?
- ✅ Trusted by 36+ users worldwide
- ✅ High Rating: 5/5 stars from 1 reviews
- ✅ Latest Version: 0.0.3 - Always up to date
- ✅ Safe & Secure: Verified by Chrome Web Store
- ✅ Free to Use: No cost required
Extension Details
Type: Extension
Category: Chrome Browser Extension
Compatibility: Google Chrome Browser
Last Updated: June 2, 2021
Developer: Chrome Web Store Verified
Discover Wild Spider - The Best Chrome Extension for Your Browser
Looking for the perfect Chrome extension to enhance your browsing experience? Wild Spider is one of the most popular and highly-rated extensions available on the Chrome Web Store, trusted by over 36 users worldwide.
With an impressive 5-star rating based on 1 authentic user reviews, Wild Spider has proven its value and reliability to the Chrome community. This extension is perfect for users who want to improve their productivity, enhance their browsing security, or simply add useful functionality to their Chrome browser.
Download Wild Spider today and join thousands of satisfied users who have already discovered the benefits of this powerful Chrome extension. Installation is quick and easy - simply click the download button above to be redirected to the official Chrome Web Store where you can safely install this extension in just a few clicks.