I'm trying to scrape information from an array of links using selenium. Each of them take ~2 seconds to scrape, and it adds up to quite a while.
Is it possible / worth trying to open the links in separate tabs (or sets of tabs?) in order to multitask scraping information? Is there an otherwise better method to optimize iterating through these pages?
I'm using a headless Chrome driver and Python.