I am working on an npm package scraper library. I would like to add integration tests but I am not sure the best way to approach it.
I have an examples folder which shows how the scraper works with real world sites, and I want to add integration tests to each to prove that they work. I want to use a library called nock, which can record requests and store them as fixtures, for each external endpoint, but I am not sure if I can store fixtures (which are essentially html files) in an open source library. Similarly, I want to store snapshots of what the scraper returns from the site, but I do not know if I can store snapshots of parsed data from a website in an open source repository.
To ask in the most general way, is it frowned upon to store scraped website's content in an open source library?