Describe the feature you’d like
I have a large library of content, a small chunk of which I have managed to scrape from stashbox. I would like to be able to slowly work through matching more content, however, there’s currently not a great way for me to track which files I have already attempted to scrape, and which I haven’t. This means that every time I decide to sit down and scrape some content, I either need to remember the sort criteria and which page I was on, or sort by random and just go through and try to scrape everything again (which leads to many duplicate scraping attempts for the same content).
What would be super helpful is if some data about scraping was stored, and could be used to filter. Namely, it would be great if I could sort by last scraped date, and maybe the number of scrape attempts. Also, it might be nice to cache the results of a previous scraping attempt if results were returned (less useful, I think, and maybe less feasible?). Maybe there is also some other data that could be useful if tracked but for my purposes I think these would suffice.
I think an additional section in the “History” tab that contains information about previous scrape attempts (and maybe the actual matches, if any?) would also be nice.
Describe the benefits this would bring to existing users
Implementing this would allow users to more easily filter out content that is not currently linked to any stashbox entries but that they have already previously attempted to scrape. That way, they can focus on scraping content that they haven’t already tried to scrape before, rather than attempting to re-scrape content that previously was not found (unless that is specifically what they are trying to do).
Additionally, users could, for example, leverage the filter to only include content where scraping has previously been unsuccessful but where the last attempt was long enough ago that another attempt might be worthwhile (i.e. I haven’t tried to scrape this particular piece of content in 6 months, maybe someone has added it to stashbox since then).
Is there an existing way to achieve this goal?
I don’t think so, but I’d love to be wrong!