Ability to check stash-box matches based on last updated date in scene tagger

Describe the feature you’d like

I have a large library of content, a small chunk of which I have managed to scrape from stashbox. I would like to be able to slowly work through matching more content, however, there’s currently not a great way for me to track which files I have already attempted to scrape, and which I haven’t. This means that every time I decide to sit down and scrape some content, I either need to remember the sort criteria and which page I was on, or sort by random and just go through and try to scrape everything again (which leads to many duplicate scraping attempts for the same content).

What would be super helpful is if some data about scraping was stored, and could be used to filter. Namely, it would be great if I could sort by last scraped date, and maybe the number of scrape attempts. Also, it might be nice to cache the results of a previous scraping attempt if results were returned (less useful, I think, and maybe less feasible?). Maybe there is also some other data that could be useful if tracked but for my purposes I think these would suffice.

I think an additional section in the “History” tab that contains information about previous scrape attempts (and maybe the actual matches, if any?) would also be nice.

Describe the benefits this would bring to existing users

Implementing this would allow users to more easily filter out content that is not currently linked to any stashbox entries but that they have already previously attempted to scrape. That way, they can focus on scraping content that they haven’t already tried to scrape before, rather than attempting to re-scrape content that previously was not found (unless that is specifically what they are trying to do).

Additionally, users could, for example, leverage the filter to only include content where scraping has previously been unsuccessful but where the last attempt was long enough ago that another attempt might be worthwhile (i.e. I haven’t tried to scrape this particular piece of content in 6 months, maybe someone has added it to stashbox since then).

Is there an existing way to achieve this goal?

I don’t think so, but I’d love to be wrong!

Additional context

Additionally, if tracking of previous scrape results is implemented it could pave the way for a subsequent feature request for a periodic scraping job.

The periodic job could be configured similarly to what the filters in the OP could be used for - to scrape content that has never been scraped and/or to re-scrape content which was previously unsuccessfully scraped sufficiently long ago.

This would probably also require a way to review the scrape results from the periodic job and apply the ones that match correctly (or maybe a YOLO mode that just accepts matches if they meet enough criteria)

Why not save it as a filter?

Hmmm maybe I’m misunderstanding or missing something, but I didn’t think that filters saved the page that you were on? I think a filter would ensure the same order for the scenes every time, but not your progress through that order? Also, wouldn’t the order be impacted if new scenes are added?

I don’t think this linked issue is the too relevant here, it seems to mostly be discussing a way of keeping already matched content up-to-date with the upstream stashbox instance, which isn’t really something that I was considering here. Maybe I’m missing something?