Scenes being lost from stash database, only to show-up as new scene in later scans

Support
1

Hello,

I’ve been using stash for about a year now and this seems to be a recurring issue.

It doesn’t happen all at once, so I don’t notice it, but my database is losing scenes regularly, but they don’t show up when I’m scanning for awhile.

Then suddenly, all of the missing scenes will show up as though they’re new. It happened yesterday with 1000 scenes coming up as new, despite knowing they have existed for months.

I checked my database back-ups, and they haven’t been in there for at least the last month, but I’ve ran multiple scans since then.

Its particularly annoying for scenes who’s data isn’t in stashdb, or full length films that I’ve manually added the info for. I can’t really go back to an older backup as I’ve added a bunch of scenes since, so it doesn’t seem worth the hassle.

Any ideas why this keeps happening?

2

Not aware of anything that would cause scenes to randomly disappear. Some guesses:

  • you’ve been running the clean task and the video files have been moved/renamed or otherwise unable to be read while cleaning
  • possible that a plugin is causing something to be removed, but I’m not aware of any specific
3

running the clean task and the video files have been moved/renamed

You mean, the clean task ran without running a scan task first? When I rename a file and rescan, it results in a “duplicate” scene, with one of the duplicates pointing to a no longer existing path. Subsequent clean task remove the duplicate with the old path.

But that’s my concern with the clean task as well; it is not very convenient to see what the destructive action is about to be taken (need to execute a dry run, examine the logs, find the affected scenes, then re-run an actual clean).

I wonder if it is possible to have the clean task mark the scenes to be deleted (e.g. with a dedicated tag). The user can then review the operation (by filtering with this tag) and complete the deletion (“Select All” and then “Delete”).

4

I’m currently working on improvements to the clean task. It’s been in need of improvement for a while.

5

I’ve never ran the clean task on my current setup, so I don’t think the issue is that.

I also don’t move files around or rename them. Once things enter the folder that stash can scan, they remain unchanged.

I setup a task on my server to keep a log of the scene count in stash every day and when I checked that, it will randomly drop off by a few hundred scenes for no real reason. I can check my stash logs on the days it happened and nothing out of the ordinary will have gone on.

I don’t notice the scene count in stash going down as I don’t keep a mental note of it, so I only notice loads of scenes have gone missing when I run a scan after adding a few new scenes and instead of having 5 or 6 unorganised files, I’ve suddenly got over 1000 of them.

I did setup a task to start making back-ups of the database, but since its not something that’s happening weekly, by the time I notice I’ve usually added a bunch of new content, and I don’t fancy trying to merge 2 databases together.

I’ve pulled the backup from the day before the scenes show back up, and those titles aren’t in there at all, so its not like its lost the location, the whole entry will be gone.