Consolidating and bringing in the discussion from multiple locations
Which date should be used? I’m inclined to side on “created” but sometimes it’s created before scenes even publicy exist
Related to this movie scraping question, I’ve noticed that scraping Transgressive-28 | evilangel over the last few days/weeks that the duration has been increasing.
It is the sum of the duration of the movie’s (currently 4) scenes, at 1:35:30. I would guess that the movie was initially published with only 1 or 2 scenes, and since then, scenes 3 and 4 were added to the API (and therefore site) with future release dates (i.e. Coming Soon) and brought the movie duration up when rescraping the movie URL.
I bring this up because that means that the movie Duration is not a fixed value and instead appears to be calculated from the movie’s scenes, which may be added at a later date.
In my opinion, this is very similar to how the movie date (on the movie’s web page) updates over time to the date of the most recent scene published/available date (e.g. it is currently 2025-05-28 which is the published/available date of scene 2)
As both the Duration and the Date of a movie can be observed to change over time (as the scenes are added/released), I would say that the scraper should pick these values and it should be up to the user to rescrape the movie after the final scene is released to get the final Duration and Date values.
today, rescraping shows an updated movie duration, and updated movie front/back cover images. I’ve been rescraping this movie every few days as the cover image didn’t seem correct/usual, but it also demonstrates the “non-final” scenario of the Duration value while the movie has scenes that are not yet published
Interestingly, the duration of "total_length": "02:07:21" for the movie in the API, and seen on the movie page, doesn’t currently match the listed scenes durations total. I can see Isabella Salvatore and Queen Kimi on the cover but not in the scene list, so that seems like the movie will have additional scenes more than the 4 listed now.