FansDB SHALookup

feederbox826 · November 29, 2024, 4:51am


	Summary	FansDB SHA256 scraper
	Repository	metadata-scrapers/scrapers/Coomer/SHALookup at main · FansDB/metadata-scrapers · GitHub
	Source URL	https://fansdb.github.io/metadata-scrapers/main/index.yml
	Install	How to install scrapers via package manager

Features

A scraper for FansDB to scrape against coomer.su with SHA256 hashes

Installation

Install the following python modules

pip install --user --break-system-packages \
  emojis \
  requests \
  lxml \
  stashapp-tools

Rename config.py.example to config.py and edit it with your configuration details.

DogmaDragon · April 27, 2025, 7:25pm

github.com/FansDB/metadata-scrapers

SHALookup v2.1.0

main ← shalookup-update

opened 11:09PM - 24 Apr 25 UTC

feederbox826

+152 -43

Works on my machine, would appreciate some testing # Fixes - Removes `<p>` t…ags from description https://github.com/FansDB/metadata-scrapers/commit/ac020dd9ec85ef014f5570547a8b4a49872763a3m, hopefully addressing #5 # Adds - Image scraping support - Thanks @GayNerd (#6) - Thanks @NotMyMainUser (#8) - SHA256 lookup shortcut with filename - Supercedes https://github.com/stashapp/CommunityScrapers/pull/2285 - Adds scenes to groups (Image in groups pending upstream) # Bugfixes/ misc - Bump global validator - Fixed some .status calls that should be .status_code - Adds more verbose debug logging for SHA256 lookup

DogmaDragon · May 16, 2025, 7:44pm

DogmaDragon · May 16, 2025, 10:31pm

DogmaDragon · May 22, 2025, 3:22pm

github.com/FansDB/metadata-scrapers

fix syntax error for python >= 3.12

main ← NotMyMainUser:main

opened 10:24PM - 20 May 25 UTC

NotMyMainUser

+1 -1

On Python >= 3.12 the import of utils.py causes a SyntaxError/SyntaxWarning due …to an invalid escape sequence. Prevent this error by using raw string notation as described in https://docs.python.org/3/library/re.html > Regular expressions use the backslash character ('\') to indicate special forms or to allow special characters to be used without invoking their special meaning. This collides with Python’s usage of the same character for the same purpose in string literals; for example, to match a literal backslash, one might have to write '\\\\' as the pattern string, because the regular expression must be \\, and each backslash must be expressed as \\ inside a regular Python string literal. Also, please note that any invalid escape sequences in Python’s usage of the backslash in string literals now generate a [SyntaxWarning](https://docs.python.org/3/library/exceptions.html#SyntaxWarning) and in the future this will become a [SyntaxError](https://docs.python.org/3/library/exceptions.html#SyntaxError). This behaviour will happen even if it is a valid escape sequence for a regular expression. The solution is to use Python’s raw string notation for regular expression patterns; backslashes are not handled in any special way in a string literal prefixed with 'r'. So r"\n" is a two-character string containing '\' and 'n', while "\n" is a one-character string containing a newline. Usually patterns will be expressed in Python code using this raw string notation.

smith113 · May 24, 2025, 7:14pm

One thing that was not obvious to me: even if you are fine with the default settings for this plugin, you still need to rename/copy the example config to config.py because otherwise you get:

ERRO[2025-05-24 15:10:55] [Scrape / SHALookup]   File "C:\...\.stash\scrapers\SHALookup\SHALookup.py", line 17, in <module>
ERRO[2025-05-24 15:10:55] [Scrape / SHALookup]     import config
ERRO[2025-05-24 15:10:55] [Scrape / SHALookup] ModuleNotFoundError: No module named 'config'
ERRO[2025-05-24 15:10:55] could not unmarshal json from script output: EOF
ERRO[2025-05-24 15:10:55] scrapeSingleScene: input: scrapeSingleScene scraper SHALookup: could not unmarshal json from script output: EOF

DogmaDragon · May 24, 2025, 7:38pm

Correct. It’s done this way because including default config already pre-configured would be overwritten with each update due to how manifest packages work (they delete all files from the manifest and download fresh copies).

I clarified the installation instruction to reflect this.

feederbox826 · May 25, 2025, 3:46am

Also because the APIKEY is needed to cache SHA, set tags etc… and scrapers don’t have access to it