Utility scrapers

xjdieid · January 19, 2026, 7:38pm

I want to know some strange scrapers. How they work

Torrent

Scrape with URL

Filename

What homework do they have?

DogmaDragon · January 20, 2026, 1:26am

xjdieid · January 21, 2026, 6:03pm

I understand this much. Using URLs for scraping I need to scan the code beforehand, manually and quickly fill in the URL information, and then the scraper runs. That shouldn’t be the case, because you can manually scrape after filling in the URL. So, this is the correct usage. Now, regarding torrents. Assuming a 200GB file contains images and videos, what will be read from it, and how is it different from a direct download?

DogmaDragon · January 21, 2026, 8:06pm

If I recall correctly, Torrent scarper scans .torrent files for embeded metadata, which not all trackers do. Parsed metadata: title, image, details, tags, performers, date, url.

github.com/stashapp/CommunityScrapers

scrapers/torrent/torrent.py

master


      
          if b"metadata" in torrent_data:
              if b"title" in torrent_data[b"metadata"]:
                  res["title"] = decode_bytes(torrent_data[b"metadata"][b"title"])
              if b"cover url" in torrent_data[b"metadata"]:
                  res["image"] = decode_bytes(torrent_data[b"metadata"][b"cover url"])
              if b"description" in torrent_data[b"metadata"]:
                  res["details"] = process_description_bbcode(decode_bytes(torrent_data[b"metadata"][b"description"]))
              if b"taglist" in torrent_data[b"metadata"]:
                  res["tags"] = [{"name": decode_bytes(t)} for t in torrent_data[b"metadata"][b"taglist"]]
              if b"taglist" in torrent_data[b"metadata"]:
                  res["performers"]=[{"name":x} for x in process_tags_performers(torrent_data[b"metadata"][b"taglist"])]
              if b"creation date" in torrent_data:
                  res["date"] = datetime.fromtimestamp(torrent_data[b"creation date"]).strftime("%Y-%m-%d")
          if b"comment" in torrent_data:
              res["url"] = decode_bytes(torrent_data[b"comment"])