RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    1. Home
    2. Tags
    3. scraping
    Log in to post
    • All categories
    • G

      Resource cache

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support skyscraper scraping cashe
      2
      0 Votes
      2 Posts
      299 Views
      ClydeC

      The lingering 20 GB won't do anything detrimental to your system. So, if you don't need the space, I would just leave them there in the case that you'll need them sometime in the (far) future.

    • R

      Skyscraper cache location issue

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support skyscraper scraping cache usbromservice external drive
      5
      0 Votes
      5 Posts
      1k Views
      R

      @mitu Just did final test. It all worked out perfectly. Cache has been moved to the external drive using the path to retropie-mount. The only thing that was weird was after nano-ing into the config.ini, I got the same error message, even after the MicroSD was cleared of the cache. It was just a black screen with the error message at the bottom. However, after hitting ctrl + r to give a command to read a file, I just typed in config.ini into the prompt, and then the file decided to open and let me edit it. Aside from small bump, everything worked out perfectly.

    • R

      Can scraping slow down performance in emulators?

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support scraping overclock performance scrape data
      5
      0 Votes
      5 Posts
      657 Views
      ClydeC

      Good to hear, and thanks for sharing the outcome, as even "I overlooked something" can be an important hint for others. ๐Ÿ‘

    • K

      Scraping from within Retropie

      Watching Ignoring Scheduled Pinned Locked Moved General Discussion and Gaming scraping
      3
      0 Votes
      3 Posts
      137 Views
      C

      There are a few game list generators that will create a game list from your art and roms and put them nicely together is a .xml file.

      I have heard good things about Gengal though I have not used it myself.

      https://retropie.org.uk/forum/topic/9486/gengal-gamelist-xml-generator?_=1590434755524

      Hope this helps

      Rgds

      CCF

    • T

      Skyscraper

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support skyscraper name change scraping
      1
      0 Votes
      1 Posts
      214 Views
      No one has replied
    • BenMcLeanB

      Un-skraper a.k.a. the Anti-Scraper

      Watching Ignoring Scheduled Pinned Locked Moved Ideas and Development scraper scraping emulationstatio
      1
      1 Votes
      1 Posts
      172 Views
      No one has replied
    • George SpiggottG

      Skyscraper Won't Scrape One System

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support skyscraper pi4 scraping
      5
      0 Votes
      5 Posts
      136 Views
      George SpiggottG

      Thanks @mitu. Good news. I looked around but I couldn't find a log file but while I was looking I found a gamelist file and a videos folder in my Roms/Arcade folder. I deleted them and regenerated the gameslist in Skyscraper. The Arcade section now works perfectly.

      Thanks again

    • ?

      Menu not showing up

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support menu retropie scraping
      7
      0 Votes
      7 Posts
      1k Views
      mituM

      Ah, so it's not the RetroPie system that you cannot see, it's the EmulationStation menu. Did you, by any chance, switched EmulationStation to Kid mode ?

    • R

      Generic Art & Video for Games that do not Scrape

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support scraping retropie game art
      4
      0 Votes
      4 Posts
      510 Views
      R

      Fantastic! Thank you to both of you for your responses.

      AARM is a great tool! Exactly what I was looking for.

    • S

      Scraping

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support scraping skyeskraper skraper
      6
      0 Votes
      6 Posts
      560 Views
      mituM

      It's in the Games & Front End tab, you can change the folder where the ROM files are searched and also the file extensions.

      6237330e-a032-4c56-99d3-6fbbe75d3ab2-image.png

    • D

      Scraping PSX with 6 threads dreadfully slow!

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support scraping screenscraper skraper
      26
      0 Votes
      26 Posts
      5k Views
      D

      Yup, converting to CHD solved the original problem. Now itโ€™s nice and fast! Converting all PSX to CHD now which will take a while but be worth it in the end.

    • L

      Scraping in EmulationStation not working..

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support retropie es-scraping scraping screenscraper emulationstatio
      8
      0 Votes
      8 Posts
      3k Views
      L

      @mitu said in Scraping in EmulationStation not working..:

      Please add more info about your system, as detailed in https://retropie.org.uk/forum/topic/3/read-this-first.
      What scraping source are you using ? There are 2 options in EmulationStation - TheGamesDB and ScreenScraper - and the former is not functional at the moment.

      Do you know when TheGamesDB will be functional again?

      This is from the website:
      "Update:
      due to certain family commitments, we were not able to get the latest backup as of yet.
      for now, we're using a READ ONLY old backup, and the API is also back online,
      but using the prefix /v1/ which is both to get devs to explicitly make sure old data doesn't just crash their apps,
      but this prefix will remain as our main endpoint for this api going forward (aka once latest backup is restored)"

      Is this something we can change? Change it to use the prefix v1, whatever that means xD

    • Striderx99S

      The Games Database is down

      Watching Ignoring Scheduled Pinned Locked Moved General Discussion and Gaming the games datab scraping
      7
      0 Votes
      7 Posts
      738 Views
      PhilaPhan80P

      I've created a pull request for this on the EmulationStation repo -- https://github.com/RetroPie/EmulationStation/pull/630

    • B

      Having almost nothing but bad luck scraping

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support scraping skraper fail to scrape help scraping
      7
      0 Votes
      7 Posts
      1k Views
      quicksilverQ

      @bfollowell It's possible that the data you had already scraped was cached on your computer and that was why previously successful scrapes still appeared to scrape correctly and new scrapes did not.

    • B

      I need some help scraping ROM data

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support data scraping scraper
      14
      0 Votes
      14 Posts
      2k Views
      ClydeC

      @IanDaemon I think the โ€žplayingโ€œ part is much too big in this diagram. ๐Ÿ˜‰

    • m2306M

      Problem with Skyscraper, no data found or not showing up

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support skyscraper scraping
      12
      0 Votes
      12 Posts
      3k Views
      m2306M

      @muldjord ok. Thank you for a great application!

    • SmythiusS

      Run bezel project via SSH?

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support bezel project command line scraping ssh
      4
      0 Votes
      4 Posts
      881 Views
      ClydeC

      Okay, for some reason, the screen command needs an sh after the -L on a Raspbian-based Retropie. sh starts a new shell with the script in it. On my Desktop PC running Kubuntu Linux 18.04, the command works without the sh, but on my Raspberry Pi running Retropie, it needs the sh to work as intended.

      Whatever, please try this with an sh behind -L:

      screen -S bezelproject -L sh /home/pi/RetroPie/retropiemenu/bezelproject.sh
    • I

      Screenscraper.fr add images to site

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support screenscraper missing images scraping neo geo xml scraper
      3
      0 Votes
      3 Posts
      890 Views
      I

      @mitu

      Thank mitu for your response, I have got an account, I don't know were to post the missing images.

      But all of a sudden my missing image has appeared after continue attempts since yesterday of scraping the same game over and over.

      karnovr-image.png

    • C

      Scraper stopped mid-run

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support scrapper scraping
      2
      0 Votes
      2 Posts
      238 Views
      mituM

      @cwalk828 said in Scraper stopped mid-run:

      Is gamesdb down?

      It doesn't seem so, but there's a monthly quota of requests allowed per client - I think 2500 (?). If you've gone over that quota, scraping will not return any results.

    • shavecatS

      PC GAMES SCRAPING only FOLDERS

      Watching Ignoring Scheduled Pinned Locked Moved Help and Support scraping
      10
      0 Votes
      10 Posts
      958 Views
      shavecatS

      @mitu
      Guess u right :
      thanks