Versatile C++ game scraper: Skyscraper
-
@analoghero Yes, it appears that the problems on screenscrapers end persists and even seem to be broader than I first thought. Anyways, 2.3.2 coming up... I want this fix out there asap.
-
@muldjord Glad I could help. Have you seen this thread on GitHub?
https://github.com/sselph/scraper/issues/214
They also talk about ".hack//Link".
-
@jwcbronski Thank you, yes I glanced over that thread just earlier today. I thought the "//" was just a spelling error. But it would seem that it actually sometimes returns one and sometimes the other.
Either way... Release is ready.
-
Skyscraper 2.3.2 released: https://github.com/muldjord/skyscraper
- Added support for 'wii' and 'gc' platforms
- Added '.chd' format to a bunch of platforms
- Added more robust filtering of the faulty screenscraper 'hack-Link' results
It now looks for "hack" and "Link" and if both exist in the title it skips it. So it'll work for both ".hack-Link" and ".hack//Link". Please let me know if the issue persists in any form.
Also added two new platforms per user request and a bunch of file formats to new and existing platforms. :)Happy scraping!
-
Curious, what happens if you want to scrape the game .hack//Link?
-
@livefastcyyoung Haha, yeah, I thought about that myself and it simply won't. I could do some further checks, for instance check if the platform is "psp" and then allow it anyways, but what if other psp results are faulty? Of course there is a way to get around all of that, but frankly I don't feel like it's worth plastering my code with all sorts of weird checks, just to let people scrape that one game. :) So I hope people are ok with that. At least until screenscraper fixes the problem and I can remove the checks again.
-
Users with experience scraping, do you have edited or used the priorities.xml file, general? per platform?
Any tips about best sources for each platform?I am thinking to delete my localdb and rescrape everything, as i think i have some kind of mess after all the tests and learning about this in the last weeks.
Thanks -
@bleuge I didnt edit any of those except for amiga. Im also not sure about that. Im always using all sources.
-
By popular request Skyscraper is now upgradeable. To get the updateable release go to https://github.com/muldjord/skyscraper and follow the installation instructions. After you've installed it you can update it using the new update_skyscraper.sh script. :)
-
@muldjord I see sometimes this text in the output
'.known option 'pretend
Literal text. Is this right?
-
@bleuge I don't understand. It looks like part of a message about the "pretend" option. Maybe a spelling error in your script somewhere? That's my best suggestion.
-
@muldjord For the Skyscraper update script can I install it on top of the current script or do I need to delete everything again?
-
@sammyboy Delete everything just to be sure. Then from the next release, you can just run "update_skyscraper.sh"
-
When compiling it in the rpi3 it gives me error, in archlinux no.
-
@snock I need a bit more information than that to help you. What error? Did you install Qt5 succesfully before installing as per the instruction on the github page? Are you using the official RetroPie 4.3 image?
-
@muldjord yes . It is rare that running the script as the wiki says failed me when compiling. But doing qmake && make && sudo make install works. Thanks for your quick response.
-
@snock I would very much like to know what problems you had specifically. If there's an error in the script I need to fix it. Did the script not work for you? What was the cause? Thank you.
-
Skyscraper version 2.3.3 released: https://github.com/muldjord/skyscraper
- Added 'hue' effect which changes the hue of the image
- Added 'saturation' effect which changes the color saturation of the image
- Added 'colorize' effect which renders the image using a single hue
- Added 'rotate' effect that rotates the parent layer around the x, y or z axis
- Added layer render 'mode' attribute ('overlay', 'colordodge', 'hardlight' and so on)
- Added layer 'opacity' attribute (0-100)
- Improved front and side textures for the 'gamebox' effect
- Optimized search passes a bit
- Re-added platform checking on 'screenscraper' and added all arcade platforms as aliases
This release is mostly a polishing release. I added a bunch more compositing effects and updated the gamebox textures to be a lot more cool looking.
If you have the "update_skyscraper.sh" script (most 2.3.2 users should have it) you can get this new release simply by running that. Otherwise go to the github page and follow the instructions on there. -
Skyscraper version 2.3.4 released: https://github.com/muldjord/skyscraper
- 'gamebox' effect no longer cuts top and bottom from source layer
- 'gamebox' effect now handles side artwork that is too tall
- Optimized localdb mutexes
- Fixed issue where searchName could be empty and cause Skyscraper to stall for 15 minutes
- Now no longer runs screenscraper sha1 and md5 passes if filesize is 0
This is mostly a bugfix and polish release. Rare cases where Skyscraper would stall for 15 or more minutes should now be a thing of the past. I've also fixed it so screenscraper now no longer runs the sha1 and md5 passes if the filename in question is empty (such as the scummvm dummy files).
Happy scraping!
-
Thanks for updates and for fixing the network stall i was getting!
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.