FYI Major update to sselph/scraper

sselph

A while back I updated retropie to download a more modern version of Go, the language I write my scraper in. I did this so I could switch to using more modern features. This was needed for various reasons but tonight I switched my code to require it. Please let me know if there are issues at https://github.com/sselph/scraper/issues or you could reply here and I will probably see it.

The notes for this release are at https://github.com/sselph/scraper/releases/tag/v1.3.0

BuZz

@sselph thanks!

bleuge

Best scraper around, thanks you very much for updates.

vretro

Thank you for your continued efforts with scraper @sselph

I have a feature request I'd like to run past you.

I've found many sources of data available in scraper provide inaccurate player counts. Is it possible to have an option to always append a higher player count if a higher value exists, when you initiate additional scrapes from any source?

This way inaccurate values will more likely be replaced with accurate values. Also values which are already correct, are less ikely to be replaced with smaller inaccurate values.

Thanks

DarkWolf

Omg thank you! It was a pain for me to use the Universal XML Scraper with ScreenScraper to get the mix images.

robertybob

@vretro Basically, if player count = 0, then make it a 1 ? I'd like this too, although I guess it's not too difficult to find and replace within the XML.

vretro

@robertybob not exactly. I've edited my post to now read as follows to make it clearer “Is it possible to have an option to always append a higher player count if a higher value exists”

This option presumes the higher value to be the truth, so should overwrite lower values. It seems 1 is often used as a default, when the actual number isn't known.

/cc @sselph

sselph

@vretro This isn't something that would be trivial but it is essentially an option to merge multiple sources of information. Feel free to open an issue on github but I have to warn you that I have been busy and it might take some time to get to it.

alaindesjardins

Your scraper was super helpful for my needs. I went through all the command line arguments thoroughly and was able to get the results i wanted. I made a feature suggestion on the repo in hopes that you would consider adding options that would have made it even better. https://github.com/sselph/scraper/issues/146

Let me know if you have seen those features as they would be a boon to many users out there. Mainly, I am looking for options to add my own data to the gamelist.xml using the scraper. Anyways, if you get a chance to look at it I hope you consider adding those options :)

vretro

Thanks @sselph - it took a while, but I added a feature request over on Github:
https://github.com/sselph/scraper/issues/167