[SOFT] New Scraper in the works

[kiro]

Hi Everyone, I'm currently working on a new scraper 'retroscraper' (yeah, the most original name ever).
It is currently in early alpha and I'd like to have some people helping me with the testing. It is available in Linux (working quite ok) and Windows (not tested at all). Please go to: http://77.68.23.83/download.html for more info!
Thanks!
** Just added the RPI4 version, and the --cli option to run from the command line only.

[kiro]

Good news! with a lot of help, the Windows version has been properly tested and I'm happy to say it seems to work quite well. Give it a try and let me know your thoughts!

[Clyde]

@kiro Thanks for supporting Linux. And the name may be not original, but catchy. 👍

edit: Are you planning to move it to a development platform like Github some day? It has its advantages over a normal file download. Just a suggestion.

[kiro]

@clyde Hi! Not sure, maybe one day when I feel it is in enough good shape. For the moment is advancing quite well (I based it on my previous scraper https://github.com/zayamatias/sscraper) but with a much improved fronted, and specially backend.

It'd be great if you could help me testing, the windows version is the most advanced one for the moment.

[kiro]

@clyde Hopefully the linux version will be updated in a couple of weeks when I'm back home, for the moment I have only access to a very limited windows machine.

[Clyde]

Take your time. I can't help you with the Windows version, but I may give the Linux version a try, although I'm not in any immediate need for scraping, and I'm used to and satisfied with Skyskraper. But cam certainly help you with some testing. 🙃

[kiro]

@clyde Cool! Will let you know as soon as I update the Linux version!
Thanks!

[arnaldchaves]

Perfect !

[kiro]

Linux version is now available!!, please let me know if you test and see any issues (directory mapping is not yet working on any version, be aware)

Thanks!

[Clyde]

@kiro Thanks, I will check it out. But please have patience, since I'm on vacation next week.

[kiro]

@Clyde no worries, patience is one of the few things I've got plenty of 🤣🤣

[kiro]

More news, I've added a 'Google translate' functionality, which lets you translate game descriptions to your language of choice (around 100 languages) ... give it a try and let me know your thoughts!
http://77.68.23.83/download.html

All versions (Linux/RPI/Windows) are up to date

[kiro]

Some screenshots of scrapped and translated descriptions to different alphabets (Ukrainian, Chinese traditional, Greek & Japanese), all running in retropie (linux):

If the description in the desired language exists, it will use it, otherwise, it will translate it with google. Enjoy!

[kiro]

A bit more of work this weekend, now you can download the game's bezels and you also have the option to put the default system bezel if the game's bezel is not available. This means that all games will show a bezel if run with a retroarch emulator. Also did some optimizations here and there and subdirectories are being scanned for ROMs.

If you want to help to translate the tool (it is already done by me in English, Spanish and French), drop me a message at retrsocraper[at]gmail.com and I'll set something up.

Get it here!

[kiro]

I'm running out of ideas on what features I could add to the scraper... anyone has any ideas on what they would like to have in their ideal scraper? Thanks!

[Clyde]

@kiro Hi, I haven't forgotten about you. I just didn't get around to occupy myself with it because of a "mild" COVID illness that nevertheless took me out for two weeks.

Just saying, stay tuned. 🙂

[kiro]

@Clyde Hope you're ok! let me know if you have any issues testing the software! Thanks again!

[kiro]

Hi @mitu, sorry to bother. How could I do to get my scraper into the retro-pie setup script? Is there any process that needs to be taken? or are you not accepting any more scrapers? Thanks!

[mitu]

@kiro said in [SOFT] New Scraper in the works:

Is there any process that needs to be taken?

Any modifications to RetroPie are added via the Github project, at https://github.com/RetroPie/RetroPie-Setup, either directly (by project maintainers) or via Pull Requests.

are you not accepting any more scrapers? Thanks!

No, we're open to improvements. I would advise first to open topic in the forums with installation/operations instructions so users can test it and provide feedback, before submitting it to RetroPie-Setup. Also, while providing the source for your program is not mandatory, it would be useful for users to be able to compile on their own platform without relying on a distributed binary.

I tried downloading the program from your web page, but clicking on the download link opens a 'application/json' page filled with binary data - the download link is not working properly.

[kiro]

Hi @mitu Thanks for the explanation, really appreciate it!!

I'll have a look on why you're getting that! Thanks! I've had others download without issues. Which browser/os are you using by the way?

I will provide a source for the scraper as soon as I feel it is ready to be distributed, still working on it.