RetroPie Setup can't update/install a lot of packages

[mitu]

Thanks for the logs. Looks like the 'online check' fails when the 'new package' check is run:

+ rp_remoteFileExists https://files.retropie.org.uk/binaries/buster/rpi3/libretrocores/lr-tyrquake.tar.gz
+ local url=https://files.retropie.org.uk/binaries/buster/rpi3/libretrocores/lr-tyrquake.tar.gz
+ local ret
+ curl --max-time 5 -o /dev/null -sfI https://files.retropie.org.uk/binaries/buster/rpi3/libretrocores/lr-tyrquake.tar.gz
+ ret=28
+ [[ 28 -eq 0 ]]
+ [[ 28 -eq 22 ]]
+ return 2
+ ret=2
+ [[ 2 -ne 2 ]]
+ return 2
+ local ret=2
+ [[ 2 -eq 0 ]]
+ [[ 2 -eq 2 ]]
+ has_net=0
+ [[ 0 -eq 0 ]]
+ __ERRMSGS+=("Can't install/update $md_id - unable to connect to the internet")

The command that checks for a new version of the package is the curl line:

curl --max-time 5 -o /dev/null -sfI https://files.retropie.org.uk/binaries/buster/rpi3/libretrocores/lr-tyrquake.tar.gz

The error received (28) means a timeout was reached doing that request (https://curl.se/libcurl/c/libcurl-errors.html). If you run

time curl --max-time 5 -sfI https://files.retropie.org.uk/binaries/buster/rpi3/libretrocores/lr-tyrquake.tar.gz

time curl -sfI https://files.retropie.org.uk/binaries/buster/rpi3/libretrocores/lr-tyrquake.tar.gz

what is the output ?

[kokossexy]

@mitu said in RetroPie Setup can't update/install a lot of packages:

time curl -sfI https://files.retropie.org.uk/binaries/buster/rpi3/libretrocores/lr-tyrquake.tar.gz

Thx for the reply!

Here are my results

pi@retropie:~ $ time curl --max-time 5 -sfI https://files.retropie.org.uk/binaries/buster/rpi3/libretrocores/lr-tyrquake.tar.gz

real    0m5.115s
user    0m0.052s
sys     0m0.025s

and

pi@retropie:~ $ time curl -sfI https://files.retropie.org.uk/binaries/buster/rpi3/libretrocores/lr-tyrquake.tar.gz
HTTP/2 200
server: nginx
date: Sun, 28 Feb 2021 17:38:05 GMT
content-type: application/octet-stream
content-length: 571459
last-modified: Fri, 22 Jan 2021 13:04:44 GMT
etag: "600acd6c-8b843"
accept-ranges: bytes


real    0m5.462s
user    0m0.073s
sys     0m0.035s

Let me know if I can get any other info for you.

[mitu]

Looks like the request is just a smudge over the 5sec mark set for timeout, so the RetroPie setup scripts thinks the internet connection is not working. First request, with a 5 sec timeout, doesn't output anything, 2nd request (without any timeout) completes in a little over 5 sec time.

We may have to adjust the timeout - are you using a mobile (3G/4G) based connection by any chance ?

[kokossexy]

@mitu No 3G/4G connection.

I am behind a 50mbps VDSL line.

Anything I can do to 'speed check' my RPi?

Thanks again!

[mitu]

You can temporarily increase the timeout to 6 sec here, this requires you to modify the packages.sh in $HOME/RetroPie-Setup/scriptmodules. It's just a workaround and you should revert the modification once you've made the update.

[kokossexy]

@mitu Thx for your help.

At least I know what the issue is. Was driving me nuts trying to troubleshoot :)

I did increase the timeout and was able to finish the update without errors. I've already reverted the change and I'll wait for an official update.

Thx again!

[ExarKunIv]

@mitu cool. I have been having the same issue every time I redo my system. ( Doing alot of script building and testing).

It's been driving me crazy that it happens every time

[mitu]

Can you update now RetroPie-Setup and see if the issue re-appears during updates ?

[ExarKunIv]

@mitu seems to be working fine for me. most of my system was updated so not much has changed.
but it always seemed to aleast fail one time.

i will do a clean load on a spare card and let you know after that

[mitu]

@exarkuniv You can get the latest update log from $RetroPie-Setup/logs and post it on pastebin.com - I don't think a clean install is needed, as long as you're using the latest RetroPie-Setup script.

[ExarKunIv]

@mitu here you go. sorry i had to split it up in three parts due to the ports i have installed. i have not figured out how to have them see if they are running the current version or not

https://pastebin.com/S97f0Z8q
https://pastebin.com/pmBEPvZ9
https://pastebin.com/VNpxBgkP

[kokossexy]

@mitu Just got the 4.7.11 update.

Most of the binaries were already up to date but no timeouts / errors occurred.

Thx for the prompt fix!

PS I did some digging on the curl timeout.

Running in verbose showed the beginning of curl output being spammed by

Expire in 0 ms for 6 (transfer 0x558820d06dc0)

According to Google it is a bug on certain curl version. Maybe this is the actual cause of the increase time of the curl

[mitu]

@exarkuniv I can't find any obvious errors - I see that binary packages are mostly not updated, probably because they're already up-to-date.

[mitu]

@kokossexy said in RetroPie Setup can't update/install a lot of packages:

Running in verbose showed the beginning of curl output being spammed by
Expire in 0 ms for 6 (transfer 0x558820d06dc0)
According to Google it is a bug on certain curl version. Maybe this is the actual cause of the increase time of the curl

I don't think there's a curl error - you're just seeing some diagnostic/debug messages using verbose logging.

Thanks for the update. Let's hope this doesn't bugs users from now on. Btw, @BuZz is the one that fixed the timeout issue, not me.

[ExarKunIv]

@mitu just did a update with a clean load. went perfect. no fails or anything now.
@BuZz thanks for clearing this up so fast

[kokossexy]

@mitu , @BuZz Thank you both :)