Updating Broken? Connection Time Out

[corradokid]

I decided to update my basic image I put together as I have many time before on my RaspberryPi 4, 4GB. This time updating was taking a very very long time. I checked the status messages and see

Downloading https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretocores/ <various cores> ... failed: Connection timed out.

a few times per emulator. Seems the Pi is waiting minutes for it to time out before moving on. I figured maybe it was something from having updated my version of RetroPie over the year so I downloaded fresh official image and put it on another card, started up fine. Went to update as usual and same thing.

Did something break in the latest RetroPie? Or is the update repository down/broken?

[mitu]

The update seems to be working now, can't say for sure if something happened 3 hours ago. Do you still get errors during update ?

[corradokid]

@mitu

Something still seems to be wrong with my Pi4 4GB is connected via ethernet on 1000mbps download internet, update process asks if I'd like to update underlying OS packages, saying yes it updates the OS successfully, then it continues to the emulator cores and reaches this timeout after about 5min per timeout before moving on to the next:

= = = = = = = = = = = = = = = = = = = = =
Installing dependencies for 'mupen64plus' : N64 emulator MUPEN64Plus
= = = = = = = = = = = = = = = = = = = = =
 
 
= = = = = = = = = = = = = = = = = = = = =
Installing 'mupen64plus' : N64 emulator MUPEN64Plus
= = = = = = = = = = = = = = = = = = = = =
 
Downloading https://files.retropie.org.uk/binaries/buster/rpi4/kms/emulators/mupen64plus.tar.gz.asc ...
failed: Connection timed out.
2020-12-23 20:22:24 URL:https://files.retropie.org.uk/binaries/buster/rpi4/kms/emulators/mupen64plus.tar.gz.asc [870/870] -> "/tmp/tmp.ydOYmfpTRo/mupen64plus.tar.gz.asc" [1]
Downloading https://files.retropie.org.uk/binaries/buster/rpi4/kms/emulators/mupen64plus.tar.gz ...
failed: Connection timed out.
2020-12-23 20:24:38 URL:https://files.retropie.org.uk/binaries/buster/rpi4/kms/emulators/mupen64plus.tar.gz [2169407/2169407] -> "/tmp/tmp.ydOYmfpTRo/mupen64plus.tar.gz" [1]
mupen64plus/
mupen64plus/retropie.pkg
mupen64plus/bin/
mupen64plus/bin/mupen64plus
mupen64plus/share/

it appears the remaining mupen64plus update process is successful, then moves on to the next core.

This is the pattern for each core update check, see below with Atari800

= = = = = = = = = = = = = = = = = = = = =
Installing 'lr-atari800' : Atari 8-bit/800/5200 emulator - Atari800 port for libretro
= = = = = = = = = = = = = = = = = = = = =
 
Downloading https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-atari800.tar.gz.asc ...
failed: Connection timed out.
2020-12-23 20:40:09 URL:https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-atari800.tar.gz.asc [870/870] -> "/tmp/tmp.XcnY6Kunps/lr-atari800.tar.gz.asc" [1]
Downloading https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-atari800.tar.gz ...
failed: Connection timed out.
2020-12-23 20:42:23 URL:https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-atari800.tar.gz [314572/314572] -> "/tmp/tmp.XcnY6Kunps/lr-atari800.tar.gz" [1]
lr-atari800/
lr-atari800/COPYING
lr-atari800/retropie.pkg
lr-atari800/atari800_libretro.so

Same with Neo Geo Pocket (color) and the rest of the cores:

= = = = = = = = = = = = = = = = = = = = =
Installing 'lr-beetle-ngp' : Neo Geo Pocket(Color)emu - Mednafen Neo Geo Pocket core port for libretro
= = = = = = = = = = = = = = = = = = = = =
 
Downloading https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-beetle-ngp.tar.gz.asc ...
failed: Connection timed out.
2020-12-23 20:53:28 URL:https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-beetle-ngp.tar.gz.asc [870/870] -> "/tmp/tmp.1KfpmLu6bI/lr-beetle-ngp.tar.gz.asc" [1]
Downloading https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-beetle-ngp.tar.gz ...
failed: Connection timed out.
2020-12-23 20:55:41 URL:https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-beetle-ngp.tar.gz [107549/107549] -> "/tmp/tmp.1KfpmLu6bI/lr-beetle-ngp.tar.gz" [1]
lr-beetle-ngp/
lr-beetle-ngp/mednafen_ngp_libretro.so
lr-beetle-ngp/retropie.pkg

Maybe something isn't linked correctly? Now updating takes hours since each emulator waits ~10min for updates that time out, then continues to configure other things.

Happy to try other tweaks or suggestions.

Thanks!

[mitu]

The files are downloading, not sure what exactly is timing out.
Can you run a manual download to see a trace the traffic, with

curl -Sv https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-beetle-ngp.tar.gz.asc

and post the output ?

[corradokid]

@mitu

Sure, just ran it with results below in another terminal session while Retropie is still running updates from the previous session:

pi@retropie:~ $ curl -Sv https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-beetle-ngp.tar.gz.asc
* Expire in 0 ms for 6 (transfer 0xf68a0)
* Expire in 1 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 1 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 0 ms for 1 (transfer 0xf68a0)
* Expire in 1 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 1 ms for 1 (transfer 0xf68a0)
* Expire in 1 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 1 ms for 1 (transfer 0xf68a0)
* Expire in 1 ms for 1 (transfer 0xf68a0)
* Expire in 4 ms for 1 (transfer 0xf68a0)
* Expire in 1 ms for 1 (transfer 0xf68a0)
* Expire in 1 ms for 1 (transfer 0xf68a0)
* Expire in 4 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
* Expire in 2 ms for 1 (transfer 0xf68a0)
*   Trying 2a00:1098:0:80:1000:57:0:1...
* TCP_NODELAY set
* Expire in 149996 ms for 3 (transfer 0xf68a0)
* Expire in 200 ms for 4 (transfer 0xf68a0)
*   Trying 93.93.129.253...
* TCP_NODELAY set
* Expire in 149996 ms for 3 (transfer 0xf68a0)
* Connected to files.retropie.org.uk (93.93.129.253) port 443 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* successfully set certificate verify locations:
*   CAfile: none
  CApath: /etc/ssl/certs
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.2 (IN), TLS handshake, Certificate (11):
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
* TLSv1.2 (IN), TLS handshake, Server finished (14):
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
* TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):
* TLSv1.2 (OUT), TLS handshake, Finished (20):
* TLSv1.2 (IN), TLS handshake, Finished (20):
* SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
* ALPN, server accepted to use h2
* Server certificate:
*  subject: CN=files.retropie.org.uk
*  start date: Nov  3 19:34:24 2020 GMT
*  expire date: Feb  1 19:34:24 2021 GMT
*  subjectAltName: host "files.retropie.org.uk" matched cert's "files.retropie.org.uk"
*  issuer: C=US; O=Let's Encrypt; CN=Let's Encrypt Authority X3
*  SSL certificate verify ok.
* Using HTTP2, server supports multi-use
* Connection state changed (HTTP/2 confirmed)
* Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0
* Using Stream ID: 1 (easy handle 0xf68a0)
> GET /binaries/buster/rpi4/kms/libretrocores/lr-beetle-ngp.tar.gz.asc HTTP/2
> Host: files.retropie.org.uk
> User-Agent: curl/7.64.0
> Accept: */*
> 
* Connection state changed (MAX_CONCURRENT_STREAMS == 128)!
< HTTP/2 200 
< server: nginx
< date: Wed, 23 Dec 2020 21:39:31 GMT
< content-type: application/octet-stream
< content-length: 870
< last-modified: Tue, 15 Dec 2020 07:49:12 GMT
< etag: "5fd86a78-366"
< accept-ranges: bytes
< 
-----BEGIN PGP SIGNATURE-----

iQJOBAABCgA4FiEE3J13/4II/8Udj1DM8bAwkGo7DTEFAl/YangaHHJldHJvcGll
cHJvamVjdEBnbWFpbC5jb20ACgkQ8bAwkGo7DTFLCRAAw1ETusYdFLaxVHGP3ubE
wFb5FzDjZErbKzRy/Fujew3B51ZH6SWg4B3of/NRr4JP0cKr8HNs2xsXczcF2kQp
n+Cz46cjggO9ccgLi+iG9XtFIlAG6NHD5Yk6j7Epc+i0imiCDClF0D79RCDoi5ID
DQhRsowS1HVRwGMsv8PuVlNT+daAVr2Mj9l5DarifB6Q5AXHEx37omRf5NY2wPqw
LrS2U5EXyOIRGRVUTyR/b7hedluIVERai703fonDtHnqPeKcgsBKbxBF02oBf4Ia
3rf8H/InljkvSWEUpix0PVOh7S98T8qlEBCY39KM4UDG6zp5KQ+bJw2/YMhJzM6j
HXbttwJ2eYhQauRX9Sn6MhUy8AEnohkV0dY7MMouGODUgY0RjDFjSEz2j+Sz6Brl
ZI8AJtkPAbqCUaajwdGFEgawNXbZepSfYTFv99p0EaXeBfWLbzU5hH34uiSpjafm
wZRa0LLrAszLAmpR0+ZtY+sRrqkZpGyKVWfofAeEDuXl7ePfR3/BXhMFTYWjq11O
ywSyTd/DHlerc37ge8pfnHwJp8IU6FIRFeh+Hl3pNZnZH5aAMChZuJPpMj2Lf/EC
dY6r9NFwm5JuhK8xGkc0lIw2Q/eG9MlthGbCLmF6Yk+7EabkIFzs1Q2Xy5SUZXgP
AkSlCtFhYLEVSLs4tDdTXlA=
=sghE
-----END PGP SIGNATURE-----
* Connection #0 to host files.retropie.org.uk left intact

[mitu]

Try disabling IPv6 on the Pi and re-run the update.

[corradokid]

@mitu
That looks like it worked! Thank you so much for the quick help with the issue.

= = = = = = = = = = = = = = = = = = = = =
Installing 'lr-handy' : Atari Lynx emulator - Handy port for libretro
= = = = = = = = = = = = = = = = = = = = =
 
Downloading https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-handy.tar.gz.asc ...
2020-12-23 23:12:29 URL:https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-handy.tar.gz.asc [870/870] -> "/tmp/tmp.UgKjwjiS5o/lr-handy.tar.gz.asc" [1]
Downloading https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-handy.tar.gz ...
2020-12-23 23:12:30 URL:https://files.retropie.org.uk/binaries/buster/rpi4/kms/libretrocores/lr-handy.tar.gz [59593/59593] -> "/tmp/tmp.UgKjwjiS5o/lr-handy.tar.gz" [1]
lr-handy/
lr-handy/retropie.pkg
lr-handy/handy_libretro.so
lr-handy/README.md
/opt/retropie/libretrocores/lr-handy /home/pi