how do you get faster write speeds to SSD only getting 24mb/s
-
@comet424 Not an expert but here's my experience setting up my plex nas with a 14TB usb hdd on another pi4.
I was getting around 20MB/s transfers from ethernet on buster. I'm not sure what did it, but then I started over using bullseye and used the "big_writes" (no quotes) option in fstab and that increased it to around 40MB/s. It's not much but I'll take it. Btw, bullseye is not supported on retropie right now so I'd try the "big_writes" option.
-
how do i set that up? ive only done the step by step article i did a how to setup NEspi4 and how you get it to work with retropie but i had a 250 and 500gb but it worked fine... . but seems when i jumped to a 2tb to put all roms on it seem to slow as molases..
how do you do the big write.. would be also nice if we had a link that had all the. roms.. so we could just extract to a ssd like a master iso
-
@comet424 said in how do you get faster write speeds to SSD only getting 24mb/s:
how do you do the big write.. would be also nice if we had a link that had all the. roms.. so we could just extract to a ssd like a master iso
There is not ROM linking in the forums - see the forum rules https://retropie.org.uk/forum/topic/2/forum-rules
You should first try to check the speed of your disk locally (without file sharing) using
hdparm, see https://askubuntu.com/questions/87035/how-to-check-hard-disk-performance.Using
ntfsalso may be an issue, since the write support in Linux viafuse(userspace filesystem) will not be the same as usingfat32or a native Linux filesystem. -
@comet424 like mitu said at the bottom of the forum don’t use ntfs. I haven’t actually put everything into action yet but I did a lot of research and I do remember seeing not to use that format as it will affect performance.
-
ah ok ill check out link
i did try formating the 2TB in Fat in my Unraid Box but it formated but it was unmountable formatting FAT wouldnt format 2TB right
and then i googleed.. and it said Linux 5 and up has ntfs full support doesnt retropie use Linux 5+?
so how can i format it then in retropie to get the 2TB to see Fat? or would be better ExFat? as i was able to mount that in Unraid ExFat for 2tb
do you guys fill a 2TB? or find 1TB big enough?
i didnt know from that link kodi was to watch pirated videos .. i seen i on my unraid has the kodi /LibreElece/OpenElece
learn something new everydayand didnt know bios's and such not legal either..
-
i ran the dd program on the bottom of that forum
pi@retropie:~ $ dd if=/dev/zero of=./largefile bs=1M count=1024 1024+0 records in 1024+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 45.0954 s, 23.8 MB/spi@retropie:~ $ sudo sh -c "sync && echo 3 > /proc/sys/vm/drop_caches" pi@retropie:~ $ dd if=./largefile of=/dev/null bs=4k 262144+0 records in 262144+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 25.6095 s, 41.9 MB/s pi@retropie:~ $and i running a WD 2tb SSD speeds up to what 550mb/s
but thats why i went ntfs.. cuz when i googled linux should have full support in kernel for ntfs least thats what i read unless thats a different version?
-
@comet424 said in how do you get faster write speeds to SSD only getting 24mb/s:
and then i googleed.. and it said Linux 5 and up has ntfs full support doesnt retropie use Linux 5+?
Can you please provide a source link ? Not sure what Linux 5 is suppose to mean.
so how can i format it then in retropie to get the 2TB to see Fat? or would be better ExFat? as i was able to mount that in Unraid ExFat for 2tb
You can format it on a PC with ExFat or from Linux with the command line
mkfs.exfatcommand.sudo apt -y install exfat-utils sudo mkfs.exfat /dev/sda1Warning - formatting will erase all existing data on the disk !
-
wont let me post correctly
https://www.theregister.com/2021/10/13/how_ntfs_finally_made_it/#:~:text=Starting with the Linux 5.15,FAT)%20file%20system%20across%20Windows.here it says as if linux 5.5 version ntfs fully supported
but maybe fully supported and getting retropie to access at full speed 2 different thingsStarting with the Linux 5.15 kernel, NTFS is finally being fully supported in Linux. This journey hasn't been easy. Microsoft introduced NTFS, a proprietary – naturally – journaling file system in Windows NT 3.1 in 1993. From there, it replaced 1977's File Allocation Table (FAT) file system across Windows.Linux creator Linus Torvalds has agreed to include Paragon Software's NTFS3 kernel driver, giving the Linux kernel 5.15 release improved support for Microsoft's NTFS file system. But he also had some process and security lessons to offer developers about how to code submissions to the kernel should be made.i did see in another link
to use ntfs-3gfor for the fstab
would that fix things? adding -3g -
i guess retropie doesnt fully support ntfs
above says Linux 5.15 kernal is fully supported
but when i logged into retropie
it only runs 5.10.63 so its not fully supported yet.. i guess once retropie upgrades to 5.15 maybe then ntfs gets the fully speeds
i formated to exfat but it didnt take
pi@retropie:~ $ df -h -T Filesystem Type Size Used Avail Use% Mounted on /dev/root ext4 117G 4.5G 108G 4% / devtmpfs devtmpfs 1.8G 0 1.8G 0% /dev tmpfs tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs tmpfs 1.9G 9.4M 1.9G 1% /run tmpfs tmpfs 5.0M 4.0K 5.0M 1% /run/lock tmpfs tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/mmcblk0p1 vfat 256M 49M 207M 20% /boot tmpfs tmpfs 384M 0 384M 0% /run/user/1000pi@retropie:~ $ ls -l /dev/disk/by-uuid/ total 0 lrwxrwxrwx 1 root root 10 Feb 28 15:15 5BAF-3224 -> ../../sda1 lrwxrwxrwx 1 root root 15 Feb 28 15:15 8988cf8f-d459-476f-9a4a-16c56702dc40 -> ../../mmcblk0p2 lrwxrwxrwx 1 root root 15 Feb 28 15:15 C367-3F28 -> ../../mmcblk0p1proc /proc proc defaults 0 0 PARTUUID=e22bcd10-01 /boot vfat defaults 0 2 PARTUUID=e22bcd10-02 / ext4 defaults,noatime 0 1 # a swapfile is not a swap partition, no line here # use dphys-swapfile swap[on|off] for that UUID=5BAF-3224 /home/pi/RetroPie exfat nofail,user,uid=pi,gid=pi 0 2pi@retropie:~ $ ls -l /dev/disk/by-uuid/ total 0 lrwxrwxrwx 1 root root 10 Feb 28 15:17 5BAF-3224 -> ../../sda1 lrwxrwxrwx 1 root root 15 Feb 28 15:17 8988cf8f-d459-476f-9a4a-16c56702dc40 -> ../../mmcblk0p2 lrwxrwxrwx 1 root root 15 Feb 28 15:17 C367-3F28 -> ../../mmcblk0p1 pi@retropie:~ $ sudo mkfs.exfat /dev/sda1 mkexfatfs 1.3.0 Creating... done. Flushing... done. File system created successfully. pi@retropie:~ $ df -h -T Filesystem Type Size Used Avail Use% Mounted on /dev/root ext4 117G 4.5G 108G 4% / devtmpfs devtmpfs 1.8G 0 1.8G 0% /dev tmpfs tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs tmpfs 1.9G 9.4M 1.9G 1% /run tmpfs tmpfs 5.0M 4.0K 5.0M 1% /run/lock tmpfs tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/mmcblk0p1 vfat 256M 49M 207M 20% /boot tmpfs tmpfs 384M 0 384M 0% /run/user/1000 pi@retropie:~ $ -
so i dont have that hdparm program not sure how to install it
i did get it to format and mount using sudo mkfs.fat
pi@retropie:~ $ df -h -T Filesystem Type Size Used Avail Use% Mounted on /dev/root ext4 117G 4.5G 108G 4% / devtmpfs devtmpfs 1.8G 0 1.8G 0% /dev tmpfs tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs tmpfs 1.9G 9.4M 1.9G 1% /run tmpfs tmpfs 5.0M 4.0K 5.0M 1% /run/lock tmpfs tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/mmcblk0p1 vfat 256M 49M 207M 20% /boot /dev/sda1 vfat 1.9T 96K 1.9T 1% /home/pi/RetroPie tmpfs tmpfs 384M 0 384M 0% /run/user/1000proc /proc proc defaults 0 0 PARTUUID=e22bcd10-01 /boot vfat defaults 0 2 PARTUUID=e22bcd10-02 / ext4 defaults,noatime 0 1 # a swapfile is not a swap partition, no line here # use dphys-swapfile swap[on|off] for that UUID=D41A-0442 /home/pi/RetroPie vfat nofail,user,uid=pi,gid=pi 0 2extfat just wouldnt work now is this fat or fat32?
so copying is even worse.. now it only copies 2-5mbs/s
-
i did google and found a different format
pi@retropie:~ $ sudo mkfs.vfat -F 32 /dev/sda1now i got 5-10mb/s but no where near 80mbs whats going on? its it writting to the SD card first then the SSD?
as its supposed to write directly to the SSDpi@retropie:~ $ df -h -T Filesystem Type Size Used Avail Use% Mounted on /dev/root ext4 117G 4.5G 108G 4% / devtmpfs devtmpfs 1.8G 0 1.8G 0% /dev tmpfs tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs tmpfs 1.9G 9.6M 1.9G 1% /run tmpfs tmpfs 5.0M 4.0K 5.0M 1% /run/lock tmpfs tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/mmcblk0p1 vfat 256M 49M 207M 20% /boot /dev/sda1 vfat 1.9T 1.7G 1.9T 1% /home/pi/RetroPie tmpfs tmpfs 384M 0 384M 0% /run/user/1000 pi@retropie:~ $ ls -l /dev/disk/by-uuid/ total 0 lrwxrwxrwx 1 root root 10 Feb 28 16:12 3FDD-79EC -> ../../sda1 lrwxrwxrwx 1 root root 15 Feb 28 16:12 8988cf8f-d459-476f-9a4a-16c56702dc40 -> ../../mmcblk0p2 lrwxrwxrwx 1 root root 15 Feb 28 16:12 C367-3F28 -> ../../mmcblk0p1 pi@retropie:~ $proc /proc proc defaults 0 0 PARTUUID=e22bcd10-01 /boot vfat defaults 0 2 PARTUUID=e22bcd10-02 / ext4 defaults,noatime 0 1 # a swapfile is not a swap partition, no line here # use dphys-swapfile swap[on|off] for that UUID=3FDD-79EC /home/pi/RetroPie vfat nofail,user,uid=pi,gid=pi 0 2and i dont know how to get the testing of the dd or the hdparm command for the sda1
is it maybe retropie cant hand 2TB at the full usb 3.0 speeds? as i didnt have issue with the same brand SSD just at a 250 and 500mbs but now i jumped to a 2TB i get these extreme slow speeds..
and i dont know linux good enough to trouble shoot things
-
@comet424 said in how do you get faster write speeds to SSD only getting 24mb/s:
i formated to exfat but it didnt take
[...]You've run the correct command, but your next
dfcommands don't show that the newly formatted partition is mounted.so i dont have that hdparm program not sure how to install it
You can install it with
sudo apt install hdparm.i did get it to format and mount using sudo mkfs.fat
extfat just wouldnt work now is this fat or fat32?It's neither,
exfatis another type of filesystem, just likefatorvfat(which is Linux name for FAT32).I'm not really sure how you're testing, your
dfcommands don't show the/dev/sda1partition being mounted so you may actually be testing just the sdcard.is it maybe retropie cant hand 2TB at the full usb 3.0 speeds? as i didnt have issue with the same brand SSD just at a 250 and 500mbs but now i jumped to a 2TB i get these extreme slow speeds.
It can handle it fine, that's not the issue here - is the filesystem used. Use
exfatinstead ofntfsand you should get better performance. -
@mitu
ill re ty again and the test i did was on the bottom of the forum pagei ran
pi@retropie:~ $ sudo sh -c "sync && echo 3 > /proc/sys/vm/drop_caches" pi@retropie:~ $ dd if=./largefile of=/dev/null bs=4kand ran
dd if=/dev/zero of=./largefile bs=1M count=1024so i installed it and ran
pi@retropie:~ $ sudo hdparm -Tt /dev/sda1 /dev/sda1: Timing cached reads: 1588 MB in 2.00 seconds = 793.80 MB/sec Timing buffered disk reads: 882 MB in 3.00 seconds = 293.62 MB/secso for doing the exfat how do i change that for the fstab? as it wouldnt mount or if it did it was media/usb0
pi@retropie:~ $ df -h -T Filesystem Type Size Used Avail Use% Mounted on /dev/root ext4 117G 4.5G 108G 4% / devtmpfs devtmpfs 1.8G 0 1.8G 0% /dev tmpfs tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs tmpfs 1.9G 9.5M 1.9G 1% /run tmpfs tmpfs 5.0M 4.0K 5.0M 1% /run/lock tmpfs tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/mmcblk0p1 vfat 256M 49M 207M 20% /boot /dev/sda1 vfat 1.9T 4.2G 1.9T 1% /home/pi/RetroPie tmpfs tmpfs 384M 0 384M 0% /run/user/1000this above formated for fat 32 and i getting copy speeds of 5-10mbs
but when i had ntfs it was least 25 so i dont get it ):
-
@comet424 said in how do you get faster write speeds to SSD only getting 24mb/s:
so for doing the exfat how do i change that for the fstab? as it wouldnt mount or if it did it was media/usb0
Did you try to use the
fstabline that you previously posted ?/dev/sda1 /home/pi/RetroPie exfat nofail,user,uid=pi,gid=pi 0 2When you test using
dd, make sure you're using an output file that's on the external disc:dd if=/dev/urandom of=/home/pi/RetroPie/test.file bs=1M count=1024 -
for the fstab i tried "exfat" "exfat4" "extfat" "ext4"
none of them mounted.. unless i change the fstab uuid
and set the usbmount to Enabled in the menu
then sometimes it mountedso the results for the tests are
pi@retropie:~ $ sudo hdparm -Tt /dev/sda1 /dev/sda1: Timing cached reads: 1588 MB in 2.00 seconds = 793.80 MB/sec Timing buffered disk reads: 882 MB in 3.00 seconds = 293.62 MB/sec pi@retropie:~ $ df -h -T Filesystem Type Size Used Avail Use% Mounted on /dev/root ext4 117G 4.5G 108G 4% / devtmpfs devtmpfs 1.8G 0 1.8G 0% /dev tmpfs tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs tmpfs 1.9G 9.5M 1.9G 1% /run tmpfs tmpfs 5.0M 4.0K 5.0M 1% /run/lock tmpfs tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/mmcblk0p1 vfat 256M 49M 207M 20% /boot /dev/sda1 vfat 1.9T 4.2G 1.9T 1% /home/pi/RetroPie tmpfs tmpfs 384M 0 384M 0% /run/user/1000 pi@retropie:~ $ dd if=/dev/urandom of=/home/pi/RetroPie/test.file bs=1M count=1024 1024+0 records in 1024+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 59.2516 s, 18.1 MB/s -
@comet424 said in how do you get faster write speeds to SSD only getting 24mb/s:
none of them mounted.. unless i change the fstab uuid
My example was without the UUID, just using the partition inode directly. If you re-format the drive, it's label may change, so the UUID may not match.
EDIT: add the entry to
/etc/fstab, then try runningmount -a -t exfatand if the drive is mounted (
mount -t exfat). -
ok so not sure what to change in my fstab
proc /proc proc defaults 0 0 PARTUUID=e22bcd10-01 /boot vfat defaults 0 2 PARTUUID=e22bcd10-02 / ext4 defaults,noatime 0 1 # a swapfile is not a swap partition, no line here # use dphys-swapfile swap[on|off] for that UUID=3FDD-79EC /home/pi/RetroPie vfat nofail,user,uid=pi,gid=pi 0 2is my current Fat32 for the 2TB drive
everytime i format it changes the UUID so then i re change it in the fstaband what i was meaning is /home/pi/RetroPie vfat
i changed the vfat to "ext4" "exfat" "exfat4"
when i had it formated as exFat or whatever the proper wording is for itto see if it would mount.. it would sometimes mount as /media/usb0
so wehre in the fstab do i add /etc/fstab
and i guess reformat the drive to exfat right?
and i did try where vfat is when i had "ntfs" i tried changing it to "ntfs-3g" but that didnt help either as i read that in a different retropie article someone said worked but didnt work for me
when i had it as ntfs -
Sorry, but it's getting difficult to follow your replies without any phrasing or punctuation. Can you make an effort and organize your replies better ? I understand English may not be your native language, but try to make an effort and put some structure into it.
-
First, make sure you format your drive as
exfat, use themkfs.exfatcommand I've mentioned. Usecfdisk /dev/sdaorfdisk -l /dev/sdato confirm the drive is properly formatted. -
2nd, modify
/etc/fstaband replace the last line with the entry I mentioned a couple of replies ago:
/dev/sda1 /home/pi/RetroPie exfat nofail,user,uid=pi,gid=pi 0 2- 3rd, try the mount commands from my previous reply to make sure that you've correctly modified
/etc/fstaband mounting works. If none of the commands fail, then you can disable theusbmountservice and reboot to see if the external disc is mounted correctly (to/home/pi/RetroPie).
-
-
@mitu
sorry try my best as i have dislexia and its sounds clear to mewhat i was say
in fstab file
vfat line i changed it to "ext4" "exfat" "exfat4" for Exfat
non of these settings "mounted" the drive tp /home/pi/RetroPie
only to /media/usb0 and you had to have the Auto USBmount service Enabled in the Menu.. Disabled wouldnt mountwhen it was ntfs i treid "ntfs" and "ntfs-3g"
and i was sayin since its in Fat32 i guess i have to reformat it
and i said i had to change the UUID in the Fstab every single time when i formated the drive
pi@retropie:/etc $ sudo mkfs.exfat /dev/sda1 mkexfatfs 1.3.0 Creating... done. Flushing... done. File system created successfully. pi@retropie:/etc $ cfdisk /dev/sda cfdisk: cannot open /dev/sda: Permission denied pi@retropie:/etc $ cfdisk /dev/sda1 cfdisk: cannot open /dev/sda1: Permission denied pi@retropie:/etc $ fdisk -l /dev/sda fdisk: cannot open /dev/sda: Permission denied pi@retropie:/etc $ ls -l /dev/disk/by-uuid/ total 0 lrwxrwxrwx 1 root root 15 Feb 28 16:34 8988cf8f-d459-476f-9a4a-16c56702dc40 -> ../../mmcblk0p2 lrwxrwxrwx 1 root root 10 Feb 28 17:51 B862-4CA4 -> ../../sda1 lrwxrwxrwx 1 root root 15 Feb 28 16:34 C367-3F28 -> ../../mmcblk0p1 pi@retropie:/etc $ sudo nano fstab pi@retropie:/etc $ pi@retropie:/etc $ fdisk -l /dev/sda1 fdisk: cannot open /dev/sda1: Permission deniedi rebooted and ran your 2 commands again
`"""' The RetroPie Project, https://retropie.org.uk pi@retropie:~ $ ls -l /dev/disk/by-uuid/ total 0 lrwxrwxrwx 1 root root 15 Feb 28 17:58 8988cf8f-d459-476f-9a4a-16c56702dc40 -> ../../mmcblk0p2 lrwxrwxrwx 1 root root 10 Feb 28 17:58 B862-4CA4 -> ../../sda1 lrwxrwxrwx 1 root root 15 Feb 28 17:58 C367-3F28 -> ../../mmcblk0p1 pi@retropie:~ $ df -h -T Filesystem Type Size Used Avail Use% Mounted on /dev/root ext4 117G 4.5G 108G 4% / devtmpfs devtmpfs 1.8G 0 1.8G 0% /dev tmpfs tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs tmpfs 1.9G 9.4M 1.9G 1% /run tmpfs tmpfs 5.0M 4.0K 5.0M 1% /run/lock tmpfs tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/mmcblk0p1 vfat 256M 49M 207M 20% /boot tmpfs tmpfs 384M 0 384M 0% /run/user/1000 pi@retropie:~ $ cfdisk /dev/sda1 cfdisk: cannot open /dev/sda1: Permission denied pi@retropie:~ $ fdisk -l /dev/sda fdisk: cannot open /dev/sda: Permission denied pi@retropie:~ $ fdisk -l /dev/sda1 fdisk: cannot open /dev/sda1: Permission denied pi@retropie:~ $proc /proc proc defaults 0 0 PARTUUID=e22bcd10-01 /boot vfat defaults 0 2 PARTUUID=e22bcd10-02 / ext4 defaults,noatime 0 1 # a swapfile is not a swap partition, no line here # use dphys-swapfile swap[on|off] for that UUID=B862-4CA4 /home/pi/RetroPie exfat nofail,user,uid=pi,gid=pi 0 2pi@retropie:/etc $ mount -a -t exfat mount: only root can use "--all" option pi@retropie:/etc $ sudo mount -a -t exfat FUSE exfat 1.3.0 WARN: volume was not unmounted cleanly. fuse: mountpoint is not empty fuse: if you are sure this is safe, use the 'nonempty' mount option pi@retropie:/etc $ -
The errors below
cfdisk: cannot open /dev/sda1: Permission denied
pi@retropie:~ $ fdisk -l /dev/sda
fdisk: cannot open /dev/sda: Permission denied
pi@retropie:~ $ fdisk -l /dev/sda1
fdisk: cannot open /dev/sda1: Permission deniedare because I forgot to prefix them with
sudo(they needrootaccess). Trysudo fdisk -l /dev/sdaand check if the
/dev/sda1partition is reported as NTFS/exFAT.The same with the
mountcommands.sudo mount -a -t exfat
FUSE exfat 1.3.0
WARN: volume was not unmounted cleanly.
fuse: mountpoint is not empty
fuse: if you are sure this is safe, use the 'nonempty' mount optionThe first message is because the
fusevariant is installed, though it shouldn't interfere. You can uninstall it first by runningsudo apt remove exfat-fuseand the mounting will use the native Linux
exfatsupport. Re-try then to run> sudo mount -a -t exfat -o nonemptyand then check by running
mountthat/home/pi/RetroPieis mounted usingexfat.
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.