Not sure what OS you're using but the default location is configs\all\emulationstation\downloaded_images[system_name] and you can remove them from there
For example: if I were to do this from my Windows machine I would open Windows explorer and browse the RETROPIE computer shown with the other computers attached to my network and then browse the above address. Then sort the folder contents by filetype and delete the unwanted video files