Okay, so after some more searching I found out that the screen I'm seeing is the Raspberry Pi bootloader. I can disable it's appearance by editing it's configuration but I'm still concerned about the error message.
Should I worry it can't find "recovery.elf" and "recovery4.elf"?
By the way, I can still boot into RetroPie just fine play games.