Is this a PS4 Pro? Still that doesn't make sense, since, the total memory on a PS4 Pro is 9GB. There's something that I am definitely missing or not understanding.
As for the 5GB VRAM payload, what I understand is that the VRAM allocation on PS4 Linux is not 100% perfect. So, when you do use 5GB VRAM, it just leaves <3GB RAM for the CPU. The give and take that you would expect on Orbis (for eg.- if it's a GPU-intensive sequence on Orbis, then PS4 might have a way to allocate more to VRAM, taking away some power from the CPU) doesn't work exactly like that on Linux. So, maybe during the boot process, PS4 might be looking for >3GB RAM, and when there's no mechanism to borrow from VRAM (which in this case is hardcoded to be 5GB), it might just be failing.