Ubuntu won't boot with more than 4 GPU's

[flux]

In the interest of helping others, I finally figured this out last week.

The issue was running PCIE1x simulatenously with 4x and 16x. The solution was to set a kernel boot option in grub of iommo=soft.

All cards up and running at this point.

hope this helps someone else out.