Is a setup with 128 GPUs possible?

[atom]

I'm not aware of a single board with that much pci-express slots. But at the time when VCL was still working it was faking to the OpenCL client that it has X numbers of OpenCL capable devices so if you had 32 computers each with 4 pci-express slots that has worked.