Just in case anyone was wondering these on ebay and ali are legit, full nvlink for $250 2x or $800ish 4x. search "v100 nvlink baseboard" I don't want to link to any specific one here because there are probably some scam sellers.

You'll see some have big fans and some dont. This is a pretty good indicator one has a PLX switch chip (with the fan). PLX switching works like a network switch for the pcie bus and it can be really handy with ML cards because at some point you'll realize latency matters a lot. If you're sharding across cards for inference and properly configuring nvlink you might not think its doing much but the very small bits of data traveling between the cards are super low latency and it has a huge impact vs traversing the pcie bus.

Of particular note I wasn't aware of the ECC setting despite having had my v100s for quite some time now. While the article is horribly ai written and a lot of it is actually just wrong I wanted to link to the whole thing since the ECC info was new. I am testing if it impacts inference when sharding now.

This of course is pcie and im using sxm2 cards