More PCIe Testing on the Raspberry Pi 5

Feb 3, 2024 12:52 PM

Finally got my hands on an Intel 10G NIC with PCIe gen3 support.
This series of NIC uses the i40e driver.

I did have to apply a small patch to disable the more niche features of the card that were hogging MSI-X vectors, stuff like VMDq and iWARP.
After the patch, the card works great, no bus errors, and it performs close to theoretical maximum in iperf3

patched section of the i40e driver https://paste.ofcode.org/37shEWt5w3wY8zwPRpm3nqL
I simply disable the unwanted features before the MSI-X vectors are distributed.
There may be a way to do this without a patch, but I haven't found one yet.

Gen3 PCIe @ x1 has a max speed of 8 Gbps

Next on the agenda is obtaining a PCIe gen3 switch and a Broadcom 94xx raid controller. I tested a 93xx card but it didn't work, upon further researching, Broadcom says that only the 94xx and newer support ARM

linux

raspberry_pi

tech

maker

I had to double check I didn’t just discover Jeff Gerling on Imgur lol

2 years ago | Likes 2 Dislikes 0

My PI5 can do composite :P

2 years ago | Likes 3 Dislikes 0

Nice. That's a level of geekery I can truly appreciate. What kind of storage are you using?

2 years ago | Likes 5 Dislikes 0

For the pi? I have a "Samsung Pro Endurance" sdcard. For general storage I have a 5 drive raidz on an x86 server that serves as my NAS. The hope is that I can get both a 10G NIC /and/ a raid controller working on the pi5, since that setup would use a fraction of the power and just be fun to build. So far gen3 PCIe switches are hard to come by, but I have a few options I'm exploring

2 years ago | Likes 3 Dislikes 0