PCIe testing on the Raspberry Pi 5, and NAS project, part 8. The big one

Feb 27, 2024 3:32 AM

This is a big one.
This is a PCIe x8 to 4(qty) m.2 PCIe add-on card, with the PLX PEX8724 PCIe 3.0 switch chipset
tl;dr it works on the pi5

Details:
"Plan A" is to have both a 10GbE NIC /and/ a SAS storage controller attached to the Pi. I have confirmed a working 10G NIC and SAS controller.
To get them both on the pi I need a PCIe switch, and for maximum performance, I want a gen3 switch specifically.

Of the few options for gen3 PCIe switches, the fastest (shipping) route would be one of the multi-m.2 cards on Amazon (not the bifurcation cards). They're meant for nvme SSDs, but technically they're just a PCIe switch on an add-on card, so other PCIe devices should work with adapters.
The problem is that they're expensive, typically $200 for the PLX based cards.
Asmedia based cards are slightly cheaper, but I tried those and they didn't work. So my only other hope would be a PLX card.
There are much cheaper PLX cards overseas (with cables instead of m.2), but returns could be a problem if it doesn't work.
Thankfully I had a friend who had one of the m.2 PLX cards and he let me borrow it.

Wonderful news!
IT WORKS! :DDDD

After the Asmedia didn't work I was losing hope, but now I'm ecstatic

Already started the order for the overseas PLX card. Which was $69. It will be here mid March
Full switch part links
https://www.aliexpress.com/item/1005006105942362.html
https://www.aliexpress.com/item/1005004655762506.html
https://www.aliexpress.com/item/4000547667414.html

Getting the exact same read/write on my NVMEs that I got without the switch in the middle, which is mighty impressive.

Cat tax

raspberry_pi

maker

technology

diy

That is stupid impressive. I need to get a PCIe hat and hook up a 2-4tb disk to it and make a better NAS.

1 year ago | Likes 3 Dislikes 0

What power draw do you get when all this is running?

1 year ago | Likes 2 Dislikes 0

I have a smart plug that has power monitoring, but after looking at the history I don't think it's accurate at all (0w reported occasionally). I do want to get a power usage number though, so I plan to get a kill-a-watt plug instead and I'll let you know

1 year ago | Likes 2 Dislikes 0

That's the problem with switching power supplies,they have weird power factors that sometimes mess up the readings. Kill a watt should be reasonably accurate,although maybe less so under a certain amperage.

1 year ago | Likes 2 Dislikes 0

Btw2: what's your stance on the usb3 >nvme adapters? Think those would work for pcie cards?

1 year ago | Likes 2 Dislikes 0

Unfortunately those are unique. They host the nvme driver on the dongle and then pass a virtual block device over USB.

1 year ago | Likes 2 Dislikes 0

Btw: could you maybe tag me when you post updates to this? I've been waiting for proper PCIe since the Pi 2 and so far all the implementations were stupid,but this one i dig.

1 year ago | Likes 2 Dislikes 0

Certainly

1 year ago | Likes 2 Dislikes 0