
ijustpostwhenimhi
1171
30
4

You may ask, how is it a PiNAS without a Pi? And that's a good question...
PCIe switch woes:
I originally set out to upgrade a Pi4 based NAS that used USB SATA and USB 2.5GbE, to a full fledged SAS NAS with 10GbE connectivity, using the Pi5.
The biggest hurdle? The pi5 only has a single x1 PCIe gen3 port.
The solution was /supposed/ to be a PCIe gen3 switch, and I /HAD/ a working switch until a power failure/fault blew up my Pi and the switch. The replacement switch -the exact same model- refuses to show up and many attempts with other switch cards had the same results. I'm sure it's the x1 host bus.
The switch needs to be configured to allow an x1 upstream port, and that first switch was likely configured as such, but every replacement has not been.
These all come from china, so going back and forth with them to solve that issue has not been easy...
I tried to contact the switch chip mfgs for the switch cards directly, Microchip is the only one that got back to me in regard to reconfiguring an existing switch card to accept the x1 port.
Their response "We can't help you re-engineer our partner's product" fair ig lol
Maybe USB???:
Getting desperate, I re-explored USB options for the NIC, eliminating the switch and only having the SAS controller on the x1 port.
Well as luck would have it, Realtek /very/ recently released a 5GbE USB chip.
I found a listing on amz for $40 and gave it a try... It's not great.
1. It doesn't support jumbo frames (despite docs saying it does), which for large file transfers on a system with limited CPU resources, is a very big deal.
2. USB has a lot more overhead vs PCIe in general.
3. I get 900Mb/s up, 2.3 Gb/s down. I was getting 7Gb/s both ways with the PCIe NIC.
I'll make my own PCIe switch HAT with jack black and hookers!:
There exists a single gen3 switch IC that doesn't hide the datasheet behind NDAs. I've put together a schematic for it, but layout and routing for a 8GHz circuit is a bit outside my comfort zone, so that's very much on a back burner.
Is this defeat?:
There are a few goals with this project, and one of them /was/ to use the RPi5.
I /did/ have a working switch, so the concept is more than theoretical, but my quest for another working switch has been a hit to both morale and my wallet.
Well... What if there was an ARM based SBC with... 2 PCIe ports?!?!
Enter the Radxa ROCK 5B+.
It has the same 4 A76 cores as the RPi5, /PLUS/ an additional 4 A55 cores., and the most important part, 2(two) gen3 x2 PCIe ports. No switch needed.
Oh, and it costs $15 more than a 8GB RPi5. gru.jpeg
To all those shouting "just go x86" No! This was a Pi project and if we aren't having Pi we're still having ARM and/or an SBC! So at least the spirit of the project lives on.
I still want to get it working with the pi5, but at this point I just want my NAS up and running, so I must accept defeat... for now.
Thanks for coming to my Ted talk.
@StackMySwitchUp

Cat Tax
KainLamond
ugh you guys with your big PiNASes, if you really knew how to use your hard drive, you'd know all you need is a pico...
KilroyLichking
lightweight nas ftw hope you get it working
StackMySwitchUp
Lol, cheater.
ijustpostwhenimhi
Unfortunately, yes. I do seriously want to make my own gen3 switch HAT, but that will have to wait 'til sometime Q1 '25. I may hire help for the routing and general high-speed circuit tips. At least then I will have the documentation and tools to configure it correctly for the x1 host bus.
StackMySwitchUp
I'd be thoroughly impressed if you can pull that off. I'm pretty sure the most important details with high frequency traces is that they have equal length and proper pairing with respective ground lines to prevent crosstalk. Other than that it's probably just a complicated puzzle. Do definitely tag me in that project as I've considered similar things in the past but never attempted them.
weedeewee
Hi again. There's likely a small memorychip on the PCIe gen3 switch cards, including the one that blew up, that contains the configuration for said switch. Best case a transplant of said memory chip could make the new card work. Though maybe locating it and reading it out to verify it is still working might be a better idea to try first.
ijustpostwhenimhi
I tried swapping the eeprom chip, unfortunately no-go. as far as I can tell the switch also has onboard memory that holds config data
weedeewee
I didn't see any eeprom when I looked at the card. Was it underneath the heatsink and if so, do you have a photo of that, that you can post ?
ijustpostwhenimhi
It's under the heat sink. I can't take pictures of the card rght now, but it was a typical 8-pin soic spi chip.
weedeewee
or... having looked at what's maybe the correct photo of the card. it's just a tiny strap resistor that's either not present or in a slightly different location.
ijustpostwhenimhi
https://www.aliexpress.us/item/2255800570197081.html I'll do a double check of all the resistors, but everything appears to be the same
weedeewee
yeah, I think I pointed that card out to you a while back :-)
ijustpostwhenimhi
Yeah that or the slot adapter board. ;)
weedeewee
or both ;-)