The Mustang Rides Again

Revisiting the Mustang board two years later, we learned that a few things have changed, and use three of them to build a test storage cluster to try Ceph on ARM — doing a little benchmarking while we are at it.

A New Breed #

A newer revision of the Mustang EVK X-Gene 1 development board has relocated some of its ports and added a few more capabilities. The classic board we discussed at length in a previous blog is now identified with the model number 3PBx, whereas the new ones are part of the 3PCx series.

Relocated Ports.jpg

The SATA ports have moved, as you can see in the picture stacking a new board over the older one, and two ethernet ports and the SD card slot have traded places. Besides these cosmetic changes, an additional serial port has been brought out to a connector as UART1 and placed right above good old UART0.

IMG_4862.jpg

A more substantial change is the adoption of a new UEFI firmware made by American Megatrends. While I am and forever will be a fan of U-Boot, this is a logical step towards making ARM a full-fledged datacenter platform.

Hardware Integration #

Our friends at Ampere very kindly provided me with two additional boards, so that I could experiment with the design and creation of a small storage cluster. I properly stacked them on a Lian Li PC-T60B test bench using brass standoffs Amazon promptly delivered for just a few bucks.

IMG_4857.jpg

Powering the system required a little more thinking. The test bench has room for one standard-size ATX power supply, not three. I resolved this by employing three Flex ATX form factor power supplies. These are designed to fit in 1-U datacenter cases and have front-to-back forced ventilation, which makes them perfect for stacking. I coupled the PSUs together using 3M double-sided VHB tape, which bonds permanently and was originally designed to replace rivets in metal assembly — awesome stuff as long as the plan does not involve ever taking things apart!

IMG_4859.jpg

Cleverly lining up the combined power supply to existing screw holes and using the rubber pads of the standard PSU seat to provide additional support made for a very stylish 3-PSU rig. If you do not look too closely, you would never know this was not the originally designed setup.

IMG_4861.jpg

Storage configuration was more straightforward. The APM Mustang is ideally suited to this task because of its many storage options, unlike mostly all other ARM developer boards, as they have no SATA ports to speak of. My design calls for booting from the SDXC card slot and using the four SATA ports to each drive a disk — these will be managed by Ceph OSDs.

IMG_5226 (1).jpg

The Seagate team very generously agreed to loan a dozen SSD drives for my experiment. We have now enough drives to assign a dedicated CPU core to each drive, plus three SD cards to boot the system from - fifteen storage devices.

IMG_5264.jpg

The drives arrived concurrently with a Vantec EZ Swap M2500 twelve-bay SATA drive cage to install them in. Very solid aluminum construction and straightforward SATA pass-thru make it ideal to rack our twelve drives closely-packed and in style.

IMG_5300.jpg

We are now working on software configuration, which will be the subject of a second blog. To be continued…

 
17
Kudos
 
17
Kudos

Now read this

A Look at Ceph Storage 5

Introducing the Pacific codebase of Red Hat’s flagship storage product # with Marcel Hergaarden (Red Hat) Red Hat Ceph Storage 5 is now generally available. This release includes support for NFSv4, additional disaster recovery... Continue →