Advice needed: MikroTik design for GPU server, NAS, VLANs, high-throughput storage and future cluster

Hardware MikroTik hardware general
1

Hello everyone,

I am designing a new network and small datacenter environment and would appreciate advice from experienced MikroTik users and certified engineers.

We are starting with one high-density GPU server for AI training. The server has an 8-GPU NVIDIA HGX B200 platform and will require high-throughput access to active storage, future cold/archive storage and developer workstations. We also need a scalable design for possible future GPU servers and distributed training.

Current environment

  • Two office floors: 5th and 6th floor.

  • Existing structured copper cabling: Category 7A SFTP, tested successfully to EN 50173 Class EA / 10GbE capability.

  • Currently only one Cat 6 connection between the two floors; this will be replaced with fiber.

  • One Ubiquiti UniFi Pro XG Aggregation switch with 32 × 25GbE SFP28 ports.

  • Planned Ubiquiti access network: ECS-48-PoE switches, Wi-Fi 7 access points and an Enterprise Gateway/firewall.

  • Approximately 100 office users, laptops and PCs.

  • Active Directory-based user and access management is planned.

2

Hi,

Suggest that: https://mikrotik.com/consultants?category=consultants

3

yeah thanks, Already tried that !

4

And what's happened? You write the tag as suggested?

5

No , I contacted the closest consultant guy to me and I'm waiting for answer but the thing is as I see there is no 24x 10Gbps Ethernet with SFP/SFP+ in the switches series to use in the design probably gonna use another brand for like Ubiquity or QNAP for that access layer but it's like nobody is willing to discuss the network design

6

As it depends on used brand.
If you have some constraints to obey then write them down (with more details in the post) and send to companies specializing in networking for a project. It would be payable however.

7

The reason is simple:

  1. User forum
  2. Users responding in their spare time
  3. If we had to develop such complicated projects for the first person who comes along...
    it would be work, so no more than point 2.
  4. I don't know how many consultants you've tried to contact,
    but around here they're usually on vacation these weeks.
8

Isn't the CRS326-24S+2Q+RM a 24-port SFP+ switch?

https://mikrotik.com/product/crs326_24s_2q_rm

I have four of those in use in my MLAG setups.

Or did you want 24 copper 10G ports and a couple of SFP+ ports on the side?

You could also get a CRS520-4XS-16XQ and get break-out cables for up to 48 SFP+ ports, or any combination of 10G, 25G, 40G, 50G (?), or 100G you could want.

https://mikrotik.com/product/crs326_24s_2q_rm