I’m going to try to get all the details in one go, but forgive me if I miss something. So I have multiple Mikrotik switches in my home network. 2 in my rack out in the garage, 1 in the network distribution box in my parents closet, plan on adding 2 more down the road not really relevant right now. The ones on the rack are where I’m having issues, specifically the SFP+ switch mentioned in the title. I recently re-ran the fiber cables in my rack to clean things up/switch to shorter cables in some areas. I had also bought some new transceivers along with the cables. The way I have everything run is as follows: PF router at the top of the rack, fiber patch box below the router, then aforementioned switch I am having issues with below the patch box, RJ-45 patch below that, and the second switch below that. At the front of the rack I have a fiber line connected directly from the front of the PFbox to port 1 on the switch I’m having troubles with. From there I have short fiber patch cables running from the transceivers to the patch box. Out of the back of the patch box I have 2 meter fiber cables running to my NAS, and my 3 Proxmox Nodes (2 each using the middle 8 SFP ports, I also want to add I turned them off for trouble shooting purposes to eliminate them as a variable). Port 24 Runs front side of the rack to the other Mikrotik switch, and port 20 runs back through the patch box up through the ceiling to my workspace/room in the house. I started by checking all the physical connections, everything checked out there, after quite a bit of troubleshooting I’m leaning towards it either being a hardware issue, or a configuration issue. I have been running ping tests all day, I set it to 4 different IP addresses, 3 on my LAN that all run through the fiber switch and 1 external IP (Cloudflare’s 1Dot) One address is my NAS, 1 address is my PF Router, and one address is this switch. An interesting thing to note that I’ve found is not a single packed has ever been dropped from my Workspace to the switch, the dropped packets seem to happen on the switch sometimes the network will hang completely for up to a few seconds only for any actions made to catch back up rapidly. I also want to not I didn’t have issues prior to re-cabling the rack and adding more SFP+ Transceivers, I also want to note some port locations changed when doing this when watching my ping utility I see the connection just drop randomly on the 3 addresses that are not the switch. I have been stuck fiddling with this all day, and I’m just not sure how to pinpoint my issue. I feel like I’m leaning in the direction of misconfiguration/Faulty hardware, but I’m not sure where to go from here.
—Updates—
[10/03/2023]
I switched it over to Router OS. I’ve never had issues before; but it seems like a sizable chunk of people on this forum hate working with SwOS, and just tell you to boot ROS instead (I also want to point out SwOS does not seem like its being maintained the last version released was in 2021?). I set it up in ROS and it fixed the problem for like, a single day, it seems the issue has started again. I am going to append a screenshot of the Router OS log page to the bottom of the post. It seems like there is a loop issue with the SFP+ connection to my CSS326-24G-2S+ (sfpplus24). Also if you look at line 24-27, interface links go down and back up.
Some side notes:
- A quick thing with me, always assume I’m on the latest stable version of what ever software I’m requesting help for unless I specify otherwise.
- Below are some screenshots I feel might be helpful, if there is anymore tabs from the web interface I should post A screenshot of please let me know, thank you!
