Latency is still in the 30-40 range, But stable so????
I'm guessing that's ping time in milliseconds? Is that under load, or with nothing running?
It does not make sense that you grab a block of addresses
The scale of the address space is outside all human experience. Your brain didn't evolve with any ability to understand values this big, so it struggles and comes up with misanalogies.
I expect you're aware that IPv4 has a 32-bit address space, and that IPv6 has a 128-bit address space. A normal initial reaction is to see the latter as 4× bigger, but in fact a
34-bit address is 4× bigger, since every additional bit — that is, binary digit — is a doubling. To go from 32-bits to 128-bits is ninety-six doublings!
If your ISP gives you a /64 subnet, that isn't half the total IPv6 space, it's one out of 2⁶⁴ subnets available. If each IPv4 address in existence were assigned one of these subnets as a companion, that would use up 2⁹⁶ IPv6 addresses. To use them all up, every IPv4 address would have to be assigned 2³² of these IPv6 /64 subnets.
the devices pick an address at random.
That's
only one way for IPv6 addressing to work. You can draw them from a DHCPv6 pool, or assign them statically, or base them on MAC addresses, or…
My biggest concern for cake is that I am limiting local Lan speeds
So don't put it on the LAN interfaces. You can target a RouterOS queue at any interface you like. Post your configuration and a network diagram if you want someone to vet your configuration.
my worry is I opened my self to much to the internet. And put my self at risk.
While NAT does provide a type of firewalling, doing without NAT doesn't mean you are now without a firewall. RouterOS IPv6 firewall rules still apply, even when your clients have public IPv6 addresses.
Again, post your config if you want reassurance.