Cloud Hosted Router

JnSchl · Wed Sep 23, 2015 11:52 am

In addition to the other issues regarding XenServer (Xen) metering used memory, disks, network, live migration or even shutting down the CHR will not work (only force shutdown). The tools must be installed to get this working.

Personally I think it would be great to get CHR working in XenServer environments. With XenServer you get great functionality for free (and it’s easy to deploy). XenServer with CHR instances in combination with the MikroTik hardware would be a very powerful virtualization environment.

new images for CHR
http://www.mikrotik.com/download/share/chr_6_32.img
http://www.mikrotik.com/download/share/chr_6_32.vmdk
Any news for XenServer users? The following is still valid for 6.32 on XenServer6.5:

Will this work on XenServer 6.5? I imported the vmdk, gave it 512Mb RAM and got the following error while booting.

Booting Kernel Failed: Invalid argument

Is there something special I need to do?

Exactly the same for me.
I've tried under Debian with Xen4.0 and Xen4.1, HVM mode
what is strange, it would like to start linux, but if i press [tab] it says "system"

janisk · Tue Sep 29, 2015 2:56 pm

you can already use it for tests. As the only limitation is the throughput. And in some cases you have to do a workaround that you have to start it in VirtualBox or KVM and shut-down after initial installation.

shaoranrch · Thu Oct 01, 2015 10:39 pm

Hello, I've encountered the following issues with CHR:

1.- On BGP print advertisements, it won't show iBGP advertised prefixes, even though the route is installed in the routing table.
2.- BGP also mixes sometimes the names of peers on the advertisement section, for instance a router with 2 eBGP sessions will show the prefixes but it'll say that prefixes from peerA are learnt via peerB.
3.- On MPLS (LDP), you can see the neighbouring happening, all the routes getting installed and the corresponding labels shown, however if you try to send traffic inside the MPLS network, no MPLS tags are used (tested using wireshark), it behaves as if it had no MPLS functioning.

Anyone else got these issues? I'm using the latest image (6.32)

leemans · Fri Oct 02, 2015 5:52 pm

Dear,
Can the Cloud Hosted Router itself be a Virtual Router with KVM?
I suppose this will depend in the future on the hosted provider.
Thanks,
Patrick
Yes it can. I'm using it in both KVM and QEMU.

I suppose you didn't get me wel.
You take a Cloud Hosted router and this Router itself will be the KVM for 2 other RouterOS systems.

wpeople · Sun Oct 04, 2015 8:41 pm

you can already use it for tests. As the only limitation is the throughput. And in some cases you have to do a workaround that you have to start it in VirtualBox or KVM and shut-down after initial installation.

well, not only with thruput.
The thruput is much limited (around 100 to 200mbps in my scenario) while VM fully use the shared CPU core.

Comparing linux VM, what can load ~950mbps with max 30% cpu usage in VM.

bakergt · Mon Oct 05, 2015 12:37 am

Im sorry is this has already been asked, but i can't see it.

Are the Hyper-V integration components going to be added to the CHR?

I have it up and working on the Hyper-V server no problems, but there is no ability shutdown the VM cleanly from the host. Without this, it will make the host wait 15 min for a reboot.

Mon Oct 05, 2015 10:40 am

Im sorry is this has already been asked, but i can't see it.

Are the Hyper-V integration components going to be added to the CHR?

I have it up and working on the Hyper-V server no problems, but there is no ability shutdown the VM cleanly from the host. Without this, it will make the host wait 15 min for a reboot.

Not sure if this is what you are looking for, but RouterOS does not require a clean shutdown. Power off. It doesn't even support shutdown, since it will reboot rather than stay off.

Buster2 · Mon Oct 05, 2015 4:34 pm

I doesn't matter if the system inside the VM do not care about unclean shutdowns. The host systems do care, because they have to. They wait for signals of clean completed tasks and providing timeouts is only a fallback for unresponsive VM and shouldn't be the normal case. It's their job to provide a clean working environment and RouterOS should be so kind to tell them that all is okay. That means support for openvm/hyper-v/you-name-it tools is needed.

bakergt · Tue Oct 06, 2015 1:29 pm

Not needing a clean shutdown is great (it logs it tho.) but like above, the host will wait for it. It's not a super huge issue, but it would be great it one day it was added. It would allow for a quicker reboot of a host. And if that host is running the only router, shutting down before the host isn't an option.

janisk · Fri Oct 09, 2015 12:32 pm

there is new thread to ask what features from different tool packages you want CHR to support. We will try to make CHR react to those.
here is the link: http://forum.mikrotik.com/viewtopic.php?f=15&t=101204

kkeker · Sat Oct 10, 2015 7:36 pm

Hello!

I understand why this system has been made for licensing, but it creates some inconvenience honest users.

I always used to VMvare licensed images RouterOS installed from the official ISO-image and licensed later donation for conferences and training licenses L4 or L5 purchased. I was enough for my purposes, and all the virtual routers have a unique license honest.

What do I do in this case with a new licensing system? I can somehow convert classic license RouterOS license CHR provided that I can confirm their purchase through a personal account?

###########################################################################################

Здравствуйте!

Я понимаю зачем была сделана эта система лицензирования, но она создает некоторое неудобство честным пользователям.

Я всегда использовал в VMWare лицензионные образы RouterOS, установленный с официального образа ISO и лицензированные позже даренными за конференции и обучения лицензиями L4 или же купленной L5. Мне этого было достаточно для моих целей и все виртуальные роутеры имели честную уникальную лицензию.

Что мне делать в таком случае с новой системой лицензирования? Я могу как-то конвертировать классические лицензии RouterOS в лицензии CHR при условии, что я могу подтвердить их покупку через личный кабинет?

janisk · Tue Oct 13, 2015 12:03 pm

no answers can be given to you at this moment regarding licensing. We have in mind that there are a lot of users already using virtualization. In worst case cenario - nothing will change for you and you will be able to use virtualization services like you did before we started developing CHR.

Kunstovny · Mon Oct 19, 2015 10:18 am

Hi, to Mikrotik guy's
thaks for CHR and my question is when will be on market the payd version of CHR? I need it now for one project.

janisk · Mon Oct 19, 2015 10:40 am

we are working on the licensing policy and pricing. No details yet for the public.

Sanity · Sat Oct 24, 2015 10:07 am

Can you comment on a timeframe for availability? not a release date, more like "planned in Q1 2016"... for planning. I really want to get rid of a certain virtual VPN endpoint

AlexS · Mon Oct 26, 2015 12:19 am

Can you comment on a timeframe for availability? not a release date, more like "planned in Q1 2016"... for planning. I really want to get rid of a certain virtual VPN endpoint

Yes this, hanging out on pricing...

I have a project on hold to replace my current ROS VM's with either handmade or other 3rd party, the driver 10G or vmxnet3 capable images

Muqatil · Sun Nov 01, 2015 3:01 pm

I had problems adding CHR_6.32 to GNS3. It wont start. Maybe it's something related to my HW, but CHR_6.31 works flawlessly out of the box

deejaywal · Wed Nov 04, 2015 5:48 pm

Hello everyone!
This is my first post in this forum.

I am a fan and enthusiastic of routerboards and RouterOS Amazon and Azure.

I did some testing with RouterOS running within a virtual box on top of a vm azure windows and I was very disappointed with the limitations.

I was very pleased to see the CHR running both Hyper-V 2012 (not R2) and as a full VM azure just exporting the vhd to my storage account

Besides not having to do double virtualization (with deadlock risks) there are also the benefits of no double nat.

The only disappointment (with azure, not to chr) was the ILPIP (level instance public ip) is associated via NAT to my private ip unlike the Amazon EC2 that assigns the real public ip to the interface. My next step is to attempt to install on an instance ec2

I believe that the CHR has a great future in cloud environments and can easily replace the native VPN solutions such providers that limit the use ipsec just being difficult to deploy connections where you have a dynamic IP on the client side.

Sorry for my english!

Thank you all!

kyawkyawwin · Thu Nov 05, 2015 9:28 am

Nice One!

planetcoop · Thu Nov 12, 2015 8:26 pm

Any new image for 6.33.vmdk?

AlexS · Thu Nov 12, 2015 10:53 pm

Hi

Will CHR fix the issue of VRRP not working in VMWare, unless you turn on promisc mode for that interface ?

janisk · Mon Nov 16, 2015 10:10 am

you have to run interface in promiscuous mode if you want to run VRRP on the interfaces.

danipolo · Wed Nov 18, 2015 3:40 am

I have been hosting cloud hosted ROS since 2010. Paid for the licenses L4&L5 but, is it possible to upgrade to CHR?
Currently we only offer the 1Mbit limited version, if you don't need higher sped, just use this image. In future we will offer subscriptions, but I don't think there will be any migration between old license and new.

Hi,

That means if I try to make a bandwith-test, the speed will be limited to 1mbit?

Are you thinking in offer the service as a SaaS? Could be good.

Thnaks

AlexS · Wed Nov 18, 2015 4:40 am

you have to run interface in promiscuous mode if you want to run VRRP on the interfaces.

But that causes its own problems.

Its possible to run with out promisc mode but must use different macs

siv · Wed Nov 18, 2015 4:07 pm

Guys, on the Hyper-V side, you NEED to implement synthetic NIC drivers:

VMBus Network Controller Drivers: Two types of network adapters are available in a virtual machine running on the Hyper-V Server: a legacy network adapter and VMBus network controllers. VMBus network controllers are available only if you have installed LIS. A VMBus network controller uses the Network VSC, running on the Linux virtual machine, to communicate with the Network VSP running on the Hyper-V host. The Hv_netsvc driver provides support for VMBus network controllers.

I have connections in Microsoft Linux development group, so I can introduce some developers if needed. Just e-mail me.

siv · Wed Nov 18, 2015 4:12 pm

In Hyper-V:
If anyone gets the "bug" that the CHR reboots after setting up SSH keys, please note you have to remove your synthetic NIC and install a "Legacy" NIC.
To save you the time from converting .img to .vhd, here is a download link:
http://home.varlyakov.com:5000/fbsharing/sJOHoXEC

russman · Wed Nov 18, 2015 7:37 pm

So I previously purchased a x86 lvl 6 license and run it in VMware. Can I convert this to a CHR license and decommission this one?

capprentice · Wed Nov 18, 2015 7:55 pm

As it currently stands, this "Cloud Hosted Router" is really more like "RouterOS VM Edition".
Well yes, for now
Support for Amazon or other services is planned.

What purpose it will serve if hosted in Cloud? Will it be used for VPN or as NTP server?

Thu Nov 19, 2015 10:32 am

As it currently stands, this "Cloud Hosted Router" is really more like "RouterOS VM Edition".
Well yes, for now
Support for Amazon or other services is planned.

What purpose it will serve if hosted in Cloud? Will it be used for VPN or as NTP server?

yes,as examples, it can also function as a firewall for your server in EC2 ...

janisk · Thu Nov 19, 2015 11:34 am

In Hyper-V:
If anyone gets the "bug" that the CHR reboots after setting up SSH keys, please note you have to remove your synthetic NIC and install a "Legacy" NIC.
To save you the time from converting .img to .vhd, here is a download link:
http://home.varlyakov.com:5000/fbsharing/sJOHoXEC

in our tests there are no issues using either of the interfaces provided by Hyper-V with CHR image. Would like to get more details of your setup.

siv · Thu Nov 19, 2015 5:26 pm

@janisk

Okay, so I was testing it on our pre-prod environment which is on standard Windows 8.1 (client Hyper-V).

Deployed the .vhd after converting the .img file to .vhd using VirtualBox management CLI - VBoxManage.

Systeminfo:
OS Name: Microsoft Windows 8.1 Pro
OS Version: 6.3.9600 N/A Build 9600
OS Manufacturer: Microsoft Corporation
OS Configuration: Standalone Workstation
OS Build Type: Multiprocessor Free
X64 installation, patched last tuesday (up to date)

On our prod environment - Windows server 2012 R2, the issue is not present. I am unable to test Windows 10 at the moment, maybe someone else could do that.

Do you need any additional information ?

Rudios · Fri Nov 20, 2015 1:42 pm

I have tested CHR on Windows 10 just now. Running 6.31.
I only see my legacy network adapter, not the normal one.
Another issue I noticed is that when I check for updates, it tells me that version 6.33.1 is available and after download and reboot it tries to install but the VM keeps rebooting.

{add}
Another thing I just came accross.
I have 2 versions of CHR images available 6.31 and 6.32
After conversion from img to VHDX (I don't know whether VHD vs. VHDX would matter) 6.31 starts ok, but only with the "Legacy Network interface"
6.32 has the same reboot issue as the 6.31 updated to 6.33.1

siuslawbb · Mon Nov 23, 2015 6:06 am

Any more thoughts on when this will be ready for EC2?

janisk · Thu Nov 26, 2015 8:18 am

you can use this on EC2. It is just not jet available as an AMI provided by us.

We will check what is going on on Windows 8.1 and Windows 10 and normal Hyper-V interface.

Rudios · Thu Nov 26, 2015 8:40 am

[...]
We will check what is going on on Windows 8.1 and Windows 10 and normal Hyper-V interface.

That would be nice!!
Hope to hear some possible solutions soon!

mpoisel · Thu Nov 26, 2015 6:15 pm

Hello,

is it possible, to get some time limited version (until stable version is released), without bandwidth limitation? I'd like to start testing in production environment, but 1 mbps is too low

. It would by useflull, to remove limitation, until stable version is released.

thank you

siuslawbb · Fri Nov 27, 2015 9:09 pm

you can use this on EC2. It is just not jet available as an AMI provided by us.

We will check what is going on on Windows 8.1 and Windows 10 and normal Hyper-V interface.

Importing the raw file into EC2 with their cli tools?

http://docs.aws.amazon.com/AWSEC2/lates ... Image.html

siuslawbb · Sat Nov 28, 2015 4:37 am

Trying to manually import this into EC2 with their CLI tools, since it appears that's the only way to do it at this point. I've tried the import with both the raw .img and the vmdk.

Getting this error for the raw .img version:
Client.Unsupported: No bootable partition found. (Service: AmazonEC2; Status Code: 400; Error Code: Unsupported;

When trying the vmdk, I'm getting this:
ERROR: File uses unsupported compression algorithm 0

Below, is the CLI command we're trying to use to get it imported:
ec2-import-instance chr_6_32.vmdk -t ts.micro -f VMDK -a x86_64 -z AWSREGION --subnet subnet-ID -b AWSS3Bucket -o USERID -w USERKEY

We've tried both x86_64 and i386 as the architecture flag without change.

Using this set of instructions from Amazon: http://docs.aws.amazon.com/AWSEC2/lates ... tance.html

janisk · Mon Nov 30, 2015 1:00 pm

prepare image locally first , then do the import as AMI, then you can start instances.

Also, before you try to build image - start it in KVM so it installs itself and shutdown on reboot. After that bundle-image, upload to , create AMI and start instanced from that ami.

siuslawbb · Mon Nov 30, 2015 4:20 pm

Thanks for the feedback Janis. What tool do you use to prepare the image locally first and export into an AMI format?

siv · Tue Dec 01, 2015 11:12 am

Janis stated what tool to use - use KVM.

1. Load the image in KVM
2. Start it
3. After it installs, shut down the appliance
4. Upload to AWS using your command.

This should work.

dw5304 · Tue Dec 01, 2015 4:11 pm

bump for: Can you comment on a timeframe for availability? not a release date, more like "planned in Q1 2016"... for planning.

pietroscherer · Wed Dec 02, 2015 7:16 pm

Hello,

Is there a way to use switching functionality CHR ?

switch.JPG

Thanks!

Chupaka · Wed Dec 02, 2015 10:23 pm

"switch" is about hardware functionality. This menu should be removed on CHR, I think

Thu Dec 03, 2015 2:35 pm

"switch" is about hardware functionality. This menu should be removed on CHR, I think

It appears that the person is asking for us to add such "virtual switch", it is not there currently, because you are right, Switch is a hardware feature

pietroscherer · Fri Dec 04, 2015 1:40 pm

"switch" is about hardware functionality. This menu should be removed on CHR, I think
It appears that the person is asking for us to add such "virtual switch", it is not there currently, because you are right, Switch is a hardware feature

Normis and Pavel, you're right!

Normis, It would be interesting to have the functions of switching, even if it is virtual, so we can study the functions it offers.

Thanks.

wa4zlw · Sun Dec 06, 2015 11:28 pm

Hi folks....I pulled down the VM images and Hyper-V gets an IMPORT FAILED!

A server Error occurred while attempting to import the virtual machine.

Import failed.

Import failed. Unable to find virtual machine import files under location "D:\xfer\Mikrotik\VM\". You can import a virtual machine
only if you used Hyper-V to create and export it.

I am successfully running two VMs under Hyper-V one from Watchguard for their Dimension server and a w10-32bit image running other Watchguard management tools as well as the Dude windows x86

So how does one get this running please?

Thanks leon

Andreas · Sun Dec 06, 2015 11:46 pm

I don´t understand that 1Mbit limitation. It is only usefull to see if it runs or not.
For testing I would be much more happy with the 24h test-version (or even less time), to see how it performs compared to the "old" virtualized x86 version.

Mon Dec 07, 2015 9:37 am

Andreas, we will have a 60 day trial without the speed limit.

wa4zlw · Mon Dec 07, 2015 3:36 pm

take 2 - please

Hi folks....I pulled down the VM images and Hyper-V gets an IMPORT FAILED!

A server Error occurred while attempting to import the virtual machine.

Import failed.

Import failed. Unable to find virtual machine import files under location "D:\xfer\Mikrotik\VM\". You can import a virtual machine
only if you used Hyper-V to create and export it.

I am successfully running two VMs under Hyper-V one from Watchguard for their Dimension server and a w10-32bit image running other Watchguard management tools as well as the Dude windows x86

So how does one get this running please?

Thanks leon

sash555 · Mon Dec 07, 2015 10:20 pm

Andreas, we will have a 60 day trial without the speed limit.

Hello. How can I get a 60 day trial without the speed limit? Can I upload the configuration when the trial license is used?

mpoisel · Tue Dec 08, 2015 12:28 pm

Andreas, we will have a 60 day trial without the speed limit.
Hello. How can I get a 60 day trial without the speed limit? Can I upload the configuration when the trial license is used?

+1

please, release trial version asap. I want to get rid of my "lots of RBs thrown in rack" and start virtualization.

Tue Dec 08, 2015 12:35 pm

any day now

wa4zlw · Tue Dec 08, 2015 1:21 pm

Normis can u please answer my question on hyperv?

Thanks leon

Sent from my 0PJA2 using Tapatalk

pietroscherer · Tue Dec 08, 2015 3:55 pm

Hi,

I'm having a issue with package IPv6. When I enable it in CHR 6.32 using Qemu, the router crashes. Somebody else with the same problem?

Thanks.

janisk · Wed Dec 09, 2015 8:44 am

Today you can start to get CHR trial licenses (currently no paid options) to try out different licensing tiers that will become available for purchase later. To try that you have to have an account on mikrotik.com and you can fetch trial license directly from the router. To try this you have to have at least CHR image based on RouterOS 6.34rc19 available from our download page:
http://www.mikrotik.com/download

select release-candidate option to see available images.

Also, these are not importable virtual machines these are just disk images.

To get the trial:
'/system license renew' and then fill in required fields of account password, account name and license level.

Currently, there are trials for perpetual licenses p1, p10 and p-unlimited, 1 and 10 stands for transfer speed limit of 1 and 10 Gbps. Unlimited is just that, unlimited.

edit:
http://wiki.mikrotik.com/wiki/Manual:CHR

mpoisel · Wed Dec 09, 2015 2:22 pm

thank you for nice Christmas present

. I'm going to test in production immediately.

liteforce · Wed Dec 09, 2015 2:25 pm

My understanding was that there would be subscription-based and perpetual license options available.

I suppose my question is, "If we purchase a perpetual license, will the router need to be in periodic contact with MikroTik's licensing servers ?"

The current license model works well for us in that only the client running Winbox needs to have Internet access and if we need to fiddle with licenses, we don't need to open holes in firewalls to allow routers to talk directly to an outside network - we simply get a new license from MikroTik and the client does all of the communication on the routers' behalf.

If the perpetual license does not require the router to be in contact with MikroTik's licensing servers, you will certainly have custom from us.

Regards,
Terry Froy
Spilsby Internet Solutions

Wed Dec 09, 2015 2:35 pm

Yes, including Perpetual licenses. "system license print" will show you the time left until the device needs to contact MikroTik. After that time runs out, you will not be able to upgrade RouterOS, but nothing will stop working.

The router will never stop working, regardless of license type or connectivity issues, there will be just some limitation after 2 months after the last license renewal.

liteforce · Wed Dec 09, 2015 2:54 pm

The router will never stop working, regardless of license type or connectivity issues, there will be just some limitation after 2 months after the last license renewal.

My problem is that the manual tells a different story:

p-unlimited

The p-unlimited (perpetual-unlimited) license level allows to run CHR indefinitely. It is highest tier license and it has no limitations enforced.

If we purchase a perpetual license, I expect it to work 'as sold' perpetually and as the license text above says, 'no limitations enforced'.

A p-unlimited license should never need to be upgraded and should never ever have limitations once it has been validated and activated by MikroTik.

Please clarify whether a p-unlimited licensed CHR would be impacted by the requirement to remain in contact with a MikroTik licensing server.

For background here, we have a number of MikroTik devices performing firewalling as Layer 2 bridges and as such, they have IP connectivity for the purpose of management but not for the purpose of talking to the Internet; temporarily configuring them to have access to the Internet and activating them with MikroTik's licensing servers as a one-time provisioning exercise is perfectly acceptable but to enforce that this would be required on an ongoing basis makes it difficult for us to justify CHR and we would rather just keep using RouterOS x86.

I would be happy to buy p-unlimited licenses for all CHR instances that we may deploy if it can be guaranteed, that apart from initial activation, we will never ever ever be bothered by any licensing or activation process ever again.

Regards,
Terry Froy
Spilsby Internet Solutions

Wed Dec 09, 2015 2:56 pm

Limitations in this context means "Speed limitations", because the tiers are speed based.

P1 = 1Gbit speed limitation
P10 = 10Gbit speed limitation
PU = No speed limitation

Like I said, it is not required to contact the Licensing server. Your installation will keep working. Only RouterOS upgrade will not be possible, but if you have no connectivity, that is not possible anyway, or you can organize access when you need to do the upgrade every 6 months or so.

raymonvdm · Wed Dec 09, 2015 3:26 pm

I just received the email about RouterOS v6.34 RC (The Dude and CHR) and downloaded CHR VMDK

I uploaded the VMDK to my ESXi host and created a VM out of it. After that i have exported the VM to an OVF file and uploaded it to a Hosted "VMware vCloud Platform" After the import the template seems to be working fine and the router is working in my Cloud

- Will there be a vApp template in the future? So i don`t need to create the OVF myself
- The VMXnet3 NIC seems to be working but there is no driver listed under System -> Drivers for VMXnet3?
-

janisk · Wed Dec 09, 2015 3:36 pm

maybe special CHR with Dude pre-installed will come as virtual guest configuration. The CHR in general, is thought to have different configurations.

liteforce · Wed Dec 09, 2015 3:38 pm

Like I said, it is not required to contact the Licensing server. Your installation will keep working. Only RouterOS upgrade will not be possible, but if you have no connectivity, that is not possible anyway, or you can organize access when you need to do the upgrade every 6 months or so.

We have working IP connectivity to all MikroTik devices on our network.

However, these devices do not have a defaultroute and hence, they have no IP connectivity to the outside world but we can still upload an .npk to these devices and reboot them.

We will likely buy a p-unlimited license to see exactly what is, what is not possible, put the clock forward by two months between reboots and perform a RouterOS upgrade to see precisely what the impact would be.

Regards,
Terry Froy
Spilsby Internet Solutions

apteixeira · Wed Dec 09, 2015 4:21 pm

Hello,

I just successfully upload the MikroTik CHR image to Amazon Web Services (AWS) and it works perfectly as router/firewall for the Amazon VPC.

The only problem is that I tried to apply the free trial P-Unlimited license but it did not work. It keeps saying free license and 1 Mbps Rx/Tx.

Is the trial license working properly?. Here are some images:

Best regards.

dw5304 · Wed Dec 09, 2015 4:23 pm

vm type gen 2

hyper-v image is also broken no boot.
chr-6.34rc19

tryed with and without secureboot enabled.

12-9-2015 8-22-05 AM.png

was able to generate a gen 1 image from the vmdk and it loades w/o issues.

jmginer · Wed Dec 09, 2015 4:31 pm

I try to install RouterOS in VULTR, they don't allow to upload images and the ISO also not run as the disk is not detected (virtio disk driver).

It's possible to get a ISO with the Virtio disk driver? or how to install in this case?

gogusrl · Wed Dec 09, 2015 5:25 pm

I'm having trouble starting the .vmdk image on ESXi 6.0.

Starting it default give me a not enough space error so I tried to increase the size of the disk. I tried both from edit settings in Vsphere Client and from command line with vmkfstools -X 1G /vmfs/volumes/SSD/ISOs/chr-6.34rc19.vmdk.

After resizing it, I get this error when I try to start the VM :

VMware ESX cannot find the virtual disk "/vmfs/volumes/5606714d-8b1e47aa-57e9-000bab5d3512/ISOs/chr-6.34rc19.vmdk". Verify the path is valid and try again.

dw5304 · Wed Dec 09, 2015 5:50 pm

Hello,

I just successfully upload the MikroTik CHR image to Amazon Web Services (AWS) and it works perfectly as router/firewall for the Amazon VPC.

The only problem is that I tried to apply the free trial P-Unlimited license but it did not work. It keeps saying free license and 1 Mbps Rx/Tx.

Is the trial license working properly?. Here are some images:

Best regards.

can confirm as well was on p-10 can not upgrade to p-unlimited.after hitting generate new id can get p unlimited.

also testing on hyper-v seems max throughput is 4.2 gbps

will continue testing.

biomesh · Wed Dec 09, 2015 8:23 pm

Looks good - Now I am just waiting for the licensing to be enabled for purchase. Will there be any way to convert prepaid standard keys (level 4/5/6) to a CHR equivalent license?

mitry · Wed Dec 09, 2015 8:34 pm

Instead fixing bugs, Mikrotik trying to sale the air. I use RouterOS as ESXi guest for over 3 years without stupid 1Mbit limitations.

NelsonM · Wed Dec 09, 2015 8:44 pm

downloaded the raw img added 1G converted to vmdk built using vmxnet3 and paravirtual drivers crashed our host controller running VMware ESXi 5.1.0... yes we need to upgrade...

nevesjunior21 · Wed Dec 09, 2015 9:32 pm

can perform updates for stable release?

mkt_chr.png

sbajic · Wed Dec 09, 2015 10:32 pm

but did anyone from you try the CHR image on Xen ?

I tried few times with few versions of CHR image and still get problem... it hangs on boot, same as someone posted allready screenshot.

I tried to import vmdk image with and without OS fixup that xen server import wizard offers.

Also just to tell you that all versions of x86 ROS works perfectly with same XenServer cluster that I have.

XenServer is version 6.5 but I also tried before pool upgrade when it was XenServer 6.2

Does anyone have some idea?

Normis did you even tried CHR and Xen in your lab because it is here in Europe popular platform Citrix Xen, and I know a lot of people who would use it instead Cisco Nexus virtual appliance just if it could boot and run stable in their virtualised infrastructure...

Regards,
Sasa

AzAel76 · Thu Dec 10, 2015 12:39 am

I tested 6.34rc18 vmdk image on esxi 5.1.0 last night and it crashed the entire host.

I won't be attempting to replicate as its a production host.

rjickity · Thu Dec 10, 2015 2:46 am

Instead fixing bugs, Mikrotik trying to sale the air. I use RouterOS as ESXi guest for over 3 years without stupid 1Mbit limitations.

CHR is essentially fixing bugs and broadening platforms for the x86 architecture. If you want more bandwidth then pay the extremely cheap price it costs to do so (which btw for the 1Gbit license it is the same price the old license would have cost anyway)

kasparskr · Thu Dec 10, 2015 10:15 am

If you have a trial licence, say P1 and you want a higher level - just take a new trial. It is not possible to change trial tiers. In future it will be possible to upgrade to any paid tier from any trial tier.

kasparskr · Thu Dec 10, 2015 10:16 am

Please send supout file to MikroTik support.

Hello,

I just successfully upload the MikroTik CHR image to Amazon Web Services (AWS) and it works perfectly as router/firewall for the Amazon VPC.

The only problem is that I tried to apply the free trial P-Unlimited license but it did not work. It keeps saying free license and 1 Mbps Rx/Tx.

Is the trial license working properly?. Here are some images:

Best regards.

kasparskr · Thu Dec 10, 2015 10:18 am

CHR is currently available only in release-candidate channel starting from version 6.34rc19

can perform updates for stable release?

mkt_chr.png

kasparskr · Thu Dec 10, 2015 10:34 am

Hyper-V gen2 is not supported at the moment

vm type gen 2

hyper-v image is also broken no boot.
chr-6.34rc19

tryed with and without secureboot enabled.

12-9-2015 8-22-05 AM.png
was able to generate a gen 1 image from the vmdk and it loades w/o issues.

apteixeira · Thu Dec 10, 2015 1:55 pm

Please send supout file to MikroTik support.

Hello,

I just successfully upload the MikroTik CHR image to Amazon Web Services (AWS) and it works perfectly as router/firewall for the Amazon VPC.

The only problem is that I tried to apply the free trial P-Unlimited license but it did not work. It keeps saying free license and 1 Mbps Rx/Tx.

Is the trial license working properly?. Here are some images:

Best regards.

Hello,

I just send an email to support@mikrotik.com with all the information and supout.rif

Note: I generate new keys and try to apply new free trial license but it did not work.

Ticket# 2015121066000478

Best regards.

iwikus · Thu Dec 10, 2015 2:00 pm

Hi, since there is separate vmdk for vmware, can you please include in this release for vmware also vmware tools and pvscsi driver?

leemans · Thu Dec 10, 2015 3:53 pm

vm type gen 2

hyper-v image is also broken no boot.
chr-6.34rc19

tryed with and without secureboot enabled.

12-9-2015 8-22-05 AM.png
was able to generate a gen 1 image from the vmdk and it loades w/o issues.

Dear,
When you convert the VHDX file into VHD file it will work with IDE config and Legacy Network Adapter.

nevesjunior21 · Thu Dec 10, 2015 4:18 pm

RouterOS CHR, not pppoe-server runs with 31 users or more, it restarts.

Thu Dec 10, 2015 4:41 pm

RouterOS CHR, not pppoe-server runs with 31 users or more, it restarts.

if it crashed, it made a "autosupout.rif" file. send it to support

nevesjunior21 · Thu Dec 10, 2015 5:02 pm

RouterOS CHR, not pppoe-server runs with 31 users or more, it restarts.
if it crashed, it made a "autosupout.rif" file. send it to support

ok, ever sent!

dw5304 · Thu Dec 10, 2015 5:06 pm

is their plan for support at some point?

Hyper-V gen2 is not supported at the moment

vm type gen 2

hyper-v image is also broken no boot.
chr-6.34rc19

tryed with and without secureboot enabled.

12-9-2015 8-22-05 AM.png
was able to generate a gen 1 image from the vmdk and it loades w/o issues.

also after turning the machine off in hyper-v and right clicking export the vm will no longer boot.
attempts to start the services and just restarts. on the orginal vm host.
taking the exported image and putting it on anouther vm host for backup. it will not boot their either.

hypervisor server 2012r2
gen: 1
ros: v6.34rc19

hedele · Thu Dec 10, 2015 8:32 pm

What does the "upload per interface" limit apply to? Ethernet interfaces or "all" interfaces?

joemarriott · Thu Dec 10, 2015 8:55 pm

Re: trouble starting the .vmdk image on ESXi 6.0.

I had the same issue on ESXi 6. For me the workaround was to import the vmdk and start up a VM on ESXi5, and then migrate the VM to and ESXi 6 host.

It might be related to the VMDK format, (i.e. thick or thin etc). I think I've seen this issue before when importing vmdk's from VMware workstation into ESX

Sob · Thu Dec 10, 2015 9:41 pm

... include in this release for vmware also vmware tools and pvscsi driver?

Pvscsi driver is already included and works fine. The only problem I had, was that vmdk file from MikroTik includes adapter type "ide". VMware Player is happy to change that to pvscsi, but ESXi did not allow me to change it, when I uploaded vmdk file to host. The solution was to convert it:

qemu-img convert -o adapter_type=lsilogic,subformat=monolithicFlat -f vmdk -O vmdk chr-6.34rc19.vmdk chr-6.34rc19-scsi.vmdk

It produces two files, chr-6.34rc19-scsi-flat.vmdk and chr-6.34rc19-scsi.vmdk and ESXi can take those. Adapter type lsilogic is used because qemu-img did not like pvscsi, but it can be changed in ESXi.

Thu Dec 10, 2015 10:58 pm

Hi,

I'm having a issue with package IPv6. When I enable it in CHR 6.32 using Qemu, the router crashes. Somebody else with the same problem?

Thanks.

I'm getting this issue as well.

Windows Server 2008 R2
CHR version 6.34rc19
GNS3 ver 1.3.11
Qemu ver 2.4.0 (included version)

If I run the image in Qemu 2.4.93 (the latest build) then it's stable with all packages installed and enabled (well, I didn't install userman)

I would just use Qemu 2.4.93 but it's got a bug in the udp socket netdevice that makes the emulation run VERY slow and eventually crash when used. This is the type of back-end GNS3 makes when you connect an ethernet interface in the network topology, so Qemu 2.4.93 is useless for this....

oali · Fri Dec 11, 2015 8:16 pm

Glad to see that Mikrotik is heading the could direction , I tried to import the image after installing it in KVM to AWS EC2 but no luck , can some one share how to get to work on EC2? do we have an AMI that we can use ? we have few projects that we need a firewall/router in the could and we had been using Cisco CSR1000V but we would like to move to Mikrotik RouterOS because the Cisco CSR1000V is very expensive and an over kill for what we are using it for .

raymonvdm · Sat Dec 12, 2015 2:23 am

I just upgraded the CHR to v6.34rc20 and now i` m unable to login

jebz · Sat Dec 12, 2015 3:53 am

I just upgraded the CHR to v6.34rc20 and now i` m unable to login

Looks like v6.34rc20 has been removed, back to v6.34rc19 as RC.

wa4zlw · Sat Dec 12, 2015 4:35 am

take 3 - please

Normis....I pulled down the VM images and Hyper-V gets an IMPORT FAILED!

A server Error occurred while attempting to import the virtual machine.

Import failed.

Import failed. Unable to find virtual machine import files under location "D:\xfer\Mikrotik\VM\". You can import a virtual machine
only if you used Hyper-V to create and export it.

I am successfully running two VMs under Hyper-V one from Watchguard for their Dimension server and a w10-32bit image running other Watchguard management tools as well as the Dude windows x86

So how does one get this running please?

It looks like you do not support this?

Thanks leon

HellMind · Sun Dec 13, 2015 4:58 pm

Xen 4.4 Installation steps required.

HiltonT · Sun Dec 13, 2015 10:14 pm

I just upgraded the CHR to v6.34rc20 and now i` m unable to login

I *tried* to update to 6.34rc20 but I get this error message:

ERROR: not enough disk space, 26.3MiB is required and only 17.2MiB is free

This is on the default VHDX version of 6.24rc19 with The Dude package added and running. The default partition is 64MB - we either need a way to increase the partition size during operation (preferably), or during boot (at a minimum). Clearly the 64MB default will be insufficient when deploying this in a production environment and performing additional package installs and updates.

wa4zlw · Mon Dec 14, 2015 12:12 am

also you need to provide correct templates for Hyper_V and VMWare, etc.

what is out there does not even work.

Leon

Mon Dec 14, 2015 6:44 am

I just upgraded the CHR to v6.34rc20 and now i` m unable to login
I *tried* to update to 6.34rc20 but I get this error message:

ERROR: not enough disk space, 26.3MiB is required and only 17.2MiB is free

This is on the default VHDX version of 6.24rc19 with The Dude package added and running. The default partition is 64MB - we either need a way to increase the partition size during operation (preferably), or during boot (at a minimum). Clearly the 64MB default will be insufficient when deploying this in a production environment and performing additional package installs and updates.

This is also problem of x86 ros running virtually. There should be a way how to extend the booting partition from the ros, because just extending the virtual disk is for nothing. I solved this problem by uninstalling non critical packages, partially updated the remaining and installed the previously removed packages again in the second stage.

janisk · Mon Dec 14, 2015 9:51 am

also you need to provide correct templates for Hyper_V and VMWare, etc.

what is out there does not even work.

Leon

it is not virtual instance template or anything of that sort. It is just an disk image, that you add to the guest instance.

janisk · Mon Dec 14, 2015 10:44 am

I just upgraded the CHR to v6.34rc20 and now i` m unable to login
I *tried* to update to 6.34rc20 but I get this error message:

ERROR: not enough disk space, 26.3MiB is required and only 17.2MiB is free

This is on the default VHDX version of 6.24rc19 with The Dude package added and running. The default partition is 64MB - we either need a way to increase the partition size during operation (preferably), or during boot (at a minimum). Clearly the 64MB default will be insufficient when deploying this in a production environment and performing additional package installs and updates.

If you think you will need more storage, you should expand the storage before you install the CHR. Do that using tools provided by the VM. Then when CHR installs itself, you will have access to the larget storage.

Also, 6.34rc21 is available. Did not experience any problems with logging in the router.

raymonvdm · Mon Dec 14, 2015 11:20 am

I just upgraded the CHR to v6.34rc20 and now i` m unable to login
I *tried* to update to 6.34rc20 but I get this error message:

ERROR: not enough disk space, 26.3MiB is required and only 17.2MiB is free

This is on the default VHDX version of 6.24rc19 with The Dude package added and running. The default partition is 64MB - we either need a way to increase the partition size during operation (preferably), or during boot (at a minimum). Clearly the 64MB default will be insufficient when deploying this in a production environment and performing additional package installs and updates.
If you think you will need more storage, you should expand the storage before you install the CHR. Do that using tools provided by the VM. Then when CHR installs itself, you will have access to the larget storage.

Also, 6.34rc21 is available. Did not experience any problems with logging in the router.

This version indeed seems to be working

apteixeira · Mon Dec 14, 2015 1:37 pm

Please send supout file to MikroTik support.

Hello,

I just successfully upload the MikroTik CHR image to Amazon Web Services (AWS) and it works perfectly as router/firewall for the Amazon VPC.

The only problem is that I tried to apply the free trial P-Unlimited license but it did not work. It keeps saying free license and 1 Mbps Rx/Tx.

Is the trial license working properly?. Here are some images:

Best regards.
Hello,

I just send an email to support@mikrotik.com with all the information and supout.rif

Note: I generate new keys and try to apply new free trial license but it did not work.

Ticket# 2015121066000478

Best regards.

Hello,

I just upgrade the CHR to the latest RouterOS version (v6.34rc21) but I got the same problem trying to upgrade the free license to any trial version. It still says free but in the MikroTik account appears correctly.

Any news about it?

Best regards.

raymonvdm · Mon Dec 14, 2015 2:45 pm

I think i have the same issue after an upgrade to CHR 6.34RC21

Although the CLI is more usefull (key replaced by xxx just for privacy)

[admin@router] /system license> print 
  system-id: kThxxxxx/xx
      level: free

pietroscherer · Mon Dec 14, 2015 3:17 pm

Hi,

I'm having a issue with package IPv6. When I enable it in CHR 6.32 using Qemu, the router crashes. Somebody else with the same problem?

Thanks.
I'm getting this issue as well.

Windows Server 2008 R2
CHR version 6.34rc19
GNS3 ver 1.3.11
Qemu ver 2.4.0 (included version)

If I run the image in Qemu 2.4.93 (the latest build) then it's stable with all packages installed and enabled (well, I didn't install userman)

I would just use Qemu 2.4.93 but it's got a bug in the udp socket netdevice that makes the emulation run VERY slow and eventually crash when used. This is the type of back-end GNS3 makes when you connect an ethernet interface in the network topology, so Qemu 2.4.93 is useless for this....

Really. When I used the lastest build of qemu, the emulation runs very slow, and the rOS always got 100% of CPU. Emulating with qemu built in GNS3, it's okay. I'll try to use IPv6 package with vbox, and tell you.

pietroscherer · Mon Dec 14, 2015 4:00 pm

Hi,

I'm having a issue with package IPv6. When I enable it in CHR 6.32 using Qemu, the router crashes. Somebody else with the same problem?

Thanks.
I'm getting this issue as well.

Windows Server 2008 R2
CHR version 6.34rc19
GNS3 ver 1.3.11
Qemu ver 2.4.0 (included version)

If I run the image in Qemu 2.4.93 (the latest build) then it's stable with all packages installed and enabled (well, I didn't install userman)

I would just use Qemu 2.4.93 but it's got a bug in the udp socket netdevice that makes the emulation run VERY slow and eventually crash when used. This is the type of back-end GNS3 makes when you connect an ethernet interface in the network topology, so Qemu 2.4.93 is useless for this....
Really. When I used the lastest build of qemu, the emulation runs very slow, and the rOS always got 100% of CPU. Emulating with qemu built in GNS3, it's okay. I'll try to use IPv6 package with vbox, and tell you.

Feedbacking..

Emulating CHR 6.34rc21, IPv6 package works fine in vbox, but in qemu still crashing.

raffav · Mon Dec 14, 2015 8:58 pm

Hello,
edited the answer was already on the site

but the price for 1p-10p Up it is the price for purchases or it only a estimate ?

the license will be transferable ?

leoktv · Mon Dec 14, 2015 11:43 pm

Is a netinstall soulutions for CHR on its way as after upgrade to 6.34cr20 im not able to login to do the upgrade to rc21. and for this to work we need a main package not only image files.

wdavid · Tue Dec 15, 2015 4:09 pm

Hello,

I just successfully upload the MikroTik CHR image to Amazon Web Services (AWS) and it works perfectly as router/firewall for the Amazon VPC.

The only problem is that I tried to apply the free trial P-Unlimited license but it did not work. It keeps saying free license and 1 Mbps Rx/Tx.

Is the trial license working properly?. Here are some images:

Best regards.

Could you please share with us the steps you used to import the MikroTik CHR VM to AWS. Thank you

HiltonT · Wed Dec 16, 2015 1:53 pm

I just upgraded the CHR to v6.34rc20 and now i` m unable to login
I *tried* to update to 6.34rc20 but I get this error message:

ERROR: not enough disk space, 26.3MiB is required and only 17.2MiB is free

This is on the default VHDX version of 6.24rc19 with The Dude package added and running. The default partition is 64MB - we either need a way to increase the partition size during operation (preferably), or during boot (at a minimum). Clearly the 64MB default will be insufficient when deploying this in a production environment and performing additional package installs and updates.
If you think you will need more storage, you should expand the storage before you install the CHR. Do that using tools provided by the VM. Then when CHR installs itself, you will have access to the larget storage.

Also, 6.34rc21 is available. Did not experience any problems with logging in the router.

Yeah, I worked that out - I re-copied the VHDX, expanded it, started it and now everything lives on Disk2 in the new, expanded VHDX partition. I'm not sure there *was* a "Disk 2" before I expanded, but I can look at some time.

Also, good news on the 6.32rc21 front - may give that a go and see what Dude progress has been made...

janisk · Wed Dec 16, 2015 1:57 pm

Could you please share with us the steps you used to import the MikroTik CHR VM to AWS. Thank you

we are working to make CHR available from the amazon image store. So you can just locate it and launch your own CHR.

edit:

you can try to look up ami-fce6448f and lautnch your instance. Please be aware that amazon can charge you something.

apteixeira · Wed Dec 16, 2015 2:00 pm

Hello,

I just upgrade the CHR to the latest RouterOS version (v6.34rc21) but I got the same problem trying to upgrade the free license to any trial version. It still says free but in the MikroTik account appears correctly.

Any news about it?

Best regards.

Hello,

I have tested several times and the problem with the license persists only with the image that I uploaded to AWS. If a use the vmdk or raw image on VMware or Qemu it works fine, but when I use the raw image on AWS it did not get the correct license.

Any reason for it?.

Best regards.

Wed Dec 16, 2015 2:01 pm

Known bug with AWS, are working on it!

apteixeira · Wed Dec 16, 2015 2:24 pm

*** Please give karma ***

Hello,

Here are the steps to upload the CHR to AWS (Amazon Web Services):

Install http://qemu.weilnetz.de/w64/qemu-w64-setup-20151208.exe

[/b]Download Cloud Hosted Router Raw Disk Image (lastest)
http://download2.mikrotik.com/routeros/ ... 19.img.zip

Rename image >> chr.img

Resize image with quemu
cd "C:\Program Files\qemu\"
qemu-img resize -f raw chr.img +500M

Pre-install RouterOS
cd "C:\Program Files\qemu\"
qemu-system-x86_64w.exe chr.img

ZIP file and upload chr.img to DropBox or S3

Create credentials
*** Create new Security Credentials using Identity and Access Management (IAM) and assign policies
*** Start a new Amazon Linux AMI VM to use as AWS CLI

Download RAW Image to Amazon Linux AMI VM
sudo su
cd \
mkdir CHR
cd /CHR
wget http://xxxxxx/chr.zip

UNZIP file
unzip chr.zip

Rename image
mv chr.img chr

Save credentials on AWS CLI VM
export AWS_ACCESS_KEY=xxxxx (your credential)
export AWS_SECRET_KEY=xxxxx (your password credential)

Start AMI creation process:

ec2-create-volume --size 1 --region us-east-1 --availability-zone us-east-1a

ec2-attach-volume vol-zzzzz -i i-kkkkk --device /dev/sdb --region us-east-1

sudo dd if=/CHR/chr of=/dev/sdb bs=1M

sudo partprobe /dev/sdb

ec2-detach-volume vol-zzzzz --region us-east-1

ec2-create-snapshot --region us-east-1 -d "CHRv6.34rc21_v2" -O $AWS_ACCESS_KEY -W $AWS_SECRET_KEY vol-zzzzz

ec2-register --region us-east-1 -n AMI_CHRv6.34rc21_v2 -s snap-zzzzz -a x86_64 --virtualization-type hvm

Once the AMI have been created, then you can start a new instance.

Enjoy. Best regards.

*** Please give karma ***

apteixeira · Wed Dec 16, 2015 2:29 pm

Known bug with AWS, are working on it!

Thanks. I just wrote the process to import the image to AWS so anyone can test it.

Best regards.

leoktv · Wed Dec 16, 2015 2:50 pm

Hi any having a soulution how to upgrade from 6.34rc20 to 6.34rc21 as it is not pissible to login to the router after upgrade to rc20!

nevesjunior21 · Wed Dec 16, 2015 3:21 pm

I run the x86 version (6.34r21), pppoe server, works 100%
already aversion CHR (6.34r21) restarts on average 5 minutes.

janisk · Wed Dec 16, 2015 3:54 pm

on eu-west-1 you can look for this ami: ami-fce6448f

if this works that way.

janisk · Wed Dec 16, 2015 4:05 pm

I run the x86 version (6.34r21), pppoe server, works 100%
already aversion CHR (6.34r21) restarts on average 5 minutes.

do you have any autosupout.rif files on the router? also, create support output file and send it to support.

nevesjunior21 · Wed Dec 16, 2015 4:26 pm

ok, I will send the 2 x86 and x64!

apteixeira · Wed Dec 16, 2015 4:32 pm

on eu-west-1 you can look for this ami: ami-fce6448f

if this works that way.

Hello,

It works fine but the license upgrade does not work yet.

Here is the public AMI in us-east-1 (Virginia, EEUU): ami-c6287dac

Best regards.

wdavid · Wed Dec 16, 2015 7:04 pm

*** Please give karma ***

Hello,

Here are the steps to upload the CHR to AWS (Amazon Web Services):

......
*** Please give karma ***

Thank you for the instruction. It's working now (except the license). I was missing the qemu part with the initialization. Importing the img or vhd as is didn't worked on AWS in any form.

Regards.

janisk · Wed Dec 16, 2015 9:19 pm

Hello,

It works fine but the license upgrade does not work yet.

Here is the public AMI in us-east-1 (Virginia, EEUU): ami-c6287dac

Best regards.

we are working to fix the license. And there will be updated AMIs with latest RouterOS release available.

wa4zlw · Mon Dec 21, 2015 3:21 am

also you need to provide correct templates for Hyper_V and VMWare, etc.

what is out there does not even work.

Leon
it is not virtual instance template or anything of that sort. It is just an disk image, that you add to the guest instance.

please provide correct templates for the VMs you are supporting. It takes more time to do it this way. It should be plug and ply. the whole purpose of a template is to have an environment that comes up right away.

Leon

janisk · Mon Dec 21, 2015 12:13 pm

it is not a template. These are specifically made this way so it is not a template for your router. We do not know what setup you have, what are your requirements. There is no way on how to predict that.

Your router is not plug and play. This is not a SOHO appliance where you have NAT, one WAN port, and several LAN ports.

Buster2 · Tue Dec 22, 2015 12:59 am

Why should hundreds of admins convert your base disk image to templates to get it imported properly, when one guy at MikroTik could do this? It's not like only one person asked here.

Rudios · Tue Dec 22, 2015 10:40 am

Hi folks....I pulled down the VM images and Hyper-V gets an IMPORT FAILED!

A server Error occurred while attempting to import the virtual machine.

Import failed.

Import failed. Unable to find virtual machine import files under location "D:\xfer\Mikrotik\VM\". You can import a virtual machine
only if you used Hyper-V to create and export it.

I am successfully running two VMs under Hyper-V one from Watchguard for their Dimension server and a w10-32bit image running other Watchguard management tools as well as the Dude windows x86

So how does one get this running please?

Thanks leon

You have to create a VM yourself and apply the supplied VHD(x) file as its harddrive.

@Janisk:
I have downloaded latest available image today (6.34rc23) but it still keeps rebooting after installation

Tue Dec 22, 2015 11:50 am

Guys, if you are asking for a template. What should the config be? How many interfaces and disk sizes etc? Is there some common standard?

janisk · Tue Dec 22, 2015 1:09 pm

@Janisk:
I have downloaded latest available image today (6.34rc23) but it still keeps rebooting after installation

We are working on the issue regarding WIndows 10 pro and Hyper-V that CHR is going into the reboot loop after the installation is complete. We have test setup working, well, rebooting indefinitely.

Tue Dec 22, 2015 1:11 pm

@Janisk:
I have downloaded latest available image today (6.34rc23) but it still keeps rebooting after installation

We are working on the issue regarding WIndows 10 pro and Hyper-V that CHR is going into the reboot loop after the installation is complete. We have test setup working, well, rebooting indefinitely.

In the meantime, you can use legacy network adapters. Those work fine.

wdavid · Tue Dec 22, 2015 4:18 pm

Guys, if you are asking for a template. What should the config be? How many interfaces and disk sizes etc? Is there some common standard?

In case we are talking about an EC2 AMI image then the number network interfaces are not relevant. It's set during the configuration of the instance. The disk size has to be minimum of 1Gb but I would recommend going with 8Gb. Used to be the default for linux instances.
edit: the image of the pfSense router from Netgate also comes with 8Gb as default

AlexS · Wed Dec 23, 2015 1:55 am

Cool Cool Cool.

Is there any path for upgrading the ROS licences into CHR licenses ?

AlexS · Wed Dec 23, 2015 2:19 am

I have downloaded the vmdk - vmware disk. I have created a new VM. other - linux 64 add in 1 nic vmxnet3
I go to add the downloaded disk - have to edit the vm as I can't add during creation and i see the disk is an ide not scsi is that right ?

Quick fiddle with the vmdk change ide to lsilogic

Also I notice there is not vmware tools install - is this planned to be added ?

Any chance to get the licensing to happen via a proxy ...

janisk · Wed Dec 23, 2015 12:16 pm

still no 3rd party tool supprt as in - tools from the wendor. In future there are plans to add things that you will be able to do as if you had tools.

Regarding AMI - http://wiki.mikrotik.com/wiki/Manual:CH ... stallation

rdeclaux · Thu Dec 24, 2015 12:45 pm

How can i install it on vultr.com they want .ISO image but i couldn't convert it, some people say that just rename .img to .iso but it doesn't work.

Is there any other way of installing it? Is iPXE installing works for chr?

HellMind · Fri Dec 25, 2015 10:44 pm

Im using router CHR on an esx with a vm with 8 cores .
I'm being attack with a simple udp flood and its eating a lot of cpu.
I droped the attack on the firewall but still the resource usage is too much

http://puu.sh/m8n6s/7327dfed8e.png
http://puu.sh/m8mWN/77add21c6a.png

http://puu.sh/m8pPU/8e1fbdf3df.png

apteixeira · Sat Dec 26, 2015 1:58 pm

we are working to fix the license. And there will be updated AMIs with latest RouterOS release available.

Hello janisk,

Is there any soon update that fix AWS CHR AMI license. I am using CHR on production environment in AWS for a new VPC but it is limited to 1 Mbps.

Please fix it. It would be great!! Thank you.

Best regards.

apteixeira · Sat Dec 26, 2015 1:59 pm

Im using router CHR on an esx with a vm with 8 cores .
I'm being attack with a simple udp flood and its eating a lot of cpu.
I droped the attack on the firewall but still the resource usage is too much

http://puu.sh/m8n6s/7327dfed8e.png
http://puu.sh/m8mWN/77add21c6a.png

http://puu.sh/m8pPU/8e1fbdf3df.png

Hello,

Can you share your firewall filter configuration?.

Best regards.

HellMind · Sat Dec 26, 2015 2:37 pm

Im using router CHR on an esx with a vm with 8 cores .
I'm being attack with a simple udp flood and its eating a lot of cpu.
I droped the attack on the firewall but still the resource usage is too much

http://puu.sh/m8n6s/7327dfed8e.png
http://puu.sh/m8mWN/77add21c6a.png

http://puu.sh/m8pPU/8e1fbdf3df.png
Hello,

Can you share your firewall filter configuration?.

Best regards.

Sure:

[admin@MikroTik] > /ip firewall filter print
Flags: X - disabled, I - invalid, D - dynamic 
 0    chain=forward action=drop protocol=udp in-interface=ether1 packet-size=28 log=no log-prefix="" 

 1 XI  chain=forward action=drop protocol=udp in-interface=ether1 dst-port=10091 log=no log-prefix="" 

 2    ;;; Add address to block list when try to connect fast
      chain=input action=add-dst-to-address-list protocol=tcp address-list=blocked-addr address-list-timeout=1d connection-limit=10,32 log=no log-prefix="" 

 3 XI  chain=input action=drop dst-address=167.114.219.211 log=no log-prefix="" 

 4    chain=input action=drop protocol=udp in-interface=ether1 dst-port=53 log=no log-prefix="" 

 5    chain=input action=drop connection-state=invalid log=no log-prefix="" 

 6    chain=forward action=drop connection-state=invalid log=no log-prefix="" 

 7 XI  ;;; SYN Flood protect
      chain=forward action=jump jump-target=SYN-Protect tcp-flags=syn connection-state=new protocol=tcp log=no log-prefix="" 

 8    chain=SYN-Protect action=accept tcp-flags=syn connection-state=new protocol=tcp limit=400,5 log=no log-prefix="" 

 9    chain=SYN-Protect action=drop tcp-flags=syn connection-state=new protocol=tcp log=no log-prefix="" 
[admin@MikroTik] > /ip firewall nat print
Flags: X - disabled, I - invalid, D - dynamic 
 0 XI  chain=dstnat action=dst-nat to-addresses=0.0.0.1 protocol=udp dst-address=167.114.219.211 log=no log-prefix="" 

 1    ;;; 014
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=198.50.192.167 log=no log-prefix="" 

 2    ;;; 015
      chain=srcnat action=src-nat to-addresses=198.50.192.164 src-address=192.168.137.15 log=no log-prefix="" 

 3    ;;; 015
      chain=dstnat action=dst-nat to-addresses=192.168.137.15 dst-address=198.50.192.164 log=no log-prefix="" 

 4    ;;; 014
      chain=srcnat action=src-nat to-addresses=198.50.192.167 src-address=192.168.137.14 log=no log-prefix="" 

 5    ;;; 043
      chain=dstnat action=dst-nat to-addresses=192.168.137.16 dst-address=198.27.86.232 log=no log-prefix="" 

 6    ;;; 043
      chain=srcnat action=src-nat to-addresses=198.27.86.232 src-address=192.168.137.43 log=no log-prefix="" 

 7    ;;; 016 tsdns1
      chain=dstnat action=dst-nat to-addresses=192.168.137.234 protocol=tcp dst-address=198.50.192.165 dst-port=41144 log=no log-prefix="" 

 8    ;;; 016
      chain=dstnat action=dst-nat to-addresses=192.168.137.16 dst-address=198.50.192.165 log=no log-prefix="" 

 9    ;;; 016 irc
      chain=srcnat action=src-nat to-addresses=198.50.192.165 src-address=192.168.137.16 log=no log-prefix="" 

10    ;;; 017
      chain=dstnat action=dst-nat to-addresses=192.168.137.16 dst-address=198.50.192.166 log=no log-prefix="" 

11    ;;; 017
      chain=srcnat action=src-nat to-addresses=198.50.192.166 src-address=192.168.137.17 log=no log-prefix="" 

12    ;;; 234 tsdns
      chain=dstnat action=dst-nat to-addresses=192.168.137.234 dst-address=192.99.203.7 log=no log-prefix="" 

13    ;;; 234
      chain=srcnat action=src-nat to-addresses=192.99.203.7 src-address=192.168.137.234 log=no log-prefix="" 

14    ;;; 037
      chain=dstnat action=dst-nat to-addresses=192.168.137.37 dst-address=198.50.154.174 log=no log-prefix="" 

15    ;;; 037
      chain=srcnat action=src-nat to-addresses=198.50.154.174 src-address=192.168.137.37 log=no log-prefix="" 

16    ;;; 041
      chain=dstnat action=dst-nat to-addresses=192.168.137.41 dst-address=198.100.152.246 log=no log-prefix="" 

17    ;;; 041
      chain=srcnat action=src-nat to-addresses=198.100.152.246 src-address=192.168.137.41 log=no log-prefix="" 

18    ;;; 057 ntopng
      chain=dstnat action=dst-nat to-addresses=192.168.137.57 dst-address=142.4.206.216 log=no log-prefix="" 

19    ;;; 057
      chain=srcnat action=src-nat to-addresses=142.4.206.216 src-address=192.168.137.57 log=no log-prefix="" 

20    ;;; 066 ts3ca no publicado
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=167.114.219.211 log=no log-prefix="" 

21    ;;; 066
      chain=srcnat action=src-nat to-addresses=167.114.219.211 src-address=192.168.137.66 log=no log-prefix="" 

22    ;;; 067 ts3ca
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=198.50.239.113 log=no log-prefix="" 

23    ;;; 067
      chain=srcnat action=src-nat to-addresses=198.50.239.113 src-address=192.168.137.66 log=no log-prefix="" 

24    ;;; 068 ts3ca
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=198.50.158.222 log=no log-prefix="" 

25    ;;; 068
      chain=srcnat action=src-nat to-addresses=198.50.158.222 src-address=192.168.137.66 log=no log-prefix="" 

26    ;;; 069 ts3ca
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=198.50.155.239 log=no log-prefix="" 

27    ;;; 069
      chain=srcnat action=src-nat to-addresses=198.50.155.239 src-address=192.168.137.66 log=no log-prefix="" 

28    ;;; 070 ts3ca
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=198.50.155.145 log=no log-prefix="" 

29    ;;; 070
      chain=srcnat action=src-nat to-addresses=198.50.155.145 src-address=192.168.137.66 log=no log-prefix="" 

30    ;;; 071 ts3ca
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=142.4.201.104 log=no log-prefix="" 

31    ;;; 071
      chain=srcnat action=src-nat to-addresses=142.4.201.104 src-address=192.168.137.66 log=no log-prefix="" 

32    ;;; 072 ts3ca
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=158.69.3.137 log=no log-prefix="" 

33    ;;; 072
      chain=srcnat action=src-nat to-addresses=158.69.3.137 src-address=192.168.137.66 log=no log-prefix="" 

34    ;;; 073
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=167.114.219.210 log=no log-prefix="" 

35    ;;; 073
      chain=srcnat action=src-nat to-addresses=167.114.219.210 src-address=192.168.137.66 log=no log-prefix="" 

36    ;;; 074 ts3ca
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=158.69.3.116 log=no log-prefix="" 

37    ;;; 074
      chain=srcnat action=src-nat to-addresses=158.69.3.116 src-address=192.168.137.66 log=no log-prefix="" 

38    ;;; 075 ts3ca
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=198.27.88.239 log=no log-prefix="" 

39    ;;; 075
      chain=srcnat action=src-nat to-addresses=198.27.88.239 src-address=192.168.137.66 log=no log-prefix="" 

40    ;;; 076 ts3ca
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=167.114.219.207 log=no log-prefix="" 

41    ;;; 076
      chain=srcnat action=src-nat to-addresses=167.114.219.207 src-address=192.168.137.66 log=no log-prefix="" 

42    ;;; 077
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=167.114.219.208 log=no log-prefix="" 

43    ;;; 077
      chain=srcnat action=src-nat to-addresses=167.114.219.208 src-address=192.168.137.66 log=no log-prefix="" 

44    ;;; 078
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=167.114.219.209 log=no log-prefix="" 

45    ;;; 078
      chain=srcnat action=src-nat to-addresses=167.114.219.209 src-address=192.168.137.66 log=no log-prefix="" 

46    ;;; 079 ts3ca
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=167.114.219.213 log=no log-prefix="" 

47    ;;; 079
      chain=srcnat action=src-nat to-addresses=167.114.219.213 src-address=192.168.137.66 log=no log-prefix="" 

48    ;;; 080
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=167.114.219.214 log=no log-prefix="" 

49    ;;; 080
      chain=srcnat action=src-nat to-addresses=167.114.219.214 src-address=192.168.137.66 log=no log-prefix="" 

50    ;;; 081
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=167.114.219.215 log=no log-prefix="" 

51    ;;; 081
      chain=srcnat action=src-nat to-addresses=167.114.219.215 src-address=192.168.137.66 log=no log-prefix="" 

52    ;;; 082 ts3ca
      chain=dstnat action=dst-nat to-addresses=192.168.137.66 dst-address=167.114.219.216 log=no log-prefix="" 

53    ;;; 082
      chain=srcnat action=src-nat to-addresses=167.114.219.216 src-address=192.168.137.66 log=no log-prefix="" 

54    ;;; General rule
      chain=srcnat action=masquerade src-address=192.168.137.0/24 out-interface=ether1 log=no log-prefix=""

HellMind · Sat Dec 26, 2015 2:39 pm

I filter the attack with this rule

0 chain=forward action=drop protocol=udp in-interface=ether1 packet-size=28 log=no log-prefix=""
This speeds are for this rule: http://puu.sh/m8n6s/7327dfed8e.png

AlexS · Tue Dec 29, 2015 12:49 am

Hi

How can I set / show the RX/TX ethernet buffer size. for a VMWare VM I would like to set the buffer size for the vmxnet3 nic.

I have had a look at /interface ethernet

is it currently set to max 4096 ?

AlexS · Tue Dec 29, 2015 2:11 am

Been doing some simple testing VMWare esxi 5.5
using iperf

2 Centos 6.6 vm.

iperf -c <serverip> -i 10 -w 128M -t 300
iperf -s -i 10 -w 128M

[ 4] 40.0-50.0 sec 11.6 GBytes 9.99 Gbits/sec
[ 4] 50.0-60.0 sec 11.7 GBytes 10.0 Gbits/sec
[ 4] 60.0-70.0 sec 11.4 GBytes 9.79 Gbits/sec
[ 4] 70.0-80.0 sec 11.7 GBytes 10.0 Gbits/sec

VM -> CHR -> VM
[ 4] 0.0-300.9 sec 61.0 GBytes 1.74 Gbits/sec
2 cpu VM ... 100% cpu

iperf -c 10.172.208.220 -i 10 -w 128M -t 300 -P 2
[SUM] 0.0-300.4 sec 70.5 GBytes 2.02 Gbits/sec

Am i missing something

HellMind · Tue Dec 29, 2015 3:01 pm

VMXNET3 is recommended ?

janisk · Tue Dec 29, 2015 4:39 pm

yes, VMXNET3 is recommended for vmware/esxi

Tue Dec 29, 2015 4:44 pm

What about Qemu? Is VMXNET3 also recommended for it? I noticed virtio-net-pci is also supported, but which one is (at least in theory) better for Qemu?

nevesjunior21 · Wed Dec 30, 2015 4:04 pm

hello, someone had successfully pppoe server? here with me RouterOS-CHR reboots, since the RouterOS-32bit works normal.

HellMind · Wed Dec 30, 2015 10:45 pm

I still need some help to set up routeros chr in xenserver and xen 4.4
Thank you

apteixeira · Thu Dec 31, 2015 7:04 pm

Hello,

CHR license is working on AWS since version 6.34rc30. It is confirmed.

What's new in 6.34rc30 (2015-Dec-30 13:57):
*) chr - license fix for AWS and similar solutions;

Best regards

HellMind · Fri Jan 01, 2016 4:25 pm

I need the xen cfg to try it on xen 4.4 :/

dirtonth · Mon Jan 04, 2016 1:50 pm

Hey Guys,

I am using CHR on AWS using the AMI you provided, and upgraded it to the latest RC30.

Everytime the router is restarted, the hostname changes to the reverse-dns. Is there a way of blocking this from happening ?

Thanks,

Matthew.

xezen · Tue Jan 05, 2016 2:32 pm

tried everything and keep getting this error

error.jpg

Tue Jan 05, 2016 2:33 pm

tried everything and keep getting this error

The error clearly says your PC disk is full

xezen · Tue Jan 05, 2016 2:44 pm

tried everything and keep getting this error
The error clearly says your PC disk is full

size.jpg

Tue Jan 05, 2016 2:48 pm

ESXi configuration includes some other disk that is used, please see VMware manual to fix this. The screenshot shows disks that the virtual machine can use, but there are others configured in the ESXI config.

ploquets · Tue Jan 05, 2016 3:02 pm

tried everything and keep getting this error
error.jpg

I'm getting same error here....

When installing routerOS..... almost done and it fails with same error:

The error is while installing the OS (from the download image)

What I've tried:

Install OS from VMware Workstation: Works.
Resize disk with VMware Workstation: Works
Migrate resized and installed image to ESXi: Work for sometime but after disk write it fails with same error
Download image and resize the RAW image with qemu: Resize Works
Convert RAW image to VMDK with qemu: Works
Create a Virtual Machine inside ESXi with the resized vmdk image by qemu: Works
Start virtual Machine on ESXi and start install: works
Finished install: SAME ERROR!

What is wrong ??!?!?!

HELP PLEASE!

xezen · Tue Jan 05, 2016 3:13 pm

funny when i install any other vmware hdd image it works or install any other vmware os it works just when i add mikrotiks i get this error

Tue Jan 05, 2016 3:16 pm

Right-click the VM and go to Edit Settings > Options tab > Swapfile location. Select one of the other options ("Always store with the virtual machine" is recommended and will probably work for you since that datastore has a lot of free space). As far as cleaning up that datastore, you can right-click it and Browse and poke around to see what kind of files are taking up the space. It may be likely that your host is configured to use a different datastore for all VMs by default and it is just taken up by swap files at this point.

HellMind · Tue Jan 05, 2016 3:23 pm

Any news on runing it on xen, or xenserver ?

janisk · Tue Jan 05, 2016 3:24 pm

ploquets - there an issue on ESXi and XVM (including Amazon) that when you want to import the installer image that is provided on the download page you have to run through the installer and then that image should be used in AMI or virtual machine creation on XEN, ESXi or Amazon (that is XEN)

xezen · Tue Jan 05, 2016 3:28 pm

Right-click the VM and go to Edit Settings > Options tab > Swapfile location. Select one of the other options ("Always store with the virtual machine" is recommended and will probably work for you since that datastore has a lot of free space). As far as cleaning up that datastore, you can right-click it and Browse and poke around to see what kind of files are taking up the space. It may be likely that your host is configured to use a different datastore for all VMs by default and it is just taken up by swap files at this point.

that didnt work i did try it as you say with the swap files

cleaned up the stores and also tryed it with just the mikrotik image on it

did a clean install created chr-6.34rc30 and same error then added all the other vm's and they started with no problem

xezen · Tue Jan 05, 2016 3:33 pm

ploquets - there an issue on ESXi and XVM (including Amazon) that when you want to import the installer image that is provided on the download page you have to run through the installer and then that image should be used in AMI or virtual machine creation on XEN, ESXi or Amazon (that is XEN)

i did see this the image it creates but if i use that image it tells me that the operating systems missing

ploquets · Tue Jan 05, 2016 3:34 pm

... datastore has a lot of free space). As far as cleaning up that datastore, you can right-click it and Browse and poke around to see what kind of files are taking up the space. It may be likely that your host is configured to use a different datastore for all VMs by default and it is just taken up by swap files at this point.

DataStore has plenty space

Even after changing the swap files for every possible option, I get same error.
Seems that the VMware snapshot engine is causing this, because the error is at the .s001 which seems to be linked with the snapshot system.

But I've tried to make the disk Independent (supposedly will disable snapshot engine) but it fails again.

apteixeira · Tue Jan 05, 2016 3:37 pm

Hey Guys,

I am using CHR on AWS using the AMI you provided, and upgraded it to the latest RC30.

Everytime the router is restarted, the hostname changes to the reverse-dns. Is there a way of blocking this from happening ?

Thanks,

Matthew.

Hello dirtonth,

You can try disabling the DHCP client options in CHR.

Best regards.

ClayE · Tue Jan 05, 2016 7:30 pm

Just downloaded chr-6.34rc30.vhdx. It looks like it gets stuck trying to start services and reboots itself.
Windows 8.1 - Hyper-v
VM has 2GB of ram (tried 512MB also)
Anyone have a link to an older RC that I can try ?

*Edit*
Scratch that, looks like RC 30,29,21 all seem to reboot continuously. Anyone have a recommendation?

*Edit 2*
Scratch all of this. It looks like the CHR will not boot / function on my laptop (Win 8.1 64bit) with Hyper-v (possibly something broken on my end). Looks like the VM boots on a test bed server 2012R2 + Hyper-v.

lorenzo95 · Wed Jan 06, 2016 12:24 am

... datastore has a lot of free space). As far as cleaning up that datastore, you can right-click it and Browse and poke around to see what kind of files are taking up the space. It may be likely that your host is configured to use a different datastore for all VMs by default and it is just taken up by swap files at this point.
DataStore has plenty space

Even after changing the swap files for every possible option, I get same error.
Seems that the VMware snapshot engine is causing this, because the error is at the .s001 which seems to be linked with the snapshot system.

But I've tried to make the disk Independent (supposedly will disable snapshot engine) but it fails again.

The only way around that issue with ESXi that I have found so far is to first run the disk in VMware Workstation and let it install. Then export the working VM to an OVA or OVF and use that via "deploy ova" in the Vsphere client. It's the only way I have been able to successfully deploy CHR on ESXi.

janisk · Wed Jan 06, 2016 3:49 pm

Just downloaded chr-6.34rc30.vhdx. It looks like it gets stuck trying to start services and reboots itself.
Windows 8.1 - Hyper-v
VM has 2GB of ram (tried 512MB also)
Anyone have a link to an older RC that I can try ?

*Edit*
Scratch that, looks like RC 30,29,21 all seem to reboot continuously. Anyone have a recommendation?

*Edit 2*
Scratch all of this. It looks like the CHR will not boot / function on my laptop (Win 8.1 64bit) with Hyper-v (possibly something broken on my end). Looks like the VM boots on a test bed server 2012R2 + Hyper-v.

there are problems on Windows 10 Pro Hyper-V, probably you have the same problem on your version of Windows. We are working on the issue for Windows 10 Pro at the moment. From get go we tested on Windows server.

HellMind · Wed Jan 06, 2016 5:37 pm

Nobody need chr on xenserver or xen?
I think everyone is using old versions.

xezen · Thu Jan 07, 2016 11:00 am

... datastore has a lot of free space). As far as cleaning up that datastore, you can right-click it and Browse and poke around to see what kind of files are taking up the space. It may be likely that your host is configured to use a different datastore for all VMs by default and it is just taken up by swap files at this point.
DataStore has plenty space

Even after changing the swap files for every possible option, I get same error.
Seems that the VMware snapshot engine is causing this, because the error is at the .s001 which seems to be linked with the snapshot system.

But I've tried to make the disk Independent (supposedly will disable snapshot engine) but it fails again.
The only way around that issue with ESXi that I have found so far is to first run the disk in VMware Workstation and let it install. Then export the working VM to an OVA or OVF and use that via "deploy ova" in the Vsphere client. It's the only way I have been able to successfully deploy CHR on ESXi.

did that and also worked for me

Nunak · Fri Jan 08, 2016 10:21 am

... datastore has a lot of free space). As far as cleaning up that datastore, you can right-click it and Browse and poke around to see what kind of files are taking up the space. It may be likely that your host is configured to use a different datastore for all VMs by default and it is just taken up by swap files at this point.
DataStore has plenty space

Even after changing the swap files for every possible option, I get same error.
Seems that the VMware snapshot engine is causing this, because the error is at the .s001 which seems to be linked with the snapshot system.

But I've tried to make the disk Independent (supposedly will disable snapshot engine) but it fails again.
The only way around that issue with ESXi that I have found so far is to first run the disk in VMware Workstation and let it install. Then export the working VM to an OVA or OVF and use that via "deploy ova" in the Vsphere client. It's the only way I have been able to successfully deploy CHR on ESXi.

[/quote]

Dear Mikrotik,

when will be this problem solved ? I would like to test Cloud hosted router... but if I have not workstation it is not possible for me.

It is so difficult for mikrotik guys did ova ? It is only about did export from vmware ..

Thanks
Nunak

xezen · Fri Jan 08, 2016 4:24 pm

how do i upgrade chr to latest version

tells me dns dont resolve

ilnicchio · Fri Jan 08, 2016 4:43 pm

I also want to use CHR with XenServer 6.5.0 but doesn't start also with viridian=false... what we need to do?

HellMind · Fri Jan 08, 2016 9:22 pm

I also want to use CHR with XenServer 6.5.0 but doesn't start also with viridian=false... what we need to do?

I cant make it start with xen 4.4
But also I need it for xen 6.2 SP 1

AlexS · Sat Jan 09, 2016 11:27 pm

Any one been able to get more than 2Gb/s on CHR on VMWare with vmxnet3 drivers for 1 tcp stream ?

janisk · Tue Jan 12, 2016 12:17 pm

those that have problems on XEN/AMI etc try to run the image under kvm or similar. You have to finish the installation and use the image then. Before that you can resize the image as after the installation resizing is not possible.

ploquets · Tue Jan 12, 2016 1:29 pm

Making the OVF does work.Thanks!

ploquets · Tue Jan 12, 2016 1:46 pm

I'm trying to use a CHR as PPPoE Server with Radius authentication.
But every time a client reach a full traffic specified on queue... the CHR reboots.

This happens specially when using a SpeedTest.

If I kill the queue related to the PPPoE client, everything works OK. But then I cannot limit the client.
The queue is generated automatically, but even if I try to setup manually the same kind of queue, same thing happens.

Using latest version 6.34rc34

Please Help!

------------------------------------------------------------------------------------------------------------------------------------
Edit:
I've installed the stable version, 6.33.3 x86 on top of ESXi and everything went well.
Same scenario from the CHR, but CHR reboots it self when queue reaches the top.

It's probably a bug from CHR. Thanks

sb1349 · Tue Jan 12, 2016 8:26 pm

Nunak
To get this working in vsphere 6 I had to use the vmware standalone converter. First import the disk image and create a template on the esx server but do not power it on. Copy the folder to your computer and then run it in the converter application. After this I was able to re-size the vm hard drive size without corrupting it.

HellMind · Wed Jan 13, 2016 9:19 pm

Anyone successfull with xenserver?

Sanity · Thu Jan 14, 2016 10:59 am

Just 2 environments

* Confirmed running and well behaving on Hyper-V? Then I will grab one and start playing with it for our external hub link.
* Did anyone get it running on Azure? I Know Azure has their own service for VPN etc. - but besides the cost of it (which is unreasonable) - I consider adding some machines to Azure and want to standardize the whole routing infrastructure on Mikrotik. What is the setup for Azure? VM with IPLP so one has full control over the IP?

janisk · Thu Jan 14, 2016 11:02 am

Hyper-V there is an issue on Windows 10Pro. It is working on Windows Server 2012 rc2 without any issues.

Sanity · Fri Jan 15, 2016 12:09 am

Which is what I use - so I will start testing it on our chicago node

Any word on Azure?

HellMind · Fri Jan 15, 2016 12:12 am

There is very large number of people asking for XENSERVER support.

Anyone knows how to fix this?
http://puu.sh/mvStA/c2dfa0360e.png

adamnash · Fri Jan 15, 2016 7:51 am

Why call it "Cloud Hosted"? Is there the ability to actually have a custom RouterOS installation hosted on a general hosting provider (NOT a specialized provider that would let you run custom VMs...)?

Have you guys (at MikroTik) considered maybe offering such a service (preferably one which, just like this VM, has full functionality, but with rate limits). If you do, I for one would certainly end up using it, as right now, to test my API client, I need to set up a VM on my PC, and no 3rd party CI service allows me to do the same with their infrastructure.

As it currently stands, this "Cloud Hosted Router" is really more like "RouterOS VM Edition".

According to me
cloud hosting is much better than other hosting solution as cloud hosting is more depended
that why i prefer MikroTik cloud hosting

janisk · Fri Jan 15, 2016 12:15 pm

There is very large number of people asking for XENSERVER support.

Anyone knows how to fix this?
http://puu.sh/mvStA/c2dfa0360e.png

what you did? Did you try to start KVM using this image so that installer finishes and then run XEN using this.

HellMind · Fri Jan 15, 2016 1:33 pm

There is very large number of people asking for XENSERVER support.

Anyone knows how to fix this?
http://puu.sh/mvStA/c2dfa0360e.png
what you did? Did you try to start KVM using this image so that installer finishes and then run XEN using this.

No, I dont know how KVM works.
I tried kvm img but it fails.

That error can be fixed runing kvm on it?

I got a working img in xen.4.4 , should I try import that image?

mpreissner · Fri Jan 15, 2016 2:43 pm

Anyone have performance metrics related to AWS instance size? I'm looking at using the CHR as a VPN/Router for a corporate cloud infrastructure, and want to be able to price out the instance sizes in terms of routing performance within the VPC as well as number of concurrent users I can support via VPN (most likely SSTP).

Any info is greatly appreciated!

HellMind · Fri Jan 15, 2016 7:43 pm

There is very large number of people asking for XENSERVER support.

Anyone knows how to fix this?
http://puu.sh/mvStA/c2dfa0360e.png
what you did? Did you try to start KVM using this image so that installer finishes and then run XEN using this.
No, I dont know how KVM works.
I tried kvm img but it fails.

That error can be fixed runing kvm on it?

I got a working img in xen.4.4 , should I try import that image?

Its working

I uploaded the runing image from xen

xe vdi-import uuid=dca021e7-bb63-4758-804d-68bdee20ab0e filename=chr-6.34rc34.img

janisk · Mon Jan 18, 2016 2:38 pm

for amazon cloud - you have to update to 6.34rc39 or newer.

Here is the new AMI IDs (~1GB of storage):
AMI ID us-west1 ami-8fba10fc (on us-east1 ami-5081a53a)

p.s. if there is important update we will create new AMI image so it is easier to launch as generic CHR as it is possible.

Hammy · Mon Jan 18, 2016 3:24 pm

You guys need to make an OVA for VMWare deployment.

i4jordan · Mon Jan 18, 2016 5:23 pm

@Janisk

For now the 6.34rc39 version is not available. The latest is 6.34rc36.

apteixeira · Mon Jan 18, 2016 5:42 pm

Anyone have performance metrics related to AWS instance size? I'm looking at using the CHR as a VPN/Router for a corporate cloud infrastructure, and want to be able to price out the instance sizes in terms of routing performance within the VPC as well as number of concurrent users I can support via VPN (most likely SSTP).

Any info is greatly appreciated!

Hello mpreissner,

I just launched tree t2.nano instances in VPC in production environment. The performance is very nice. The maximum throughput is like 150 Mbps using that kind of instance (smallest one in AWS). I am using as VPN server and gateway, and also running BGP.

I am very happy with the stability and performance.

I asume that the performance will increase if you use another instance like m3, or bigger.

Best regards.

Sent from my SM-A500Y using Tapatalk

mpreissner · Mon Jan 18, 2016 8:04 pm

Anyone have performance metrics related to AWS instance size? I'm looking at using the CHR as a VPN/Router for a corporate cloud infrastructure, and want to be able to price out the instance sizes in terms of routing performance within the VPC as well as number of concurrent users I can support via VPN (most likely SSTP).

Any info is greatly appreciated!
Hello mpreissner,

I just launched tree t2.nano instances in VPC in production environment. The performance is very nice. The maximum throughput is like 150 Mbps using that kind of instance (smallest one in AWS). I am using as VPN server and gateway, and also running BGP.

I am very happy with the stability and performance.

I asume that the performance will increase if you use another instance like m3, or bigger.

Best regards.

Sent from my SM-A500Y using Tapatalk

Thanks! This is exactly the kind of info I'm looking for. The environment I'm looking to support is essentially a handful of servers, with about 50 users that will sporadically connect to pull down Group Policy from the AD and run compliance checks on their systems. It sounds like I can get away with a t2 instance pretty easily, so that'll look great when I go ask for budget!

janisk · Tue Jan 19, 2016 9:24 am

@Janisk

For now the 6.34rc39 version is not available. The latest is 6.34rc36.

Eventually, this will become available for other architectures too. So yeah, 6.34rc39 for CHR fixes important problem on AWS. So get this if you are launching new instances.

AtmanActive · Wed Jan 20, 2016 10:13 pm

Hello,

Am I doing something wrong or as of now (2016-01-20) it is still not possible to buy a license for CHR.

I am running v6.34rc41 and whenever I try to follow the instructions published here:

http://wiki.mikrotik.com/wiki/Manual:CHR#CHR_Licencing

... I get the error message 'ERROR: This System ID with old ID already received trial license key' on the Renew License window where I need to type in my MikroTik shop account username and password.

License window shows System ID 'WtgfTcn7YNA', level 'free', Next Renewal At:'', Deadline At:'', but even when I try 'Generate New ID', still I get the same result.

Is it possible to buy a CHR license right now, or is it something planned for the future?

Thanks.

P.S. Come on guys, I want to send money your way

kasparskr · Thu Jan 21, 2016 9:49 am

Hello,

... I get the error message 'ERROR: This System ID with old ID already received trial license key' on the Renew License window where I need to type in my MikroTik shop account username and password.

License window shows System ID 'WtgfTcn7YNA', level 'free', Next Renewal At:'', Deadline At:'', but even when I try 'Generate New ID', still I get the same result.

AtmanActive, am I understanding you correctly that even after generating new System ID it remains the same 'WtgfTcn7YNA'?

How did you install this VM, did you clone/copy it from another which already had a trial license? What is the ID of that machine?

AtmanActive · Thu Jan 21, 2016 10:40 am

No, every time I click on 'Generate New ID', I do indeed get a new ID, but even then, when I try to buy the license, I get the same error.

I installed it through AWS Web UI via AMI 'ami-c6287dac'. After that I did several Package Upgrades directly from MikroTik's WinBox UI. Strangely, now when I visit my instance details, under 'AMI ID' field I see this text: 'Cannot load details for ami-c6287dac. You may not be permitted to view it.'.
.
>> What is the ID of that machine?

Which ID exactly? Where can I see it?

janisk · Thu Jan 21, 2016 11:28 am

you need newer CHR version. at least 6.34rc39. look up tese ami images eu-west1 ami-8fba10fc and on us-east1 ami-5081a53a and launch new instance. These AMIs are created by us.

AtmanActive · Thu Jan 21, 2016 3:35 pm

Yup.
That worked.
Thank you very much for you support.

Somehow I imagined that just upgrading RouterOS packages will be enough to keep it up to date, but obviously the old AMI just got stuck.
Now I re-instantiated with 'ami-5081a53a' and everything works as expected.

Now I am a proud owner of a CHR paid license.

syadnom · Fri Jan 22, 2016 12:37 am

Ok, I'm testing CHR 6.34rc41 on a vCloud system hw version 10. I'm using VMXNET3 on interfaces.

My goal is to move to a hosted router for our wISP. A LOT of advantages to not running hardware and letting our upstream datacenter handle that.

So, I'm having a throughput issue and I'd like to know what we should expect from CHR.

With 1Ghz and 1GB RAM, and the VM set for highest resource priority so there is no contention, I'm getting somewhat erratic iperf3 results across the CHR with no fw, no queues, nothing at all. Averaging about 350Mbps one way, 165Mbps duplex.

I can get MUCH more than this off hardware. A small 1Ghz ALIX APU board can do nearly Gigabit full duplex with RouterOS.

Where is the performance target for this? Are you guys planning on near performance parity with hardware?

s802 · Fri Jan 22, 2016 7:34 pm

Working well in Azure, convert vhdx disk to vhd for azure, upload to azure and do the usual to make it a disk (mark as Linux).
let's assume you have azure PowerShell working
PS C:\> Add-AzureVhd -Destination https://<yourstore>.blob.core.windows.net/vhds/mikrotik.vhd -LocalFilePath c:\vhd\chr-6.34rc39.vhd

In the azure classic portal, browse to virtual machines,
then browse to disks, click add (browse to images if you plan to deploy a few of these you can store it as an image in your library)
Select the VHD from the library where you uploaded, give it a name, tick this disk contains an operating system, set it as Linux.

if all goes well your in business, new, compute, from gallery, My Images/My disk, you should see it there, follow the usual azure deployment procedure, I found it easier to load it as an image then I could fire up a few Mikrotik routers for testing

Azure brought in the ability to use a VM as a gateway late last year, this works with mikrotik
Run this powershell.

Get-AzureVM -Name MikrotikRouter -ServiceName MikrotikRouter | Set-AzureIPForwarding -Enable

Then your going to need to follow the guise below to setup your custom routing table

https://azure.microsoft.com/en-us/docum ... -overview/

I've only got the free licence running so limited to 1Mbit (limit only seems to apply to send) I;ve managed to get 100Mbit on receive tests. Happy to test both ways if there is a trial licence going

Static ip allocation through the azure portal works fine (it's just dhcp), trying to change the Ethernet interface Ip manually does appear to break things (like all azure services) .

Running my test boxes on Azure A0 without issue, so 11 euro a month to run if on 24x7.

Openvpn works fine, haven't got round to trying pptp/l2tp/ipsec yet.