I'm writing a simple script on php, that adding and removing entries to/from mikrotik's address-list. I'm using phpseclib to make ssh connections.
It works, but slowly - about 1 second for each command passed to mikrotik.
Here's detailed info on latencies.
From begining to login - 0.10053205490112 sec
1st command - 1.006432056427 sec (/ip firewall address-list remove [/ip firewall address-list find comment="{$guid}"])
2nd command - 1.0368900299072 sec (/ip firewall address-list add list="{$group}" address="{$ip}" comment="{$guid}")
From disconnecting to end - 0.00031399726867676 sec
Is it mikrotik or phpseclib problem? Is there other solutions?
Sadly, but php_ssh extension not working on windows and crashing apache.
PS: RB 1100, ROS 5.5. Windows 2003 on billing server.
Re: slow ssh commands executing from remote script
Is there any specific reason that you're not using the API?
Re: slow ssh commands executing from remote script
Which API?Is there any specific reason that you're not using the API?
Billing, that I want to communicate with mikrotik, have a nice feature, when user change his state (authorized/unauthorized) - it will execute a script (if specified). So when user authorizes or unauthorizes - billing executing script, which send command to mikrotik (billing and mikrotik are separated on different hardware), allowing or disallowing internet to user. So all I need, is to find fast and good way to communicate billing with mikrotik.
Re: slow ssh commands executing from remote script
Wow, just wow.
That's very fast, 30ms vs 1000ms. Thank you!
Re: slow ssh commands executing from remote script
5.6 should also be faster to execute commands through SSH, but APi will beat that anyway.
Re: slow ssh commands executing from remote script
Sadly, but 30ms was when I used incorrect commands...
When I made script working - it's slow again...
1.0343606948853 sec 
((
Is there a way to make it faster?
When I made script working - it's slow again...
Code: Select all
$stt = microtime(true);
$API = new routeros_api();
$API->debug = false;
if($API->connect($cfg["mt_host"], $cfg["mt_username"], $cfg["mt_password"]))
{
// Id finding
$id = $API->comm("/ip/firewall/address-list/print", array(
".proplist" => ".id",
"?comment" => "{$guid}",
));
// Deleting address by id
$API->comm("/ip/firewall/address-list/remove", array(
".id" => $id[0][".id"],
));
// Adding address
$API->comm("/ip/firewall/address-list/add", array(
"list" => "{$group}",
"address" => "{$ip}",
"comment" => "{$guid}",
));
$API->disconnect();
$tm = microtime(true) - $stt;
if(IN_DEBUG) file_put_contents("C:\\log.txt", "( " . $tm . " )\r\n", FILE_APPEND);
}
Is there a way to make it faster?
Re: slow ssh commands executing from remote script
print with limitation is taking the time, and you can check how many IP addresses are in the list. Problem, it seems is that you have a lot of entries and just print takes the time you are measuring.
Measure just how long initial print takes. Remove by ID should be fast.
And how many entries are in the list you are searching.
Measure just how long initial print takes. Remove by ID should be fast.
And how many entries are in the list you are searching.
Re: slow ssh commands executing from remote script
6 entriesAnd how many entries are in the list you are searching.
Re: slow ssh commands executing from remote script
Can I define .id value manually to speed up list searching?
Re: slow ssh commands executing from remote script
as for me, adding of 41 entries takes 9 sec, and printing of the whole list of ~1k entries takes <1 sec
so, check time of each operation separately - seems like /print is not as long as modifying...
so, check time of each operation separately - seems like /print is not as long as modifying...
Re: slow ssh commands executing from remote script
I checked the time, that every command consumes. Is it normal?
$API->connect($cfg["mt_host"], $cfg["mt_username"], $cfg["mt_password"]); // 0.34563493728638 sec
$id = $API->comm("/ip/firewall/address-list/print", array(".proplist" => ".id", "?comment" => "{$guid}")); // 0.21873903274536 sec
$API->comm("/ip/firewall/address-list/remove", array(".id" => $id[0][".id"])); // 0.21874403953552 sec
$API->comm("/ip/firewall/address-list/add", array("list" => "{$group}","address" => "{$ip}","comment" => "{$guid}")); // 0.21876692771912 sec
$API->connect($cfg["mt_host"], $cfg["mt_username"], $cfg["mt_password"]); // 0.35410308837891 sec
$id = $API->comm("/ip/firewall/address-list/print", array(".proplist" => ".id","?comment" => "{$guid}")); // 0.10922288894653 sec
$API->comm("/ip/firewall/address-list/remove", array(".id" => $id[0][".id"],)); // 0.21878099441528 sec
Re: slow ssh commands executing from remote script
so, you cannot speed up the things - printing consumes even less resources than removing by .id
Re: slow ssh commands executing from remote script
there is something terribly wrong with php implementation then. 
I have written my C++ (along with Java)
and there
6 addititions and along with 6 removes
does this in less than 1 second:
that includes -> reading from file, parse the commands, execute the comands and update value of <var> after each execute.
however it is RB1000 and it is idling for most time of the day.
I have written my C++ (along with Java)
and there
Code: Select all
[admin@RB1000] /ip firewall address-list> print count-only
13
does this in less than 1 second:
Code: Select all
$ time ./TestAPI rb1000 list.tst
Attempting connect to bs
Connected to bs
Going to read file list.tst
list.tst size is: 12
test command dump start:
________________________
Command out:
|/ip/firewall/address-list/add
|=address=1.1.1.1
|=list=tst
Command out:
|/ip/firewall/address-list/remove
|=.id=<var>
Command out:
|/ip/firewall/address-list/add
|=address=1.1.1.1
|=list=tst
Command out:
|/ip/firewall/address-list/remove
|=.id=<var>
Command out:
|/ip/firewall/address-list/add
|=address=1.1.1.1
|=list=tst
Command out:
|/ip/firewall/address-list/remove
|=.id=<var>
mand out: |/ip/firewall/address-list/add
|/ip/firewall/address-list/remove
|=.id=<var>
Command out:
|/ip/firewall/address-list/add
|=address=1.1.1.1
|=list=tst
Command out:
|/ip/firewall/address-list/remove
|=.id=<var>
Command out:
|/ip/firewall/address-list/add
|=address=1.1.1.1
|=list=tst
Command out:
|/ip/firewall/address-list/remove
|=.id=<var>
________________________
test command dump end.
DEBUG: getVal 0
DEBUG: getVal 1
DEBUG: getVal 0
DEBUG: getVal 1
DEBUG: getVal 0
DEBUG: getVal 1
DEBUG: getVal 0
DEBUG: getVal 1
DEBUG: getVal 0
DEBUG: getVal 1
DEBUG: getVal 0
All list.tst tests passed
real 0m0.521s
user 0m0.000s
sys 0m0.000showever it is RB1000 and it is idling for most time of the day.
Re: slow ssh commands executing from remote script
I tried other implementations and seems you're right.there is something terribly wrong with php implementation then.
Sadly C++ implementation is only for linux, even after rewriting it for winsock2 - it crashing with assertion error about string subscript out of range, if not that, it will be the fastest one...
C# API implementations works only when there's a need in sending commands, it goes in infinite loop on ".id" reading after proper query, seems to be a bug in an implementation code. I've succesfully added new entry in address-list. It took about 500 msec. It's a good progress.
I'll try the C implementation tomorrow.
Any help will be appreciated.
Re: slow ssh commands executing from remote script
Well... after few hours of rewriting (to make it use winsock2 sockets) and then testing C implementation. I have not a bad results:
1 login
1 to 2 commands
1 logout
...took on average 650 msec. It's roughly ~2 times faster than php one and ~4 times faster than php through ssh implementation.
If anyone wants, I can post working mikrotik-api.c rewritten for winsock2.
1 login
1 to 2 commands
1 logout
...took on average 650 msec. It's roughly ~2 times faster than php one and ~4 times faster than php through ssh implementation.
If anyone wants, I can post working mikrotik-api.c rewritten for winsock2.
Re: slow ssh commands executing from remote script
you can post it on wiki (have to register on wiki.mikrotik.com) - just make article and place link here i will add to pages that are not editable for other users.
SSH through php is something mindbending - you are using php to create and maintain ssh connection and there the console runs. No surprise that it is slow as you are running layer upon layer there.
SSH through php is something mindbending - you are using php to create and maintain ssh connection and there the console runs. No surprise that it is slow as you are running layer upon layer there.
Re: slow ssh commands executing from remote script
phpseclib have its own SSH client written on pure PHP. I thought mikrotik does all operations in something like 100-200 msec (including login, command execution, logout), and it's not a problem to use PHP at all. It was a bad idea...SSH through php is something mindbending - you are using php to create and maintain ssh connection and there the console runs. No surprise that it is slow as you are running layer upon layer there.
I'll post sources on wiki tomorrow. Should I post all sources, or just one changed file - mikrotik-api.c ?
Re: slow ssh commands executing from remote script
it takes some time to parse the command for CLI connection, and some time to execute it. That comes with overhead. PHP after all is script language. maybe some PHP booster could help in this case with PHP code.
Maybe converting PHP to C++ and compiling it for your system would also increase the speed.
You can set code in wiki up as you want, you can reference unchanged code, or just place it all together in one page.
Maybe converting PHP to C++ and compiling it for your system would also increase the speed.
You can set code in wiki up as you want, you can reference unchanged code, or just place it all together in one page.
Re: slow ssh commands executing from remote script
http://wiki.mikrotik.com/wiki/API_in_C_using_winsockyou can post it on wiki (have to register on wiki.mikrotik.com) - just make article and place link here i will add to pages that are not editable for other users.
Maybe I'm not good at explaining things in the beginning of the page, please correct me.
English isn't my native language, I'm russian.
Re: slow ssh commands executing from remote script
thank you for your contribution
Re: slow ssh commands executing from remote script
PHP API is slow too as OP noted. You can benchmark stuff with phpseclib. See where the bottlenecks are. Bottleneck is probably in mikrotik tbh gven PHP API performance.phpseclib have its own SSH client written on pure PHP. I thought mikrotik does all operations in something like 100-200 msec (including login, command execution, logout), and it's not a problem to use PHP at all. It was a bad idea...SSH through php is something mindbending - you are using php to create and maintain ssh connection and there the console runs. No surprise that it is slow as you are running layer upon layer there.
I'll post sources on wiki tomorrow. Should I post all sources, or just one changed file - mikrotik-api.c ?
You could also try it with PuTTY. Do remote command in SSH section. If it's faster in the SSH console (as opposed to remote command section) try read() and write() with phpseclib and not exec().
Re: slow ssh commands executing from remote script
In SSH console it's does fast. 4-6 seconds for 100 entries.If it's faster in the SSH console (as opposed to remote command section) try read() and write() with phpseclib and not exec().
I tried write() commands. It's just didn't wait for command to complete. For that readon I used read() to avoid that. write + read completed in the exactly same time as exec.
Re: slow ssh commands executing from remote script
there are several things to consider:
* what router you are using?
* php is scripting language, they are slow (slower than C/C++
in my experience API is the fastest and safest method to communicate with the router from application.
* what router you are using?
* php is scripting language, they are slow (slower than C/C++
in my experience API is the fastest and safest method to communicate with the router from application.
Re: slow ssh commands executing from remote script
Well... After investigation on that problem, I've found that it was because of specific windows 2003 server configuration and it's not a mikrotik problem at all.
Server had Routing and Remote Access + NAT and Traffic Inspector in router mode enabled.
Average script execution time was 800 msec.
After removing Routing and Remote Access service + NAT, and reconfiguring Traffic Inspector in "sniffing" mode, very first seconds on the RDP I've noticed that all lags I've experienced before is now disappeared.
Now average script execution time is 100 msec.
Server had Routing and Remote Access + NAT and Traffic Inspector in router mode enabled.
Average script execution time was 800 msec.
After removing Routing and Remote Access service + NAT, and reconfiguring Traffic Inspector in "sniffing" mode, very first seconds on the RDP I've noticed that all lags I've experienced before is now disappeared.
Now average script execution time is 100 msec.