Community discussions

MikroTik App
 
User avatar
kolorasta
Member
Member
Topic Author
Posts: 304
Joined: Sun Jun 25, 2006 11:55 pm
Location: Argentina

layer-7 in mangle with high traffic hangs RouterOS :(

Thu Dec 04, 2008 3:48 am

i have these rules in mangle, within others
add action=mark-packet chain=forward comment="ares layer7" disabled=yes \
    layer7-protocol=ares new-packet-mark=p2p passthrough=no
add action=mark-packet chain=forward comment="edonkey layer7" disabled=yes \
    layer7-protocol=edonkey new-packet-mark=p2p passthrough=no
add action=mark-packet chain=forward comment="bittorrent layer7" disabled=yes \
    layer7-protocol=bittorrent new-packet-mark=p2p passthrough=no
add action=mark-packet chain=forward comment="directconnect layer7" disabled=\
    yes layer7-protocol=directconnect new-packet-mark=p2p passthrough=no
add action=mark-packet chain=forward comment="fasttrack layer7" disabled=yes \
    layer7-protocol=fasttrack new-packet-mark=p2p passthrough=no
add action=mark-packet chain=forward comment="gnutella layer7" disabled=yes \
    layer7-protocol=gnutella new-packet-mark=p2p passthrough=no
add action=mark-packet chain=forward comment="imesh layer7" disabled=yes \
    layer7-protocol=imesh new-packet-mark=p2p passthrough=no
add action=mark-packet chain=forward comment="napster layer7" disabled=yes \
    layer7-protocol=napster new-packet-mark=p2p passthrough=no
add action=mark-packet chain=forward comment="soulseek layer7" disabled=yes \
    layer7-protocol=soulseek new-packet-mark=p2p passthrough=no
add action=mark-connection chain=forward comment=p2p disabled=no \
    new-connection-mark=p2p_conn p2p=all-p2p passthrough=yes
add action=mark-packet chain=forward comment=\
    "[][][][][][][][][][][][] P2P traffic" connection-mark=p2p_conn disabled=\
    no new-packet-mark=p2p passthrough=no
in low traffic hours everything is ok. in high traffic hours, ROS hangs and reboot. it works no more than 1minute after reboot, and hangs again. no autosupport is generated.
i use those marked packet to drop p2p or to give low priority (i know that that doesn't work to shape traffic in encrypted clients).

why do you think ROS hangs.
that behavior was tested in ROS v3.14, v3.15 & 3.16.
 
User avatar
normis
MikroTik Support
MikroTik Support
Posts: 26376
Joined: Fri May 28, 2004 11:04 am
Location: Riga, Latvia

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Thu Dec 04, 2008 1:19 pm

that's maybe too many L7 dependent rules. L7 is very very CPU intensive, use it as minimal as you can
 
User avatar
kolorasta
Member
Member
Topic Author
Posts: 304
Joined: Sun Jun 25, 2006 11:55 pm
Location: Argentina

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Thu Dec 04, 2008 2:57 pm

ok ... thanks for your advise :)
 
User avatar
mrz
MikroTik Support
MikroTik Support
Posts: 7053
Joined: Wed Feb 07, 2007 12:45 pm
Location: Latvia
Contact:

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Thu Dec 04, 2008 3:07 pm

add action=mark-connection chain=forward comment=p2p disabled=no \
    new-connection-mark=p2p_conn p2p=all-p2p passthrough=yes
This rule should be before all other layer7 rules.
Use regular rules to mark as many as you can and only then for the rest of the packets use layer7.
 
User avatar
kolorasta
Member
Member
Topic Author
Posts: 304
Joined: Sun Jun 25, 2006 11:55 pm
Location: Argentina

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Thu Dec 04, 2008 10:10 pm

add action=mark-connection chain=forward comment=p2p disabled=no \
    new-connection-mark=p2p_conn p2p=all-p2p passthrough=yes
This rule should be before all other layer7 rules.
Use regular rules to mark as many as you can and only then for the rest of the packets use layer7.
all layer-7 rules are executed beacuse of the "passthrough=yes" of the rule you mention.

it's wired because those rules are executed in a Celeron 2GHz... Normis says that layer-7 is very very cpu intensive, but when my ROS hangs only 15% or 20% of cpu usage is present.
 
itfutura
newbie
Posts: 32
Joined: Tue May 22, 2007 1:25 pm
Location: Poland
Contact:

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Sun Dec 07, 2008 12:30 am

Do not use imesh and L7. Imesh regexp is fulting ROS. Dont know why.
 
User avatar
hulk-bd
Member Candidate
Member Candidate
Posts: 231
Joined: Mon Sep 03, 2007 7:19 pm
Location: Uttara, Dhaka, Bangladesh

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Sun Dec 07, 2008 2:00 pm

itfutura is right, imesh L-7 is not work here. But else L-7 is magic, it really is. I'm using L-7 http protocol for http marking and it's just wonderful, can't imagine how good it is. I have put another L-7 http protocol in MT (not from MT wiki) from L-7 protocol website and it's says this L-7 http protocol is faster then previous one. you ppl can give it a try.

Thanks
 
rarbolay
Frequent Visitor
Frequent Visitor
Posts: 99
Joined: Mon Aug 20, 2007 6:36 pm

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Mon Dec 22, 2008 8:54 pm

I have been using L7 from the Wiki for about 2 weeks so far and really happy with it. But, I notice that I can have 2 Mbs of traffic at the interface whil seeing only 300kbs of traffic on the DSL_In qeue? What gives? What traffic am I missing?
 
rarbolay
Frequent Visitor
Frequent Visitor
Posts: 99
Joined: Mon Aug 20, 2007 6:36 pm

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Mon Dec 22, 2008 9:05 pm

hulk, please post the regexp for http. Thanks.
 
User avatar
hulk-bd
Member Candidate
Member Candidate
Posts: 231
Joined: Mon Sep 03, 2007 7:19 pm
Location: Uttara, Dhaka, Bangladesh

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Tue Dec 23, 2008 11:42 am

HTTP L-7 :


http/(0\.9|1\.0|1\.1) [1-5][0-9][0-9]|post [\x09-\x0d -~]* http/[01]\.[019]
# old pattern(s):
#(http[\x09-\x0d -~]*(200 ok|302 |304 )[\x09-\x0d -~]*(connection:|content-type:|content-length:))|^(post [\x09-\x0d -~]* http/)
 
rarbolay
Frequent Visitor
Frequent Visitor
Posts: 99
Joined: Mon Aug 20, 2007 6:36 pm

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Tue Dec 23, 2008 7:51 pm

Thanx, I'll try it
 
rarbolay
Frequent Visitor
Frequent Visitor
Posts: 99
Joined: Mon Aug 20, 2007 6:36 pm

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Wed Dec 24, 2008 7:23 am

Can someone check me, I might be doing something wrong.
All my traffic is piped thru a MT x86 router. On one end I have a 6Mbs DSL line (called Ouside) and on the other I have a connection to a MT532 that then feeds 3 other MT routers and 58 UBNT CPEs. I have been watching my traffic and I can see some strange readings. The outside interface will read 2.5Mbs Rx while the Qeue DSL_In will read 450Kbs. It should match since the DSL_In parent is global_in. Here is a sample of my config:

Flags: X - disabled, I - invalid, D - dynamic
0 ;;; 100bao_p2p
chain=prerouting action=mark-packet new-packet-mark=100bao_p2p_in
passthrough=yes layer7-protocol=100bao in-interface=Local

1 chain=postrouting action=mark-packet new-packet-mark=100bao_p2p_out
passthrough=yes layer7-protocol=100bao out-interface=Outside

2 ;;; aim mesenger
chain=prerouting action=mark-packet new-packet-mark=aim_mesanger_in
passthrough=yes layer7-protocol=aim in-interface=Local

3 chain=postrouting action=mark-packet new-packet-mark=aim_mesanger_out
passthrough=yes layer7-protocol=aim out-interface=Outside

4 ;;; aim_messenger_web
chain=prerouting action=mark-packet new-packet-mark=aim_mesenger_web_in
passthrough=yes layer7-protocol=aimwebcontent in-interface=Local

5 chain=postrouting action=mark-packet new-packet-mark=aim_mesenger_web_out
passthrough=yes layer7-protocol=aimwebcontent out-interface=Outside

...and my queu tree:

Flags: X - disabled, I - invalid
0 name="DSL_IN" parent=global-in packet-mark="" limit-at=5000000
queue=default priority=1 max-limit=6000000 burst-limit=0
burst-threshold=0 burst-time=0s

1 name="100bao_p2p_in" parent=DSL_IN packet-mark=100bao_p2p_in limit-at=0
queue=default priority=8 max-limit=0 burst-limit=0 burst-threshold=0
burst-time=0s

2 name="aim_mesanger_in" parent=DSL_IN packet-mark=aim_mesanger_in
limit-at=0 queue=default priority=6 max-limit=0 burst-limit=0
burst-threshold=0 burst-time=0s

3 name="aim_mesenger_web_in" parent=DSL_IN packet-mark=aim_mesenger_web_in
limit-at=0 queue=default priority=6 max-limit=0 burst-limit=0
burst-threshold=0 burst-time=0s

4 name="applejuice_in" parent=DSL_IN packet-mark=applejuice_in limit-at=0
queue=default priority=7 max-limit=0 burst-limit=0 burst-threshold=0
burst-time=0s

5 name="ares_p2p_in" parent=DSL_IN packet-mark=ares_p2p_in limit-at=0
queue=default priority=7 max-limit=0 burst-limit=0 burst-threshold=0

Any ideas???
 
User avatar
NetworkPro
Forum Guru
Forum Guru
Posts: 1376
Joined: Mon Jan 05, 2009 6:23 pm
Location: bit.ly/the-qos
Contact:

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Sat Jan 17, 2009 1:34 am

wiki example is missing all the rest of the traffic. whoever put it up there made all a bad favor :lol:

example:

103 X ;;; all-other
chain=prerouting action=mark-packet new-packet-mark=all-other_in passthrough=no in-interface=ADSL1

104 X chain=postrouting action=mark-packet new-packet-mark=all-other_out passthrough=no out-interface=ADSL1

Haha if our problem with RB433AH is caused by the stupid imesh layer 7 then whoever put it on the WiKi made us a huge bad favor :lol:

p.s. I have found that the WiKi for L7 - there is no way to use it like it is - the rules get inserted with lots of errors. I don't know how one must paste them one by one or something for it to work. I'm very angry.

What I did and it didnt work was - copy paste them into a txt which then renamed to src and uplaoded to the router. It seems the txt was the wrong encoding or something. This is very bad.
 
User avatar
NetworkPro
Forum Guru
Forum Guru
Posts: 1376
Joined: Mon Jan 05, 2009 6:23 pm
Location: bit.ly/the-qos
Contact:

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Sun Jan 18, 2009 12:22 am

Which one is correct?!?!

Image

the first one is from http://l7-filter.sourceforge.net/protocols.en.php and the second one is from http://wiki.mikrotik.com/wiki/Basic_tra ... _protocols

:(
 
User avatar
mrz
MikroTik Support
MikroTik Support
Posts: 7053
Joined: Wed Feb 07, 2007 12:45 pm
Location: Latvia
Contact:

Re: layer-7 in mangle with high traffic hangs RouterOS :(

Mon Jan 19, 2009 12:15 pm

both are correct. There was a bug in l7 that hex values were not accepted, that is the reason why in mikrotik wiki all hex values are replaced with corresponding ascii characters.

Who is online

Users browsing this forum: fadelliz78, jimint, ShindigNZ and 80 guests