Community discussions

MikroTik App
 
YUJOBIKA
Member Candidate
Member Candidate
Topic Author
Posts: 122
Joined: Sat Sep 15, 2007 5:55 pm

Proxy ROS v3.7 & v3.8.

Thu May 08, 2008 9:31 pm

Hi,

Many days I tried proxy in ROS v3.7 and today (with hope) just tried v3.8. Come on Mikrotik ! what are you doing ???

My proxy can cache JPG, GIF, BMP, etc. But NEVER cache zip, exe, rar, etc. What is going on ?? I read all forums, but no clue...even ask to Mikrotik also no answer !

Anybody have same issue like me ?

Here my config:

> ip proxy pr
enabled: yes
src-address: 0.0.0.0
port: 5588
parent-proxy: 0.0.0.0
parent-proxy-port: 0
cache-drive: system
cache-administrator: "me"
max-cache-size: unlimited
cache-on-disk: yes
max-client-connections: 5000
max-server-connections: 5000
max-fresh-time: 3d
serialize-connections: yes
always-from-cache: yes
cache-hit-dscp: 10



> ip fire mang pr
Flags: X - disabled, I - invalid, D - dynamic
0 ;;; bypass-proxy-hit
chain=output action=mark-packet new-packet-mark=bypass-proxy-hit
passthrough=no out-interface=LAN dscp=10




Any advice ?
 
alex_rhys-hurn
Member
Member
Posts: 352
Joined: Mon Jun 05, 2006 8:26 pm
Location: Kenya
Contact:

Re: Proxy ROS v3.7 & v3.8 ....SUCKS !!!

Thu May 08, 2008 10:30 pm

Here is my advice.

Whilst Router OS itself has been around for some years and has now evolved to verison 3, the web proxy feature is actually brand new (in version 3.x) and in my opinion only in version 0.01.

Mikrotik chose to completely re-write FROM SCRATCH the web proxy feature. This means that it is extremely new software and doesnt have the maturity that the overall package has.

My suggestion is to deploy another more mature proxy solution. Obviously Squid springs to mind.

Squid has many features and performance, and can be customised (with the base OS) to run on any hardware, and some really powerful hardware designed for the purpose.

Remember the old quote, "Jack of all trades master of none" ? Mikrotik are going to have to think very carefully as they develop their product to make sure that this doesnt apply to them.

Another on of these features that is in its infancy is the MPLS support.

Rgds

Alex
 
User avatar
thavinci
Member
Member
Posts: 335
Joined: Sat Aug 04, 2007 4:40 pm
Location: Johannessburg
Contact:

Re: Proxy ROS v3.7 & v3.8 ....SUCKS !!!

Fri May 09, 2008 12:23 am

Lol, that very much applies to ROS already.
Nothing is exceptionally good and nothing is really stable.

I know i will get killed for saying this, but its true...

One problem will be fixed and another will be created.
I would stay on one version , but that version normally has an issue that forces me to upgrade to the next version and it's issues.


Web proxy has a tendancy on my side to simply stop running!
I have to untick "enable" and retick it to start it.

Very "stable" software :p
 
User avatar
fatonk
Member
Member
Posts: 438
Joined: Tue Feb 22, 2005 11:06 am
Location: Mitrovica/Kosova

Re: Proxy ROS v3.7 & v3.8 ....SUCKS !!!

Fri May 09, 2008 9:18 am

I'm facing similar problem, but in my case the interfaces disappear I thought that with version 3.8 the problem will go away but it is still present, for me restarting the web proxy doesn't work I have to reboot the whole machine.

My proxu settings are :

enabled: yes
src-address: 0.0.0.0
port: 8080
parent-proxy: 0.0.0.0
parent-proxy-port: 0
cache-drive: system
cache-administrator: "master"
max-cache-size: unlimited
cache-on-disk: yes
max-client-connections: 5000
max-server-connections: 5000
max-fresh-time: 3d
serialize-connections: no
always-from-cache: no
cache-hit-dscp: 4

Regards

Faton
 
User avatar
sergejs
MikroTik Support
MikroTik Support
Posts: 6695
Joined: Thu Mar 31, 2005 3:33 pm
Location: Riga, Latvia
Contact:

Re: Proxy ROS v3.7 & v3.8.

Fri May 09, 2008 11:53 am

Support has not received any reports about ZIP or RAR problems with cache.

I have tried with default proxy settings and downloaded zip file,
ip proxy> print 
                 enabled: yes
             src-address: 0.0.0.0
                    port: 8080
            parent-proxy: 0.0.0.0
       parent-proxy-port: 0
             cache-drive: CompactFlash
     cache-administrator: "webmaster"
          max-cache-size: unlimited
           cache-on-disk: yes
  max-client-connections: 600
  max-server-connections: 600
          max-fresh-time: 3d
   serialize-connections: no
       always-from-cache: no
          cache-hit-dscp: 4
then check ip proxy cache-contents print
URI FILE-SIZE LAST-MODIFIED LAST-ACCESSED
http://www.mikrotik.com/download/wireless_abg.zip 8567KiB may/09/2008 may/09/2008

Make sure that you have enough free space on your disk for cached file.
 
User avatar
sergejs
MikroTik Support
MikroTik Support
Posts: 6695
Joined: Thu Mar 31, 2005 3:33 pm
Location: Riga, Latvia
Contact:

Re: Proxy ROS v3.7 & v3.8.

Fri May 09, 2008 11:53 am

Faton, which interface is disappearing ?
 
User avatar
fatonk
Member
Member
Posts: 438
Joined: Tue Feb 22, 2005 11:06 am
Location: Mitrovica/Kosova

Re: Proxy ROS v3.7 & v3.8.

Fri May 09, 2008 12:37 pm

ethernet interfaces, I have 4 of them one Public and three local interfaces, after a certain time the interfaces disappear from the list of interfaces, if I want to monitor bandwidth the only thing that I can see is aggregate, no dynamic interfaces PPPOE no any other ethernet interface is shown just aggregate.
Very strange, I have no idea what is going on, i have tried to restart proxy but no luck I have tried to reboot the router in comanl-line but it will not respond, only hard (manual) reboot of the machine brings it back to the normal work.

regards

faton
 
alex_rhys-hurn
Member
Member
Posts: 352
Joined: Mon Jun 05, 2006 8:26 pm
Location: Kenya
Contact:

Re: Proxy ROS v3.7 & v3.8.

Fri May 09, 2008 12:46 pm

What makes you think that the proxy is causing this?

Are you sure that if you leave the proxy off, that the interfaces stay in the list all the time?

How long does it run for before the interfaces fail?

What hardware platform are you running on?
 
User avatar
fatonk
Member
Member
Posts: 438
Joined: Tue Feb 22, 2005 11:06 am
Location: Mitrovica/Kosova

Re: Proxy ROS v3.7 & v3.8.

Fri May 09, 2008 3:01 pm

Why ? because this happened after I have started web-proxy, before that I had no problem with that router.
 
User avatar
sergejs
MikroTik Support
MikroTik Support
Posts: 6695
Joined: Thu Mar 31, 2005 3:33 pm
Location: Riga, Latvia
Contact:

Re: Proxy ROS v3.7 & v3.8.

Fri May 09, 2008 3:19 pm

I agree with Alex, that it does not sound like proxy issues.
Which version do you have on that router ?
Do you have a bridge ?
 
YUJOBIKA
Member Candidate
Member Candidate
Topic Author
Posts: 122
Joined: Sat Sep 15, 2007 5:55 pm

Re: Proxy ROS v3.7 & v3.8.

Fri May 09, 2008 5:18 pm

Make sure that you have enough free space on your disk for cached file.

Hi, i am using 320 GB Hardisk. So space is not my problem. I tried all size of zip files (2mb, 3mb, 50mb, 100mb) but mikrotik won't cache those.

Some people said beter do with squid. But more hardware means more cost, more power, more ups, and more trouble shooting when problems come. Then I prefer to use internalproxy , but MT proxy made headache for me :(

Please solve this issue.
 
alex_rhys-hurn
Member
Member
Posts: 352
Joined: Mon Jun 05, 2006 8:26 pm
Location: Kenya
Contact:

Re: Proxy ROS v3.7 & v3.8.

Fri May 09, 2008 5:29 pm

Hey there....

Dont be sad! I am sure some solution can be made....

Can I suggest for testing purposes that we work our way back to where we can get a stable setting.

I would suggest that you try the following in this order:

1: Make the proxy settings completely default and then test to see if that resolves the interfaces issue.
2: if it does then add each extra setting you want 1 x 1. so, first serialize connections, and then test to see if its stable.

Make sure that when you are testing you give enough time, say 24 hours between changes (as internet loads vary)

3: Keep adding the features until you either see total stability or a failure. If you see a failure, try again to go back to the last setting that worked and see if it is still stable.

At that point you will have a concrete and re-producible error that you can then describe to the Mikrotik Team by sending a supout file.

I would also suggest that you reset the router to factory defaults and rebuild the config to see if something else is in there.

Are you sure your nat rules are all A-Ok?

I am standing by to help you....

Good Luck
 
User avatar
fatonk
Member
Member
Posts: 438
Joined: Tue Feb 22, 2005 11:06 am
Location: Mitrovica/Kosova

Re: Proxy ROS v3.7 & v3.8.

Fri May 09, 2008 6:38 pm

My problem started after 3.7 upgrade, yesterday I have upgraded to 3.8 for time being have no problem, will see if it occurs again.

regards

faton
 
User avatar
maroon
Member Candidate
Member Candidate
Posts: 230
Joined: Thu Oct 07, 2004 11:15 am
Location: Lebanon
Contact:

Re: Proxy ROS v3.7 & v3.8.

Fri May 09, 2008 11:59 pm

I always prefer to setup a dedicated cache server.... for example: SQUID...

if you need any help ... please let me know...

Regards,
 
User avatar
fatonk
Member
Member
Posts: 438
Joined: Tue Feb 22, 2005 11:06 am
Location: Mitrovica/Kosova

Re: Proxy ROS v3.7 & v3.8.

Sat May 10, 2008 12:16 am

I already have a cluster of SQUID servers, using wccp, but this router is in another network segment where the SQUID cache farm can't be reached, but anyway I upgraded to 3.9 and for the time being it looks very stable it seems that upgrade itself solved the problem. Wait and see.
 
YUJOBIKA
Member Candidate
Member Candidate
Topic Author
Posts: 122
Joined: Sat Sep 15, 2007 5:55 pm

Re: Proxy ROS v3.7 & v3.8.

Sat May 10, 2008 12:01 pm

v3.9 still NOT ready for proxy. When it will be ready ??

What's new in 3.9:

*) bridge could make router busy even without traffic;
*) fixed route redistribution in RIP (bug introduced in 3.8);
*) fixed AR5212 kernel crash on setting change;
 
User avatar
maroon
Member Candidate
Member Candidate
Posts: 230
Joined: Thu Oct 07, 2004 11:15 am
Location: Lebanon
Contact:

Re: Proxy ROS v3.7 & v3.8.

Sat May 10, 2008 12:57 pm

As I already mentioned in my later posts... better to use a dedicated squid for caching puporses!
 
User avatar
thavinci
Member
Member
Posts: 335
Joined: Sat Aug 04, 2007 4:40 pm
Location: Johannessburg
Contact:

Re: Proxy ROS v3.7 & v3.8.

Sat May 10, 2008 1:39 pm

I myself have a proxy farm going, however find it's usefull to save bandwidth on backbone links by putting a proxy on larger towers.

So although i use squid for the farm, i need ROS's proxy on the towers.

However ive seen how unstable it is!
 
YUJOBIKA
Member Candidate
Member Candidate
Topic Author
Posts: 122
Joined: Sat Sep 15, 2007 5:55 pm

Re: Proxy ROS v3.7 & v3.8.

Sat May 10, 2008 9:13 pm

Then Squid seems the winner for now.
I have 6 MT Router and each of them connected to 6 different internet backbone.

Is it possible to use only 1 Squid proxy server for those 6 routers ?
I prefer using 1 proxy server only (huge server), so this server will be full of harvest cached
Please advice and how to configure those MT Routers ?
 
User avatar
fatonk
Member
Member
Posts: 438
Joined: Tue Feb 22, 2005 11:06 am
Location: Mitrovica/Kosova

Re: Proxy ROS v3.7 & v3.8.

Mon May 12, 2008 6:54 pm

OK, with upgrade to 3.9 my problem of interface disappearing has gone, it seems that I had a faulty installation so after the upgrade probably the system got fixed, and the problem went away.

Regards.

Faton
 
kjagus
Frequent Visitor
Frequent Visitor
Posts: 74
Joined: Sun Jan 30, 2005 11:29 pm
Location: Poland

Re: Proxy ROS v3.7 & v3.8.

Mon May 12, 2008 11:10 pm

In my case proxy is extremely slow. I turn off or on caching, change drive setting etc - ANY combinations - no way. I want use proxy only for initial page in hotspot login and advertisements - but i can't. If I set "source address = 0.0.0.0" (normally I put the same, that src in NAT!) proxy stops returning any pages at all! Last proxy that I remember it was working was v 3.2. Last stable - 2.9.51.
How can I use hotspot's ads without proxy??? Or when will proxy start working normal way again?
kj
 
User avatar
hulk-bd
Member Candidate
Member Candidate
Posts: 231
Joined: Mon Sep 03, 2007 7:19 pm
Location: Uttara, Dhaka, Bangladesh

Re: Proxy ROS v3.7 & v3.8.

Tue May 13, 2008 6:44 am

Dear maroon,

I need some help about squid box, like what would be the mangle(DSCP), nat rule in MT for out side squid box want to have full lan speed for cache objects.

Thanks
 
User avatar
Chupaka
Forum Guru
Forum Guru
Posts: 8709
Joined: Mon Jun 19, 2006 11:15 pm
Location: Minsk, Belarus
Contact:

Re: Proxy ROS v3.7 & v3.8.

Tue May 13, 2008 2:12 pm

as far as I remember, you need some patch for squid to set DSCP
 
User avatar
hulk-bd
Member Candidate
Member Candidate
Posts: 231
Joined: Mon Sep 03, 2007 7:19 pm
Location: Uttara, Dhaka, Bangladesh

Re: Proxy ROS v3.7 & v3.8.

Tue May 13, 2008 9:43 pm

Chupaka, Yes I know that this patch is Marin's ZPH(Zero Penalty Hits) used for squid 2.6. I'm not a dump shit here. :?

I just want to be sure about the mangle n the nat rule in MT for a squid box with ZPH patch.

Peace
 
User avatar
thavinci
Member
Member
Posts: 335
Joined: Sat Aug 04, 2007 4:40 pm
Location: Johannessburg
Contact:

Re: Proxy ROS v3.7 & v3.8.

Wed May 14, 2008 1:42 am

Ok so then ill be the dumb shit here :p

How do you set this within ROS?

I have PPPOE running and that obviously creates dynamic simple quese

No ive got DSCP set at 4.
Mangle rule created ontop:
chain : output
DSCP (TOS) : 4
Action : mark packet
New Packet Mark : proxy-hit
Passthrough : NO

Simple queue #0 above dynamic simple queues
Packet Marks : proxy-hit
No Limits

However objects are still subject to speed limitations....

What am i missing. Probably something stupid.
Always happens when i work this late :/
 
User avatar
thavinci
Member
Member
Posts: 335
Joined: Sat Aug 04, 2007 4:40 pm
Location: Johannessburg
Contact:

Re: Proxy ROS v3.7 & v3.8.

Fri May 16, 2008 12:27 pm

Ok so i tried every way to this and still no results.

However me thinks to have found the issue.

All this time cached objects weir coming from the parent and not the MT therefore not being marked and so forth.


However this means once again that the MT caching isnt working correctly.
Some objects are cached yet when client retrieves it ROS doesn't return it as hit and bring it out it's own cache but rather fetches request from parent as if it wasn't cached at all!


Anyone else have similar results?
 
User avatar
thavinci
Member
Member
Posts: 335
Joined: Sat Aug 04, 2007 4:40 pm
Location: Johannessburg
Contact:

Re: Proxy ROS v3.7 & v3.8.

Fri May 16, 2008 12:30 pm

Ah and in case i get someone suggesting to mark packets at my squid servers (till ROS web-proxy gets fixed)
great idea but there isn't a patch available for my config. :/
 
lorenzo27
just joined
Posts: 2
Joined: Mon Jun 16, 2008 3:39 pm

Re: Proxy ROS v3.7 & v3.8.

Mon Jun 16, 2008 3:47 pm

just use the cache-hit-dscp: 10 in the mangle and in the web proxy and every thing will be solved i tested it.
 
lorenzo27
just joined
Posts: 2
Joined: Mon Jun 16, 2008 3:39 pm

Re: Proxy ROS v3.7 & v3.8.

Mon Jun 16, 2008 3:49 pm

just use the cache-hit-dscp: 0 in the mangle and in the web proxy and every thing will be solved i tested it.
0 not 10 sorry

Who is online

Users browsing this forum: No registered users and 132 guests