Community discussions

MikroTik App
 
miahac
Long time Member
Long time Member
Topic Author
Posts: 516
Joined: Wed Dec 14, 2005 5:04 pm
Location: Wichita, KS

95th percentile data - or 99th average etc

Tue Feb 12, 2008 12:37 am

I am trying to figure out a way to get 95th percentile data out of dude bandwidth graphs (although percentile data is a single number not a graph).

It looks like a switch ports keep a record of historical data. But it is unclear what exactly is in the data set. From any data set, I should be able to count, sort, and cut off the top 5% of samples and the next sample is the the 95th percentile. But I have no idea how to accomplish this. I would like the information be accessible somewhere in the dude and sent in e-mail every 1st of the month for selected charts.

The best data will show the following from any dynamically selected period
1 peak rate
2 99th percentile
3 95th percentile
4 85th percentile
5 average rate
6 total bandwidth transferred (in GB or TB)
-but I would settle for only 95th percentile.

Any Ideas on where to get started?
 
miahac
Long time Member
Long time Member
Topic Author
Posts: 516
Joined: Wed Dec 14, 2005 5:04 pm
Location: Wichita, KS

Re: 95th percentile data - or 99th average etc

Thu Feb 14, 2008 4:33 am

Looking at the first data set I see that it is the bps figured from 30 second readings. It is actual bps in 30 second samples not raw traffic readings from the switch.
I took the data set and put it in a spread sheet, graphed it and it looked almost exactly like the dude graph (deduct the 1 minute it took to make the graph).

From that I assume that the second data set is one days worth of 5 minute readings. The third is 30 days of two hour readings and the last is 360 days of one day readings.

Ok so that gets me started on what data is collected for a chart. After an hour the 30 second data is dumped, that is OK by me. But after a day the 5 minute data is dumped as well. This makes making a month long record of 5 minute intervals impossible to extract without adding a custom data source.
You do not have the required permissions to view the files attached to this post.
 
miahac
Long time Member
Long time Member
Topic Author
Posts: 516
Joined: Wed Dec 14, 2005 5:04 pm
Location: Wichita, KS

Re: 95th percentile data - or 99th average etc

Thu Feb 14, 2008 4:41 am

another problem is that the values shown in the dude are some fraction of that shown in the spreadsheet (even accounting for divide by 1024)

-- edit the ratio looks to be 4x, I do not know why -- better resolution? --
 
miahac
Long time Member
Long time Member
Topic Author
Posts: 516
Joined: Wed Dec 14, 2005 5:04 pm
Location: Wichita, KS

Re: 95th percentile data - or 99th average etc

Thu Feb 14, 2008 5:06 am

the 5 minute data looks to be pretty much the same, but a few samples behind for some reason.
5min-chart.PNG
You do not have the required permissions to view the files attached to this post.
 
miahac
Long time Member
Long time Member
Topic Author
Posts: 516
Joined: Wed Dec 14, 2005 5:04 pm
Location: Wichita, KS

Re: 95th percentile data - or 99th average etc

Fri Feb 15, 2008 8:06 pm

Argh. Ok I created my own data source, that was pretty much a copy of the built in but It still only collects 5 minute data for 288 samples. I need 10k samples for just over a month to get true 95th percentile for a month.

Does anybody know if there is any way to change the 288 to 12000?
You do not have the required permissions to view the files attached to this post.
 
miahac
Long time Member
Long time Member
Topic Author
Posts: 516
Joined: Wed Dec 14, 2005 5:04 pm
Location: Wichita, KS

Re: 95th percentile data - or 99th average etc

Sun Jul 06, 2008 1:35 am

bump
 
miahac
Long time Member
Long time Member
Topic Author
Posts: 516
Joined: Wed Dec 14, 2005 5:04 pm
Location: Wichita, KS

Re: 95th percentile data - or 99th average etc

Sun Jul 13, 2008 12:52 am

OK, I saw someone else talk about being able to edit dude paramaters with xml in dreamweaver. I just need to keep 5 minute samples for the last 32 or so days and calculate percentiles off of them.. then

count samples in month, sort from larges to smallest
95th - divide count by 20, for dropcount, go dropcount down list
99th - divide count by 100, for dropcount, go dropcount down list
90th - divide count by 10, for dropcount, go dropcount down list
average - add all, divide by count (this can be calculated from regular monthly result, because results are already averaged)
peak - top result
 
miahac
Long time Member
Long time Member
Topic Author
Posts: 516
Joined: Wed Dec 14, 2005 5:04 pm
Location: Wichita, KS

Re: 95th percentile data - or 99th average etc

Wed Jun 03, 2009 4:55 am

still no tips on increasing the sample size?
 
User avatar
normis
MikroTik Support
MikroTik Support
Posts: 26376
Joined: Fri May 28, 2004 11:04 am
Location: Riga, Latvia

Re: 95th percentile data - or 99th average etc

Wed Jun 03, 2009 2:20 pm

right now it's not possible, but the next major release of Dude is planned to have this and more possibilities
 
miahac
Long time Member
Long time Member
Topic Author
Posts: 516
Joined: Wed Dec 14, 2005 5:04 pm
Location: Wichita, KS

Re: 95th percentile data - or 99th average etc

Thu Jun 04, 2009 5:49 am

wow thats great, do you mean 95th percentile/other percentiles or control of sample sizes? Major update? Any idea when that will come?
 
alexjhart
Member Candidate
Member Candidate
Posts: 197
Joined: Thu Jan 20, 2011 8:03 pm

Re: 95th percentile data - or 99th average etc

Thu Nov 17, 2016 2:48 pm

right now it's not possible, but the next major release of Dude is planned to have this and more possibilities
Bringing this up again since "the dude is not dead" and it's been a while since this thread was bumped.
 
User avatar
43north
Member Candidate
Member Candidate
Posts: 208
Joined: Fri Nov 14, 2014 7:06 am

Re: 95th percentile data - or 99th average etc

Mon Oct 30, 2017 6:56 pm

Also interested in 95th percentile calcs. Anything new on this yet?

Who is online

Users browsing this forum: No registered users and 25 guests