I would like to get some numbers out of the weblogs of various services. - a list of hits with date/time for all requests starting with http://www.gentoo.org/proj/en/gentoo-alt/prefix - a list of hits with date/time for all requests starting with http://dev.gentoo.org/~grobian/distfiles/prefix - the number of svn operations (if possible per type) per day for overlays.gentoo.org/proj/alt/trunk/prefix-overlay - the number of hits with date/time for requests for http://overlays.gentoo.org/proj/alt/browser/trunk/prefix-overlay/scripts/bootstrap-prefix.sh?format=txt - the number of hits with date/time for requests for http://overlays.gentoo.org/proj/alt/browser/trunk/prefix-overlay/scripts/bootstrap-bash.sh?format=txt Thanks in advance!
From: dev.g.o grep grobian *.access-log > /home/grobian/access-grobian.log
robbat2@egret /var/log/apache2/overlays.gentoo.org $ grep /svn/proj/alt/trunk/prefix-overlay 2008*.UTC.access-log -h | awk '{print $4" "$6}' | tr -d '["]' |tr ' ' ':' |cut -d: -f1,5 |sort | uniq -c 18 01/Jan/2008:MERGE 18 01/Jan/2008:OPTIONS 219 01/Jan/2008:PROPFIND 11 01/Jan/2008:REPORT 3 02/Jan/2008:GET 71 02/Jan/2008:MERGE 73 02/Jan/2008:OPTIONS 870 02/Jan/2008:PROPFIND 50 02/Jan/2008:REPORT 45 03/Jan/2008:MERGE 45 03/Jan/2008:OPTIONS 554 03/Jan/2008:PROPFIND 40 03/Jan/2008:REPORT 1 04/Jan/2008:HEAD 1 04/Jan/2008:MERGE 1 04/Jan/2008:OPTIONS 59 04/Jan/2008:PROPFIND 2 04/Jan/2008:REPORT 71 05/Jan/2008:MERGE 71 05/Jan/2008:OPTIONS 814 05/Jan/2008:PROPFIND 63 05/Jan/2008:REPORT 110 06/Jan/2008:MERGE 110 06/Jan/2008:OPTIONS 1217 06/Jan/2008:PROPFIND 105 06/Jan/2008:REPORT 60 07/Jan/2008:MERGE 60 07/Jan/2008:OPTIONS 794 07/Jan/2008:PROPFIND 27 07/Jan/2008:REPORT 2 08/Jan/2008:GET 18 08/Jan/2008:MERGE 18 08/Jan/2008:OPTIONS 253 08/Jan/2008:PROPFIND 14 08/Jan/2008:REPORT 4 09/Jan/2008:GET 21 09/Jan/2008:MERGE 21 09/Jan/2008:OPTIONS 300 09/Jan/2008:PROPFIND 15 09/Jan/2008:REPORT 39 10/Jan/2008:MERGE 39 10/Jan/2008:OPTIONS 514 10/Jan/2008:PROPFIND 29 10/Jan/2008:REPORT 11 11/Jan/2008:GET 131 11/Jan/2008:MERGE 133 11/Jan/2008:OPTIONS 1551 11/Jan/2008:PROPFIND 95 11/Jan/2008:REPORT 52 12/Jan/2008:MERGE 53 12/Jan/2008:OPTIONS 646 12/Jan/2008:PROPFIND 52 12/Jan/2008:REPORT 40 13/Jan/2008:MERGE 42 13/Jan/2008:OPTIONS 517 13/Jan/2008:PROPFIND 40 13/Jan/2008:REPORT 87 14/Jan/2008:MERGE 100 14/Jan/2008:OPTIONS 1109 14/Jan/2008:PROPFIND 93 14/Jan/2008:REPORT 22 15/Jan/2008:PROPFIND
robbat2@egret /var/log/apache2/overlays.gentoo.org $ egrep 'proj/alt/browser/trunk/prefix-overlay/scripts/bootstrap-(prefix).sh\?format=txt' 2008*.UTC.*access-log -h |awk '{print $4}' |cut -d: -f1 |uniq -c 12 [01/Jan/2008 8 [02/Jan/2008 16 [03/Jan/2008 9 [04/Jan/2008 3 [05/Jan/2008 6 [06/Jan/2008 8 [07/Jan/2008 14 [08/Jan/2008 11 [09/Jan/2008 7 [10/Jan/2008 9 [11/Jan/2008 20 [12/Jan/2008 17 [13/Jan/2008 4 [14/Jan/2008 4 [15/Jan/2008 robbat2@egret /var/log/apache2/overlays.gentoo.org $ egrep 'proj/alt/browser/trunk/prefix-overlay/scripts/bootstrap-(bash).sh\?format=txt' 2008*.UTC.*access-log -h |awk '{print $4}' |cut -d: -f1 |uniq -c 1 [03/Jan/2008 3 [09/Jan/2008 3 [10/Jan/2008 1 [11/Jan/2008 1 [12/Jan/2008
that's all the stats from overlays done. Just the www stats are pending.
Thanks for the info so far. It gives me a rough idea what we're talking about.
Just to store this somewhere for the moment. [12:11pm] <grobian> robbat2: any idea how I can see how many people do "svn update" per day anywhere on the tree? [12:13pm] <robbat2> that I have no clue on. closest I can do is the number of unique IPs doing SVN operations [12:14pm] <robbat2> the SVN WebDAV stuff is very very verbose over HTTP. [12:14pm] <grobian> robbat2: that would give some rough indication of unique users indeed [12:17pm] <robbat2> grobian, seems ~27 unique ip addresses per day. however since Jan 5th, we have seen 178 uniques
I keep statistics of our rsync syncs now, answering the most important question.
