From lisbon2006 at gmail.com Fri Mar 3 10:58:45 2006 From: lisbon2006 at gmail.com (lisbon_pt) Date: Fri, 3 Mar 2006 10:58:45 +0000 Subject: TUX Log files format and scripts for analysis of log files Message-ID: <14e4f1e00603030258i5024034djee118b3bf230909b@mail.gmail.com> Hi I have the following scenario (LINUX): tux and apache working in the same DOCROOT I use: tux2w3c native_log_file_tux > my_tux_logs_in_txt The lines in my_tux_logs_in_txt have the following format (which is W3C compatible): 194.65.122.241 - - Mon Feb 27 03:50:42 2006 "GET site.pt/somedir/images/IMAGE.gif HTTP/1.0" - 0 404 I have tried scripts (analog, calamaris, awstats) to analyse these logs (my_tux_logs_in_txt) defining a LOGFORMAT For example for analog, I've tried: LOGFORMAT (%S %j %u %j %M %d %h:%n:%j %Y "%r" %j %b %c) for the line logs like the ones: 194.65.122.241 - - Mon Feb 27 03:50:42 2006 "GET site.pt/somedir/images/IMAGE.gif HTTP/1.0" - 0 404 The outpur of analog is: This report contains overall statistics. Successful requests: 0 Failed requests: 21,894 Corrupt logfile lines: 225 -------------------------------------------------------------------------------- Status Code Report (Go To: Top: General Summary: Status Code Report) This report lists the HTTP status codes of all requests. Listing status codes, sorted numerically. reqs: status code -----: ----------- 21894: 404 Document not found I take for granted: 1. Tux is not working has cache (Is LOGFORMAT well defined?) 2. Why the corrupted log lines in log file? Thanks very much for your (precious) time reading and maybe providing some feedback. Best regards, lisbon_pt -------------- ANALOG for LOGFORMAT -------------- %S host (the client hostname, or address of the computer making the request) %r file requested %u user (tip: a cookie or session id can usefully be defined as %u too) %d day of the month %M month, three letter English abbreviation %Y year, four digits %h hour of the day %n minute of the hour %b number of bytes transferred %c HTTP status code %j junk: ignore this field (field can be empty too) From lisbon2006 at gmail.com Fri Mar 3 14:38:05 2006 From: lisbon2006 at gmail.com (lisbon_pt) Date: Fri, 3 Mar 2006 14:38:05 +0000 Subject: [analog-help] TUX Log files format and scripts for analysis of logfiles + apache caching Message-ID: <14e4f1e00603030638o1f4aa971g39bd4880ccdcbd6c@mail.gmail.com> thanks! You were right about point 1. That?s what I wanted. :-) Being at the risk of boring you, all busy people... any idea on the following: 1. front end tux receive requests - it doesn't have the object pass it to apache in front end (same machine) (all DOCROOT -tux and apache - point to /opt/somedir/www/) 2.apache front end does not have object --> redirect to back end IIS How do I make objects that came from back end IIS stay in /opt/somedir/www/ in order to be served next time by tux? with directives of apache such as: CacheRoot CacheSize CacheGcInterval CacheDirLevels CacheDirLength CacheExpiryCheck CacheMinFileSize CacheMaxFileSize CacheTimeMargin CacheGcDaily CacheGcUnused CacheGcClean CacheGcMemUsage MCacheSize MCacheMaxObjectCount MCacheMinObjectSize MCacheMaxObjectSize MCacheRemovalAlgorithm MCacheMaxStreamingBuffer modules apache: mod_disk_cache, mod_mem_cache (and mod_cache) Another thing, object do not have META tags :-((( Well, I hope not anoying someone with such a long email! If so I apologize. Best regards, lisbon_pt On 3/3/06, Aengus wrote: > On Friday, March 03, 2006 5:58 AM [EDT], > lisbon_pt wrote: > > > 1. Tux is not working has cache (Is LOGFORMAT well defined?) > > You probably don't wnt GET and HTTP/1.x ini your %r, so you need to change > that part to "%j %r %j", but otherwise it's okay. > > > 2. Why the corrupted log lines in log file? > > Because not all of the lines in your logfile matched the format, obviously. > You can see which lines didn't match, with an indiction of where the > mismatch occurred by turning debugging on, and looking at the error output. > > http://analog.cx/docs/debug.html > > Aengus > > +------------------------------------------------------------------------ > | TO UNSUBSCRIBE from this list: > | http://lists.meer.net/mailman/listinfo/analog-help > | > | Analog Documentation: http://analog.cx/docs/Readme.html > | List archives: http://www.analog.cx/docs/mailing.html#listarchives > | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general > +------------------------------------------------------------------------ > From lisbon2006 at gmail.com Fri Mar 3 16:02:52 2006 From: lisbon2006 at gmail.com (lisbon_pt) Date: Fri, 3 Mar 2006 16:02:52 +0000 Subject: TUX Log files format and scripts for analysis of logfiles + apache caching In-Reply-To: <14e4f1e00603030638o1f4aa971g39bd4880ccdcbd6c@mail.gmail.com> References: <14e4f1e00603030638o1f4aa971g39bd4880ccdcbd6c@mail.gmail.com> Message-ID: <14e4f1e00603030802k138a4862w9c594a353dea7946@mail.gmail.com> thanks! You were right about point 1. That?s what I wanted. :-) Being at the risk of boring you, all busy people... any idea on the following: 1. front end tux receive requests - it doesn't have the object pass it to apache in front end (same machine) (all DOCROOT -tux and apache - point to /opt/somedir/www/) 2.apache front end does not have object --> redirect to back end IIS How do I make objects that came from back end IIS stay in /opt/somedir/www/ in order to be served next time by tux? with directives of apache such as: CacheRoot CacheSize CacheGcInterval CacheDirLevels CacheDirLength CacheExpiryCheck CacheMinFileSize CacheMaxFileSize CacheTimeMargin CacheGcDaily CacheGcUnused CacheGcClean CacheGcMemUsage MCacheSize MCacheMaxObjectCount MCacheMinObjectSize MCacheMaxObjectSize MCacheRemovalAlgorithm MCacheMaxStreamingBuffer modules apache: mod_disk_cache, mod_mem_cache (and mod_cache) Another thing, object do not have META tags :-((( Well, I hope not anoying someone with such a long email! If so I apologize. Best regards, lisbon_pt On 3/3/06, Aengus wrote: > On Friday, March 03, 2006 5:58 AM [EDT], > lisbon_pt wrote: > > > 1. Tux is not working has cache (Is LOGFORMAT well defined?) > > You probably don't wnt GET and HTTP/1.x ini your %r, so you need to change > that part to "%j %r %j", but otherwise it's okay. > > > 2. Why the corrupted log lines in log file? > > Because not all of the lines in your logfile matched the format, obviously. > You can see which lines didn't match, with an indiction of where the > mismatch occurred by turning debugging on, and looking at the error output. > > http://analog.cx/docs/debug.html > > Aengus > > +------------------------------------------------------------------------ > | TO UNSUBSCRIBE from this list: > | http://lists.meer.net/mailman/listinfo/analog-help > | > | Analog Documentation: http://analog.cx/docs/Readme.html > | List archives: http://www.analog.cx/docs/mailing.html#listarchives > | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general > +------------------------------------------------------------------------ > From max at expires-2004.workforce.de Fri Mar 3 16:20:33 2006 From: max at expires-2004.workforce.de (Max Helmet) Date: Fri, 3 Mar 2006 17:20:33 +0100 Subject: AW: [analog-help] TUX Log files format and scripts for analysis oflogfiles + apache caching In-Reply-To: <14e4f1e00603030638o1f4aa971g39bd4880ccdcbd6c@mail.gmail.com> Message-ID: Hi, > 1. front end tux receive requests - it doesn't have the object > pass it to apache in front end (same machine) > (all DOCROOT -tux and apache - point to /opt/somedir/www/) > > 2.apache front end does not have object --> redirect to back end IIS > > How do I make objects that came from back end IIS stay in > /opt/somedir/www/ in order to be served next time by tux? I'm afraid mod_disk_cache doesn't support this. However, you could use mod_proxy and mod_ext_filter with a custom module which writes the files sent by the back end to the according directory in /opt/somedir/www/ before passing it on. But I wouldn't take this approach because of security concerns. Again, I'd suggest to use a cron job that mirrors the back end server once an hour or once a day. For example you could grep|sed|sort all the URLs from the AccessLog and then use wget to copy them to the front end server. Or you could have a look at the command line version of HTTrack and let it unfold its power. Regards, Max From lisbon2006 at gmail.com Mon Mar 6 08:36:42 2006 From: lisbon2006 at gmail.com (lisbon_pt) Date: Mon, 6 Mar 2006 08:36:42 +0000 Subject: [analog-help] TUX Log files format and scripts for analysis oflogfiles + apache caching In-Reply-To: References: <14e4f1e00603030638o1f4aa971g39bd4880ccdcbd6c@mail.gmail.com> Message-ID: <14e4f1e00603060036m4dc997can91644a5db1862c34@mail.gmail.com> Thanks for sharing your ideas. I guess, this issue maybe more complex than I would like... Regards On 3/3/06, Max Helmet wrote: > Hi, > > > 1. front end tux receive requests - it doesn't have the object > > pass it to apache in front end (same machine) > > (all DOCROOT -tux and apache - point to /opt/somedir/www/) > > > > 2.apache front end does not have object --> redirect to back end IIS > > > > How do I make objects that came from back end IIS stay in > > /opt/somedir/www/ in order to be served next time by tux? > > I'm afraid mod_disk_cache doesn't support this. However, you could use > mod_proxy and mod_ext_filter with a custom module which writes the files > sent by the back end to the according directory in /opt/somedir/www/ before > passing it on. But I wouldn't take this approach because of security > concerns. > > Again, I'd suggest to use a cron job that mirrors the back end server once > an hour or once a day. For example you could grep|sed|sort all the URLs from > the AccessLog and then use wget to copy them to the front end server. Or you > could have a look at the command line version of HTTrack and let it unfold > its power. > > Regards, > Max > > _______________________________________________ > tux-list mailing list > tux-list at redhat.com > https://www.redhat.com/mailman/listinfo/tux-list > From zhushisongzhu at yahoo.com Tue Mar 7 08:09:09 2006 From: zhushisongzhu at yahoo.com (zhu shi song) Date: Tue, 7 Mar 2006 00:09:09 -0800 (PST) Subject: where to get tux patches for 2.4.28 Message-ID: <20060307080909.61584.qmail@web36901.mail.mud.yahoo.com> dear lists, I hope to test tux web server. Where can I get tux patches for linux kernel 2.4.28? tks zhu __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com From max at expires-2004.workforce.de Tue Mar 7 11:16:25 2006 From: max at expires-2004.workforce.de (Max Helmet) Date: Tue, 7 Mar 2006 12:16:25 +0100 Subject: AW: where to get tux patches for 2.4.28 In-Reply-To: <20060307080909.61584.qmail@web36901.mail.mud.yahoo.com> Message-ID: Hi zhu, I'm afraid Ingo has deleted older works on TUX from his directory. That's a pitty, but he seems to ignore complaints about this for now. Thus you'll have to rely on archive.org. The most recent patch for kernel 2.4 contained in the archive seems to be for kernmel 2.4.23: http://web.archive.org/web/20050306143644/people.redhat.com/mingo/TUX-patche s/tux3-2.4.23-A3 You might want to try this one as a starting point. Regards, Max PS: Anyone interested in a TUX User Group website filling the breach? > dear lists, > I hope to test tux web server. Where can I get tux > patches for linux kernel 2.4.28? > tks > zhu From nicolas at incrowd.be Tue Mar 7 11:42:17 2006 From: nicolas at incrowd.be (Nicolas Van Eenaeme) Date: Tue, 7 Mar 2006 12:42:17 +0100 Subject: where to get tux patches for 2.4.28 In-Reply-To: Message-ID: <20060307114214.F02FA168048@asia.telenet-ops.be> Hi, I've adjusted the latest patch of Ingo to be compatible with the 2.4.31 and even 2.4.32 kernel. It works great for me. You can download it on http://www.poison.be/patches/ Regards, Nicolas Van Eenaeme -----Oorspronkelijk bericht----- Van: tux-list-bounces at redhat.com [mailto:tux-list-bounces at redhat.com] Namens Max Helmet Verzonden: dinsdag 7 maart 2006 12:16 Aan: TUX discussion list Onderwerp: AW: where to get tux patches for 2.4.28 Hi zhu, I'm afraid Ingo has deleted older works on TUX from his directory. That's a pitty, but he seems to ignore complaints about this for now. Thus you'll have to rely on archive.org. The most recent patch for kernel 2.4 contained in the archive seems to be for kernmel 2.4.23: http://web.archive.org/web/20050306143644/people.redhat.com/mingo/TUX-patche s/tux3-2.4.23-A3 You might want to try this one as a starting point. Regards, Max PS: Anyone interested in a TUX User Group website filling the breach? > dear lists, > I hope to test tux web server. Where can I get tux > patches for linux kernel 2.4.28? > tks > zhu _______________________________________________ tux-list mailing list tux-list at redhat.com https://www.redhat.com/mailman/listinfo/tux-list From rath at mglug.de Tue Mar 7 11:50:56 2006 From: rath at mglug.de (Oliver Rath) Date: Tue, 07 Mar 2006 12:50:56 +0100 Subject: What about Tux for 2.6.12-2.6.15? Realtime-patch Problems? Message-ID: <440D73A0.4050705@mglug.de> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi List, at my last look at the download page I saw the last tux-pages are one year ago for 2.6.11-foo-bar. Is the development finished? Is it difficult to adjust the last patches to 2.6.15. BTW, are there problems in conjunction with the realtime-Patch? Hfh, Oliver -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2.1 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFEDXOgoFn7vYeXbzsRAh5dAJ9V2TVGoAYft6tz8DI/8QNwELdn5ACcDPcJ rw+146bbaafm3tbcHwfBeD0= =Saku -----END PGP SIGNATURE----- From mingo at elte.hu Mon Mar 20 09:05:12 2006 From: mingo at elte.hu (Ingo Molnar) Date: Mon, 20 Mar 2006 10:05:12 +0100 Subject: [patch] tux3-2.6.16-A0 Message-ID: <20060320090512.GA1408@elte.hu> i've released the 2.6.16-A0 Tux patch: http://redhat.com/~mingo/TUX-patches/tux3-2.6.16-A0 this is a merge to v2.6.16, with small fixes. This is a maintainance release, not a submission for upstream inclusion. Ingo From mcd at daviesinc.com Mon Mar 20 14:51:26 2006 From: mcd at daviesinc.com (Chris Davies) Date: Mon, 20 Mar 2006 09:51:26 -0500 Subject: [patch] tux3-2.6.16-A0 In-Reply-To: <20060320090512.GA1408@elte.hu> References: <20060320090512.GA1408@elte.hu> Message-ID: <441EC16E.9060302@daviesinc.com> does this fix the SMP bug? Ingo Molnar wrote: > i've released the 2.6.16-A0 Tux patch: > > http://redhat.com/~mingo/TUX-patches/tux3-2.6.16-A0 > > this is a merge to v2.6.16, with small fixes. This is a maintainance > release, not a submission for upstream inclusion. > > Ingo > > _______________________________________________ > tux-list mailing list > tux-list at redhat.com > https://www.redhat.com/mailman/listinfo/tux-list > > !DSPAM:441e70d396321911215446! > From mingo at elte.hu Mon Mar 20 14:51:18 2006 From: mingo at elte.hu (Ingo Molnar) Date: Mon, 20 Mar 2006 15:51:18 +0100 Subject: [patch] tux3-2.6.16-A0 In-Reply-To: <441EC16E.9060302@daviesinc.com> References: <20060320090512.GA1408@elte.hu> <441EC16E.9060302@daviesinc.com> Message-ID: <20060320145118.GA26648@elte.hu> * Chris Davies wrote: > does this fix the SMP bug? the do_send_abuf() one? Not specifically - but upstream fixed a number of SMP bugs in the networking code, so maybe ... Ingo