| Summary: | gentoo mail server dropping emails | ||
|---|---|---|---|
| Product: | Gentoo Infrastructure | Reporter: | Richard Fish <bigfish> |
| Component: | Mailing Lists | Assignee: | Gentoo Infrastructure <infra-bugs> |
| Status: | RESOLVED FIXED | ||
| Severity: | critical | CC: | 1i5t5.duncan, aetherknight, anigel, astinus, axllent, beu, billie, bugs+gentoo, bulliver, cancellettopugno, dertobi123, falco, g2boojum, genone, grobian, halcy0n, jaervosz, jakub, m.debruijne, masterdriverz, rbu, steev, tcort, togge.gentoo, tristan, vapier, vorlon, welz, zlin |
| Priority: | Highest | ||
| Version: | unspecified | ||
| Hardware: | All | ||
| OS: | Linux | ||
| URL: | http://thread.gmane.org/gmane.linux.gentoo.user/166664/focus=166664 | ||
| Whiteboard: | Due @ 2008/01/22 | ||
| Package list: | Runtime testing required: | --- | |
| Attachments: | sample digest email with the problem explained in comment | ||
|
Description
Richard Fish
2006-07-27 10:08:46 UTC
I can confirm this using my ISP's email account. Even on the thread concerning this issue I'm missing 5 of a total of 13 emails. And I'm not behind cause I have recieved replies on emails I'm missing. I have so far missed 1 mail from this exact thread. There are other threads recently which are a lot worse (as I indicated in the intial post to this email thread). It seems regardless of ISP users from all over are having issues with missing posts. There must be some actual cause for this, and hopefully the gentoo folks will be able to trace this issue soon. I am seeing the same problem, currently gmane is reporting 18 messages, I only have 16 for this thread. I am using the same email address as what I am posting with. Thanks for looking into it. Do you still have this issue? Yes, I still have it, and often. Some recent threads with email_received / gmane_threads: "gtk+ dependency problem" - 7 / 8 "PCMCIA issues" - 2 / 3 "DSPAM?" - 4 / 6 "LVM: Pro and Contra ?" - 9 / 11 looks like this is happening on gentoo-dev as well the recent gtk/gtk2 thread is all skewed for me, and some of the recent e-mails ive posted i sometimes get back through the list, sometimes not I'm apparently seeing it on -dev as well, subscribed thru gmane, so it's not immune. I've seen replies to posts not on gmane yet. There have only been a couple I've seen so far, so gmane seems to be better than some, but it does seem to be missing a few. I'm missing messages too. Does this have anything to do with the bounces we are seeing from bug #136684? If so one of these should be marked as a duplicate. I'm getting dropped mail too. Almost 40 minutes ago I sent a mail to genone@gentoo.org with adopt-a-dev@gentoo.org in the CC. I'm on the adopt-a-dev alias and haven't gotten the mail yet. (In reply to comment #9) > I'm getting dropped mail too. Almost 40 minutes ago I sent a mail to > genone@gentoo.org with adopt-a-dev@gentoo.org in the CC. I'm on the adopt-a-dev > alias and haven't gotten the mail yet. I tried resending the mail and it worked the second time around. (In reply to comment #10) > (In reply to comment #9) > > I'm getting dropped mail too. Almost 40 minutes ago I sent a mail to > > genone@gentoo.org with adopt-a-dev@gentoo.org in the CC. I'm on the adopt-a-dev > > alias and haven't gotten the mail yet. > > I tried resending the mail and it worked the second time around. I finally got the first e-mail an hour and a half late. Sorry for the bug spam. adopt-a-dev is an alias and not a mailing list, so it's not related to gentoo-user problems. I recompiled ml software on lists and taken steps to cut down the queue. Can you foks wait 48 hours and then report to me further issues here? I'll try to do my best for tracking them down. When you report lost emails it would be ideal if you can send me the message id, date and your recipient address. thanks! *** Bug 144221 has been marked as a duplicate of this bug. *** (In reply to comment #12) > adopt-a-dev is an alias and not a mailing list, so it's not related to > gentoo-user problems. > > I recompiled ml software on lists and taken steps to cut down the queue. > > Can you foks wait 48 hours and then report to me further issues here? I'll try > to do my best for tracking them down. > > When you report lost emails it would be ideal if you can send me the message > id, date and your recipient address. > > thanks! > I paste the postfix log and the message including headers. Hope it helps. Robert Aug 17 00:35:05 Hermes postfix/smtpd[24802]: 34B051EB2: client=Jupiter.fixe-post.de[192.168.2.198] Aug 17 00:35:05 Hermes postfix/cleanup[24804]: 34B051EB2: message-id=<44E39D98.7040609@fixe-post.de> Aug 17 00:35:05 Hermes postfix/qmgr[10124]: 34B051EB2: from=<welz@fixe-post.de>, size=1603, nrcpt=1 (queue active ) Aug 17 00:35:05 Hermes postfix/smtpd[24802]: disconnect from Jupiter.fixe-post.de[192.168.2.198] Aug 17 00:35:06 Hermes postfix/smtp[24805]: 34B051EB2: to=<gentoo-user@lists.gentoo.org>, relay=lists.gentoo.org[ 140.105.134.102], delay=1, status=sent (250 2.0.0 k7GMZ5aV020943 Message accepted for delivery) Aug 17 00:35:06 Hermes postfix/qmgr[10124]: 34B051EB2: removed Message-ID: <44E39D98.7040609@fixe-post.de> Date: Thu, 17 Aug 2006 00:35:04 +0200 From: Robert Welz <welz@fixe-post.de> User-Agent: Thunderbird 1.5.0.5 (X11/20060803) MIME-Version: 1.0 To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] gentoo on an old PPC with Sonnet dual processor upgrade card References: <44E393C0.2040204@fixe-post.de> <44E39589.1090607@comcast.net> In-Reply-To: <44E39589.1090607@comcast.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Mike wrote: > Robert Welz wrote: >> Just a question, did someone manage to install gentoo (or another >> flavour of linux) on an old world PowerMac 7600 with an 1 GHZ Sonnet >> Dualprocessor Upgrade card (Crescendo)? The gentoo kernel stuck right >> after booting and I wonder if a self compiled kernel would help. >> >> Thank you, >> >> Greetings, >> Robert >> > > You probably need to pass it some kernel option at boot like "noacpi" or something. > > Mike Well, when I boot with the original processor, everything works but with the Sonnet card booting hangs. Since Sonnet delivers some MacOS drivers with their card could it be that linux won't boot at all without some specific drivers? I mean, would a linux kernel run on this card "in general" or not? The only thing I changed was the processor card :( Greetings, Robert Possibly useful info... my remote ISP's MTA rejects emails containing bare linefeeds; something about following an RFC. That rejection is absolute, and is done before my blocking rules ever see it. That doesn't happen too often, and it seems random. I suppose if one person with a bad MUA/MTA posts several messages on a thread, I'll miss those messages. Can the mailing list maintainers check for bare linefeeds, and hopefully fix them, before sending out list emails? Andrea, I'm still missing quite a few posts. An random example (as requested by you) is 8146fc8a0608181218r1e3efe13m8ffd87da48e1dd5e@mail.gmail.com ... and looking at the headers these are some serious delays it seems: Original-Received: from lists.gentoo.org ([140.105.134.102] helo=robin.gentoo.org) by ciao.gmane.org with esmtp (Exim 4.43) id 1GE9tC-0000Gy-4L for lnx-gentoo-user@m.gmane.org; Fri, 18 Aug 2006 21:20:18 +0200 Original-Received: from robin.gentoo.org (localhost [127.0.0.1]) by robin.gentoo.org (8.13.7/8.13.6) with SMTP id k7IJIWWK000223; Fri, 18 Aug 2006 19:18:32 GMT Delivered-To: <gentoo-user@lists.gentoo.org> Original-Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.181]) by robin.gentoo.org (8.13.7/8.13.6) with ESMTP id k7IJIV8h024320 for <gentoo-user@lists.gentoo.org>; Fri, 18 Aug 2006 19:18:32 GMT Original-Received: by py-out-1112.google.com with SMTP id d42so1246004pyd for <gentoo-user@lists.gentoo.org>; Fri, 18 Aug 2006 12:18:31 -0700 (PDT) This email (3 in total for this thread alone) did not make it way into my mailbox (axllent_at_gmail_dot_com). Hope this helps. (In reply to comment #16) > Andrea, I'm still missing quite a few posts. An random example (as requested by > you) is 8146fc8a0608181218r1e3efe13m8ffd87da48e1dd5e@mail.gmail.com ... and > looking at the headers these are some serious delays it seems: Hm. Does lists.gentoo.org do greylisting? If so, maybe that's the reason? It would also explain the delays. looks like it's still screwin up ... going by this thread via gmane: http://article.gmane.org/gmane.linux.gentoo.devel/41627 i did not receive these e-mails: http://article.gmane.org/gmane.linux.gentoo.devel/41628 http://article.gmane.org/gmane.linux.gentoo.devel/41632 http://article.gmane.org/gmane.linux.gentoo.devel/41631 (In reply to comment #18) > going by this thread via gmane: > http://article.gmane.org/gmane.linux.gentoo.devel/41627 > i did not receive these e-mails: [three listed] Have you / can you reverse the comparison as well? How many is gmane losing? I use gmane regularly, and have noted a couple lost there based on replies, but based on gut feeling only, it seems it's more reliable than several of the replies here indicate their mail has been. If gmane is indeed more reliable, that could be some sort of clue. AFAIK, they simply subscribe via mail and post it as news -- no multipath propagation as would typically be the case with news. If that's true, and they are getting more of the posts, it indicates one of two things. Either part of the problem is some reporters are getting a few of their mails snagged by spam filters, etc, or there's an infrastructure difference such that gmane is more reliable at getting the mail than others. Maybe the list mailer is timing out unreasonably quickly and not trying again as would be the case with ordinary mail? Maybe it's ignoring one or more error conditions? (I don't know enough about mail to go further than that.) > Have you / can you reverse the comparison as well? How many is gmane losing?
I think the only people who will be able to do this are the folks at gentoo, but it would be interesting to know.
The fact does remain that many mails are still not arriving in my inbox, and that gmane does seem to be receiving the majority of the missing emails in my broken threads (sometimes hard to tell at a glance because of missing In-Reply-To headers).
So far I have not spotted a single case where I have received something that gmane hasn't, but that's not a statistic, it's just a naked-eye comparison from time to time on larger threads (+10 replies).
i have noticed one or two e-mails that i got and gmane did not ... but i dont really care (because i'm selfish), i just want the mails showing up in *my* e-mail box ;) i sent three e-mails to the gentoo-doc list last nite ... two made it through, one did not ... the first two that worked were: http://article.gmane.org/gmane.linux.gentoo.documentation/2587 http://article.gmane.org/gmane.linux.gentoo.documentation/2589 but the third that started a new thread about the Gentoo/ARM handbook is nowhere to be found (talked to other gentoo doc devs and gmane.org doesnt have it) my local qmail smtp logs to the gentoo mail server: [first wiki post that worked] 2006-09-02 01:44:04.462361500 info msg 943041: bytes 2067 from <vapier@gentoo.org> qp 27940 uid 201 2006-09-02 01:44:04.507458500 starting delivery 386: msg 943041 to remote gentoo-doc@lists.gentoo.org 2006-09-02 01:44:04.507502500 status: local 0/10 remote 1/20 2006-09-02 01:44:07.120578500 delivery 386: success: User_and_password_not_set,_continuing_without_authentication./<gentoo-doc@lists.gentoo.org>_127.0.0.1_ac cepted_message./Remote_host_said:_250_Ok:_queued_as_5551264634/ [second wiki post that worked] 2006-09-02 04:33:57.763963500 info msg 943042: bytes 2123 from <vapier@gentoo.org> qp 404 uid 201 2006-09-02 04:33:57.900577500 starting delivery 391: msg 943042 to remote gentoo-doc@lists.gentoo.org 2006-09-02 04:33:57.900621500 status: local 0/10 remote 1/20 2006-09-02 04:34:00.844848500 delivery 391: success: User_and_password_not_set,_continuing_without_authentication./<gentoo-doc@lists.gentoo.org>_127.0.0.1_ac cepted_message./Remote_host_said:_250_Ok:_queued_as_2A74E64889/ [third about arm/handbook that failed] 2006-09-02 05:01:03.230589500 info msg 943042: bytes 2008 from <vapier@gentoo.org> qp 12149 uid 201 2006-09-02 05:01:03.380582500 starting delivery 392: msg 943042 to remote gentoo-doc@lists.gentoo.org 2006-09-02 05:01:03.380626500 status: local 0/10 remote 1/20 2006-09-02 05:01:03.391717500 starting delivery 393: msg 943042 to remote dostrow@gentoo.org 2006-09-02 05:01:03.391758500 status: local 0/10 remote 2/20 2006-09-02 05:01:07.942588500 delivery 393: success: User_and_password_not_set,_continuing_without_authentication./<dostrow@gentoo.org>_127.0.0.1_accepted_me ssage./Remote_host_said:_250_Ok:_queued_as_6CBB26436D/ 2006-09-02 05:01:07.942652500 status: local 0/10 remote 1/20 2006-09-02 05:01:08.265714500 delivery 392: success: User_and_password_not_set,_continuing_without_authentication./<gentoo-doc@lists.gentoo.org>_127.0.0.1_ac cepted_message./Remote_host_said:_250_Ok:_queued_as_B13BB641FC/ looks like another e-mail i sent to the gentoo-doc list has been dropped ... this one was starting a thread about the arm/ia64 handbook ... my smtp log: 2006-09-03 01:15:41.598362500 info msg 943042: bytes 1813 from <vapier@gentoo.org> qp 27883 uid 201 2006-09-03 01:15:41.640622500 starting delivery 408: msg 943042 to remote gentoo-doc@lists.gentoo.org 2006-09-03 01:15:41.640666500 status: local 0/10 remote 1/20 2006-09-03 01:15:45.313830500 delivery 408: success: User_and_password_not_set,_continuing_without_authentication./<gentoo-doc@lists.gentoo.org>_127.0.0.1_accepted_message./Remote_host_said:_250_Ok:_queued_as_C1D7664B9C/ and another e-mail sent to gentoo-dev that has disappeared ... it was a follow up to "[gentoo-dev] Re: [GLEP] Bugzilla access for contributors" 2006-09-04 03:00:07.799261500 info msg 943042: bytes 2378 from <vapier@gentoo.org> qp 26926 uid 201 2006-09-04 03:00:07.840584500 starting delivery 434: msg 943042 to remote gentoo-dev@lists.gentoo.org 2006-09-04 03:00:07.840627500 status: local 0/10 remote 1/20 2006-09-04 03:00:10.485329500 delivery 434: success: User_and_password_not_set,_continuing_without_authentication./<gentoo-dev@lists.gentoo.org>_127.0.0.1_accepted_message./Remote_host_said:_250_Ok:_queued_as_E4C4164771/ ok, scratch that last one gentoo-dev ... it went through now (about 1.5 hours later even though other people's went through immediately?) my gentoo-doc ones are still AFK though ... lists.gentoo.org was rebooted with a new kernel a minute ago, please report further missing emails to see if this change affects the issue or not. This bug is long already, so I'll keep this brief, but I've been experiencing mail loss also. In the last couple of weeks, I've had to resend to -dev, -core and qa@ on quite a few occasions. Note, however, that I check/send mail from woodpecker, so I don't have access to logs... (In reply to comment #27) > This bug is long already, so I'll keep this brief, but I've been experiencing > mail loss also. In the last couple of weeks, I've had to resend to -dev, -core > and qa@ on quite a few occasions. Note, however, that I check/send mail from > woodpecker, so I don't have access to logs... Almost everyone else in this thread is reporting missing mailing list emails, so are you 100% sure you're missing mails sent to qa@? Those don't ever hit the mailing list server. If you're 100% sure, (and I really question whether you are) I need more info. Subject line, date, time, to, from, msg id, etc. Otherwise, I don't have enough data to do any sort of research. (In reply to comment #28) > Almost everyone else in this thread is reporting missing mailing list emails, > so are you 100% sure you're missing mails sent to qa@? Those don't ever hit > the mailing list server. I'm 100% sure about the mails for lists.g.o; qa@, 90% sure, but I will check as soon as I've got time. > If you're 100% sure, (and I really question whether you are) I need more info. > Subject line, date, time, to, from, msg id, etc. Otherwise, I don't have > enough data to do any sort of research. Nod, I'll check when I can and report back what I have... and if you don't hear from me, that means that only the lists.g.o promlem remains. ;P More dropped mail to gentoo-user@. Had several over the last week. Most recent is: Message-Id: <200609141856.45723.bulliver@badcomputer.org> Date: Thu, 14 Sep 2006 18:56:45 -0700 Exim log: 2006-09-14 18:56:45 1GO2wf-0003rU-UN <= bulliver@badcomputer.org H=(virgo.badcomputer.org) [192.168.0.102] P=esmtp S=1669 id=200609141856.45723.bulliver@badcomputer.org 2006-09-14 18:56:48 1GO2wf-0003rU-UN => gentoo-user@gentoo.org R=dnslookup T=remote_smtp H=mail.gentoo.org [140.211.166.183] X=TLSv1:DHE-RSA-AES256-SHA:256 2006-09-14 18:56:48 1GO2wf-0003rU-UN Completed Didn't make it to gmane either! I haven't received swift's good bye email, but received tsunam's replay. From the reply I received: "In-Reply-To: <20060927185431.GA8303@gentoo.org>" same as neysx here. Swifts's goodbye email to -core didn't come thru, but the responses to it have. *** Bug 147494 has been marked as a duplicate of this bug. *** Another data point (gentoo-dev, in this case):
13:31 < g2boojum> SpanKY: Did you get my -dev mail w/ message ID
<20061025154856.GR29426@feynman.corp.halliburton.com>? It
showed up on gmane
(http://article.gmane.org/gmane.linux.gentoo.devel/43667),
but I still haven't received it, and your e-mail suggests you
didn't, either.
9:14 <@SpanKY> g2boojum: i did not :(
19:15 <@SpanKY> g2boojum: i see the other two e-mails from you in the thread
19:15 <@SpanKY> it seemed odd ciaranm's reply about radiation :)
I got a hunch (thx to Ramereth) and I changed our configuration (too long to explain what). Please report any new missing emails so that I can see if this affected this issue somehow, thanks to all. No new mails lost or is it just that you are not reporting? :) If I don't get further feedback on this I'm going to close the bug in a week or so. I appear to have lost quite a bit of mail. I have 87 posts to the "Monthly Gentoo Council Reminder for November" thread in my gmail account, however I only have 11 (!) posts to that thread in my g.o mailbox: Message-Id: <200611030847.52820.slong@rathaus.eclipse.co.uk> Message-Id: <200611030805.15663.vapier@gentoo.org> Message-ID: <eipqft$pfq$2@sea.gmane.org> Message-ID: <20061103140605.GH9264@feynman.corp.halliburton.com> Message-ID: <b38c6f4c0611041438j6238357cxd0d69c45d5d19b75@mail.gmail.com> Message-ID: <20061104234509.GF15897@curie-int.orbis-terrarum.net> Message-id: <200611051120.24317.pauldv@gentoo.org> Message-Id: <1162839289.10506.23.camel@inertia.twi-31o2.org> Message-ID: <eipqcs$pfq$1@sea.gmane.org> Message-ID: <20061107133525.57bcf365@sheridan.genone.homeip.net> Message-ID: <b38c6f4c0611070452p23601eacrd3e7a88da8d51866@mail.gmail.com> I'm not sure if this is even relevant, but beu@wookpecker:.permissive exists. Hi, I have sent a mail to gentoo-user roughly 9h ago - and it is still not in my gentoo-user inbox, while mails sent by others did arrive. The mail is in the google groups archive. Message-Id: <200611072253.03208.volker.armin.hemmann@tu-clausthal.de> Ok, applied another patch. Please report other lost emails from now on. Thanks I received vivo's mysql treequake email only on -core, while it was sent to -dev and -core. Subsequent replies to the message, also to both lists came through, though. Only difference I noticed were use of To/CC and To/To. Message-ID: <4564E77D.6070707@gentoo.org> Date: Thu, 23 Nov 2006 00:12:45 +0000 From: Francesco Riosa <vivo@gentoo.org> User-Agent: Thunderbird 2.0a1 (X11/20061110) Precedence: bulk List-Post: <mailto:gentoo-core@lists.gentoo.org> List-Help: <mailto:gentoo-core+help@gentoo.org> List-Unsubscribe: <mailto:gentoo-core+unsubscribe@gentoo.org> List-Subscribe: <mailto:gentoo-core+subscribe@gentoo.org> List-Id: Gentoo Linux mail <gentoo-core.gentoo.org> X-BeenThere: gentoo-core@gentoo.org MIME-Version: 1.0 To: gentoo-dev@lists.gentoo.org CC: gentoo-core <gentoo-core@lists.gentoo.org> Subject: [gentoo-core] [treequake] virtual/mysql addition I missed at least the mails with the following msgids in the last few days: <20070109232355.6150b289@snowdrop> <b9e574f80701071314r20cbeacaq193aa742a72a9263@mail.gmail.com> (both on -dev). There may be more, those I've noticed as I got the replies to them. same here for 20070109232355.6150b289@snowdrop (same one as for genone, if that helps any, maybe to pinpoint the time when it happens) And one more from -core this time: <1168469313.8302.28.camel@edge> I am seeing some drops myself. I went and looked on robin, but the problem doesn't appear to be the same as last time, as I have yet to determine a correlation in what I'm seeing in the logs and the missing messages. I'll be looking into this some more today. Box has new kernel now (without grsec stuff). Please report any problem on messages from now on. Thx! Lost two mails on -core that I noticed, in the last four days. solar's 1170192093.4791.43.camel@onyx.private.gni.com seemants's 1169828855.7058.9.camel@localhost (In reply to comment #46) > Lost two mails on -core that I noticed, in the last four days. > > solar's 1170192093.4791.43.camel@onyx.private.gni.com solar's mail is missing here too (In reply to comment #47) > (In reply to comment #46) > > Lost two mails on -core that I noticed, in the last four days. > > > > solar's 1170192093.4791.43.camel@onyx.private.gni.com > > solar's mail is missing here too It's because it wasn't sent to the list. Look at solar's next response. He complains that Alex added the list back. As for seemant's mail... that one appears to be a valid miss. It was sent to -core, but not everyone got it, myself included. Upon further investigation, I see this around the same time the mails stopped sending: From sendmail.log: Jan 26 16:44:09 robin sendmail_fast[23730]: l0QGhdGG023730: from=<gentoo-core+bounces-7293-sebastian=gentoo.org@gentoo.org>, size=1853, class=-60, nrcpts=1, msgid=<1169828855.7058.9.camel@localhost>, proto=SMTP, daemon=MSA, relay=localhost [127.0.0.1] Jan 26 16:44:09 robin sendmail_fast[23730]: l0QGhdGH023730: from=<gentoo-core+bounces-7293-strerror=gentoo.org@gentoo.org>, size=1853, class=-60, nrcpts=1, msgid=<1169828855.7058.9.camel@localhost>, proto=SMTP, daemon=MSA, relay=localhost [127.0.0.1] (That was the last message...) From messages: Jan 26 16:44:01 robin /usr/adm/sm.bin/mlmmj-process[24373]: mlmmj-process.c:771: Discarding /var/lists/gentoo-server//incoming/7145900d81e1069 because subonlypost and nosubonlydenymails was set: No such file or directory Jan 26 16:44:09 robin /usr/adm/sm.bin/mlmmj-send[23723]: init_sockfd.c:55: Could not connect to 127.0.0.1, exiting ... : Connection refused And apparently another one: Date: Wed, 14 Mar 2007 18:40:04 +0100 From: Marius Mauch <genone@gentoo.org> To: gentoo-core@gentoo.org Subject: Re: [gentoo-core] Staffing Needs! Message-ID: <20070314184004.0e346b27@sheridan.genone.homeip.net> Didn't turn up here, but Uberlord said he received it. Another one from -dev From: Mike Doty <kingtaco <at> gentoo.org> Subject: Re: [soc] Python bindings for Paludis Date: 2007-03-24 16:30:55 GMT ID: 4605523F.8070002@gentoo.org I missed this one on -dev: From: Ciaran McCreesh <ciaranm <at> ciaranm.org> Subject: Re: Proposed addition to the Social Contract Date: 2007-03-25 15:23:52 GMT Mail-ID was <20070325162352.445e4db5@snowflake> archived at http://article.gmane.org/gmane.linux.gentoo.devel/47327 Is there any progress on this issue? I've been looking at it, but my knowledge of mlmmj is minimal. I'm trying to determine exactly where the problem is coming from, and hoping I can assist Andrea in finding it. Right now, I'm not doing so well. mlmmj was updated to fix another issue now, and while I don't think it fixed this, there is a remote possibility it might ;-). Other than that, I took the issue to upstream now. Anyone else notice out of order replies coming in, at least on gmane, for the dev list the last couple days? Worth tracking and if so this ticket or start another (or is another already going)? Of course, now that I'm talking about it it'll probably behave for awhile and there'll be nothing to track. =8^P From here, it could be gmane too, of course, not the list itself. I hope my mail clients didn't screw up, but today has gotten worse. I lost four mails on -dev, plus one on -core. * evod2s$d47$1@sea.gmane.org From: Steve Long <slong <at> rathaus.eclipse.co.uk> Subject: Re: April Council meeting summary Date: 2007-04-13 16:58:52 GMT http://thread.gmane.org/gmane.linux.gentoo.devel/47974/focus=48010 * evo41a$abh$1@sea.gmane.org From: Steve Long <slong <at> rathaus.eclipse.co.uk> Subject: Re: EAPI 1 (Was: Re: Monthly Gentoo Council Reminder for April) Date: 2007-04-13 14:24:25 GMT (4 hours and 38 minutes ago) http://thread.gmane.org/gmane.linux.gentoo.devel/47645/focus=47988 * 200704131302.00976.vapier@gentoo.org From: Mike Frysinger <vapier <at> gentoo.org> Subject: Re: EAPI 1 (Was: Re: Monthly Gentoo Council Reminder for April) Date: 2007-04-13 17:02:00 GMT http://thread.gmane.org/gmane.linux.gentoo.devel/47645/focus=48009 * d14bee470704131029t49994d82ge2e231bfbbe54e30@mail.gmail.com From: Alex Tarkovsky <alextarkovsky <at> gmail.com> Subject: Re: baselayout-2 and volumes (raid, lvm, crypt, etc) Date: 2007-04-13 17:29:50 GMT http://thread.gmane.org/gmane.linux.gentoo.devel/47981/focus=48020 * 1176479379.8883.14.camel@inertia.twi-31o2.org Chris Gianelloni: [gentoo-core] GWN for last week same here, including my own mail, that does show up on gmane (almost instantly) i havent received any of those either This is getting *really* annoying lately, in the last couple of days I've missed almost a dozen mails (as far as I can tell). I just missed Message-ID: <9fce88250704162101y4be89dc3s36bb988944757c62@mail.gmail.com> but got all the replies so far. I realize this is mainly about mailing list dropping mails, however I have 3 machines setup with root aliased to my @g.o email address, and postfix setup to send via my ISP. At first I thought the issue was my ISP not sending, however, yesterday when troubleshooting it, I setup the PORTAGE_ELOG_FU in make.conf and emerged logrotate a few times. 2 times the mail came through, 2 times it did not. I thought perhaps it was pebcak, however, at 5AM CST, my Efika syncs its portage tree, and I should receive an email about that. The mail still has not arrived in my Gentoo email box. It is 9:14AM CST currently. May 3 05:19:31 wintermute postfix/pickup[8766]: E07D744571: uid=0 from=<root> May 3 05:19:32 wintermute postfix/cleanup[8861]: E07D744571: message-id=<20070503101931.E07D744571@wintermute.ubersekret.info> May 3 05:19:32 wintermute postfix/qmgr[3826]: E07D744571: from=<root@wintermute.ubersekret.info>, size=27812, nrcpt=1 (queue active) May 3 05:19:32 wintermute postfix/cleanup[8861]: A143D44455: message-id=<20070503101931.E07D744571@wintermute.ubersekret.info> May 3 05:19:32 wintermute postfix/qmgr[3826]: A143D44455: from=<root@wintermute.ubersekret.info>, size=27965, nrcpt=1 (queue active) May 3 05:19:32 wintermute postfix/local[8863]: E07D744571: to=<root@wintermute.ubersekret.info>, orig_to=<root>, relay=local, delay=1159, delays=1158/0.4/0/0.04, dsn=2.0.0, status=sent (forwarded as A143D44455) May 3 05:19:32 wintermute postfix/qmgr[3826]: E07D744571: removed May 3 05:19:34 wintermute postfix/smtp[8864]: A143D44455: to=<steev@gentoo.org>, orig_to=<root>, relay=smtp.central.cox.net[68.1.17.4]:25, delay=1.4, delays=0.03/0.22/0.2/0.93, dsn=2.0.0, status=sent (250 uaKq1W00F2RDG6U0000000 mail accepted for delivery) May 3 05:19:34 wintermute postfix/qmgr[3826]: A143D44455: removed Steev: File a new bug, as that is something on dev.gentoo.org, the lists aren't on the same server, so it is definitely a different bug. Thanks (lists?) mailserver is still dropping email randomly, even when no flamewars happen. Would be nice if this could be fixed eventually. Compare http://archives.gentoo.org/gentoo-dev/msg_148465.xml and http://thread.gmane.org/gmane.linux.gentoo.devel/52411 Gmane has gotten my reply, archives apparently not. Also, trapni sent a reply to my reply, and it didn't arive neither in gmane, archives as well as my own mailbox, though -dev was in the To, me in the Cc. The new lists.g.o server is in place. It's postfix+mlmmj this time, so we can share postfix configurations between machines. If you see that you are missing an email from this point forward, please leave a note on this bug. If there is nothing, I'm going to close this bug in 2 weeks (can reopen if needed). Relatedly for anybody using mail.ru on this bug, it seems that they have blacklisted several of the gentoo mail servers in the past, and rejected mail with 'user unknown': sendmail.log.1:Jan 3 04:40:00 robin sendmail_fast[11988]: m034dJC4011371: to=<XXXXXXXXXXX@mail.ru>, delay=00:00:41, xdelay=00:00:01, mailer=esmtp, pri=30093178, relay=mxs.mail.ru. [194.67.23.20], dsn=5.1.1, stat=User unknown But then still allowing some random mails to be received - smells like a badly implemented spam filter. Ok, it's still broken. I missed a mail myself. On the plus side however, I had it perfectly captured in the logs: mail.err:Jan 8 23:04:47 pigeon /usr/bin/mlmmj-send[9353]: getaddrsfromfd.c:27: Could not mmap fd: Invalid argument mail.err:Jan 8 23:04:47 pigeon /usr/bin/mlmmj-send[9353]: getaddrsfromfd.c:27: Could not mmap fd: Invalid argument mail.err:Jan 8 23:04:47 pigeon /usr/bin/mlmmj-send[9353]: getaddrsfromfd.c:27: Could not mmap fd: Invalid argument mail.err:Jan 8 23:04:47 pigeon /usr/bin/mlmmj-send[9353]: getaddrsfromfd.c:27: Could not mmap fd: Invalid argument mail.err:Jan 8 23:04:47 pigeon /usr/bin/mlmmj-send[9353]: getaddrsfromfd.c:27: Could not mmap fd: Invalid argument I'm going to dig in the mlmmj sources again. I know this is a controversial suggestion, but would it perhaps be possible to switch the mailing list software? SourceForge is doing fine for years with mailman or something. Maybe the investment to switch is less than the investment to fix mlmmj? I patched it up, so the error shouldn't occur anymore, but I'm tailing logs to make sure now. in the past, we've gone thru mailman, ezmlm, and then ended up on mlmmj. Mailman I personally dislike, as it seems to corrupt it's databases very often (pre-existing mailman instances at work suffer from this, at least once a month). Ok, so this looks much better now. I haven't personally lost any messages since I patched that of mlmmj - but I do welcome others to report message loss so that I can look into it - ideally within 24 hours of it being lost, so I can trace the logs before they are rotated out. *** Bug 196806 has been marked as a duplicate of this bug. *** I sent something to gentoo-qa that doesn't seem to have made its way to the list: Jan 17 09:43:11 aerie postfix/smtp[28680]: 5DE787ECD8: to=<gentoo-qa@lists.gentoo.org>, relay=lists.gentoo.org[69.77.167.62]:25, delay=0.45, delays=0.05/0.02/0.06/0.32, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as B5915E08A3) (that timestamp is EST) Ignore me. I suck. I forgot to resubscribe with my Gentoo email it seems. Created attachment 141236 [details]
sample digest email with the problem explained in comment
I am uncertain if this is directly related, but all digest emails that I have received for gentoo-user and gentoo-hardened since January 11 are blank, aside from some initial text. I signed up another email account on a different provider a few days ago, and it has the same problem.
aetherknight@comcast.net: please file a separate report for that. Looks related to the mlmmj templates. Thanks, I filed my problem as Bug 206590. it might be dropping mail again Message-ID: <13dd2de20808210739r2eba9d47u6e4b01d6866f723c@mail.gmail.com> To: gentoo-alt@lists.gentoo.org Cc: Fabian Groffen <grobian@gentoo.org> only arrived in my mailbox, not on gmane, not on http://archives.gentoo.org/gentoo-alt/, darksiide didn't receive it either. One thing to note, the mail was "only" 267K big, so maybe it was rejected. grobian: I need more of the headers please. Received: from mail-gx0-f10.google.com (mail-gx0-f10.google.com
[209.85.217.10]) by smtp.gentoo.org (Postfix) with ESMTP id 9F7E3649AE
for <grobian@gentoo.org>; Thu, 21 Aug 2008 14:39:43 +0000 (UTC)
Received: by gxk3 with SMTP id 3so122342gxk.0
for <grobian@gentoo.org>; Thu, 21 Aug 2008 07:39:42 -0700 (PDT)
Received: by 10.151.149.14 with SMTP id b14mr2297893ybo.24.1219329582279;
Thu, 21 Aug 2008 07:39:42 -0700 (PDT)
Received: by xx.xx.xx.xx with HTTP; Thu, 21 Aug 2008 07:39:42 -0700 (PDT)
Message-ID: <13dd2de20808210739r2eba9d47u6e4b01d6866f723c@mail.gmail.com>
Date: Thu, 21 Aug 2008 15:39:42 +0100
From: Mietek Bąk <mietek@gmail.com>
To: gentoo-alt@lists.gentoo.org
Subject: Lossage due to sys-devel/odcctools-20080820
Cc: Fabian Groffen <grobian@gentoo.org>
MIME-Version: 1.0
Content-Type: multipart/mixed;
boundary="----=_Part_29902_24136942.1219329582184"
The mails are sent separate, of course, since the domains differ. I removed the google signature header crap as I don't think it is of any use for the debugging.
grobian: the listserv dropped the mail because it wasn't from a subscriber to gentoo-alt. mietek@gmail.com unsubscribed on June 24th. closing this as the rest of the mail-drop issue is long gone. |
