[RAS] ReDIF-perl trouble

[Sune Karlsson]

One thing that could be causing problems is if $header doesn't end with a newline. Then there would be no blank line between the headers and the body of the message.

I doubt that encode would do something really strange. Have you tried printing to a file instead of piping?

/Sune

> -----Original Message-----
> From: 'Christian Zimmermann' [mailto:zimmermann at stlouisfed.org]
> Sent: Sunday, April 10, 2016 11:52 PM
> To: Dan Hayes
> Cc: Sune Karlsson; Thomas Krichel; RAS-run Mailing List
> Subject: Re: [RAS] ReDIF-perl trouble
> 
> The configuration file for ACIS (the software for RAS) has:
> 
> sendmail     = '/usr/sbin/sendmail -t -f authors at repec.org'
> 
> So it is not using a perl module to send email. It pipes to sendmail:
> 
>    my $sendmail = $config -> {sendmail};
>    if ( open MESSAGE, "|-:utf8", $sendmail ) {
>      print MESSAGE $header, "\n", $body;
>      close MESSAGE;
>    }
> 
> I am currently playing with a line that has the following comment:
>      my $val   = encode( 'MIME-Q', $value );
>      # a nasty hack to fix Encode's wrapping 'feature':
> 
> Could be promising. It is applied to message headers.
> 
> Christian Zimmermann                          FIGUGEGL!
> Economic Research
> Federal Reserve Bank of St. Louis
> P.O. Box 442
> St. Louis MO 63166-0442 USA
> https://mailfilter.sunet.se/canit/urlproxy.php?_q=aHR0cHM6Ly9pZGVhcy5yZX
> BlYy5vcmcvemltbS8%3D&_r=b3J1LXNl&_s=c2tuQG9ydS5zZQ%3D%3D
> @CZimm_economist
> 
> On Sun, 10 Apr 2016, Dan Hayes wrote:
> 
> > the mail gateway "mx1.stlouisfed.org" is configured in sendmail and
> postfix
> > config files, /etc/mail/sendmail.mc and /etc/postfix/main.cf.  I'm not
> sure
> > where it might be included in perl code or why it would be.
> >
> > On Sun, Apr 10, 2016 at 2:47 PM, Sune Karlsson <Sune.Karlsson at oru.se>
> wrote:
> >
> >> Some thoughts off the top of my head. Most probably random noise or
> things
> >> you have already thought of.
> >>
> >> Is mx1.stlouisfed.org your mail gateway? Is this configured somewhere
> or
> >> picked up automatically? If configured it might help to trace where
> this
> >> variable is used.
> >>
> >> Perl module or system call for sending e-mail? I doubt that something
> is
> >> "messing" with the e-mail address. It is more likely that whatever is
> >> sending the e-mail tacks on the @mx1.stlouisfed.org to the address
> for
> >> some strange reason.
> >>
> >> /Sune
> >>
> >>> -----Original Message-----
> >>> From: 'Christian Zimmermann' [mailto:zimmermann at stlouisfed.org]
> >>> Sent: Sunday, April 10, 2016 8:03 PM
> >>> To: Sune Karlsson
> >>> Cc: Thomas Krichel; RAS-run Mailing List; Hayes, Dan -- Dan Hayes
> >>> Subject: RE: [RAS] ReDIF-perl trouble
> >>>
> >>> The latest of the little I was able to figure out.
> >>>
> >>> ReDIF-perl does not seem to be to blame, at least not directly.
> Updating
> >>> it triggered all sort of other updates, and despite reverting ReDIF-
> >>> perl,
> >>> emails are *not* going out. New registrants and email changes
> bounced
> >>> hopping within our system.
> >>>
> >>> Emails are typically formatted like
> >>> zimmermann at stlouisfed.org@mx1.stlouisfed.org
> >>>
> >>> but I have seen one split in two like this:
> >>> christian.zimmermann at stls.frb.o@mx1.stlouisfed.org
> >>> rg at mx1.stlouisfed.org
> >>>
> >>> which makes absolutely no sense.
> >>>
> >>> There must be some package that has started messing with those email
> >>> addresses. From the list of updated packages, there is no obvious
> >>> candidate.
> >>>
> >>> Still digging.
> >>>
> >>> And, no, Thomas I cannot give you access to the machine.
> >>>
> >>>
> >>>
> >>> Christian Zimmermann                          FIGUGEGL!
> >>> Economic Research
> >>> Federal Reserve Bank of St. Louis
> >>> P.O. Box 442
> >>> St. Louis MO 63166-0442 USA
> >>>
> https://mailfilter.sunet.se/canit/urlproxy.php?_q=aHR0cHM6Ly9pZGVhcy5yZX
> >>> BlYy5vcmcvemltbS8%3D&_r=b3J1LXNl&_s=c2tuQG9ydS5zZQ%3D%3D
> >>> @CZimm_economist
> >>>
> >>> On Sun, 10 Apr 2016, Sune Karlsson wrote:
> >>>
> >>>>>> 2) I notice today the ReDIF-perl was not installed on RAS. after
> >>>>>> installation though, emails have broken. the to field is
> malformed,
> >>>>> for
> >>>>>> example:
> >>>>>>
> >>>>>> The following message to <"Christian Zimmermann"
> >>>>>> <zimmermann at stlouisfed.org>@mx1.stlouisfed.org> was
> >>>>>> undeliverable.
> >>>>>>
> >>>>>> returning to 2.70 fixed the problem, so it has nothing to do with
> >>> any
> >>>>>> external perl module that refreshed during install. I suspect
> this
> >>> has
> >>>>> to do
> >>>>>> with the following in Parser.pm:
> >>>>>>
> >>>>>> <             'remove_newline_from_values' => 0,
> >>>>>>> #SK            'remove_newline_from_values' => 0, Obsoleted by
> new
> >>>>>> Unicode processing, newlines are always removed
> >>>>>>
> >>>>>> or at least that is all I can see.
> >>>>
> >>>> There are many differences between 2.70 and 2.74. It's not clear to
> me
> >>> that they should cause problems with sending e-mails. At least I
> have
> >>> not experienced any problems.
> >>>>
> >>>> Which process is sending the e-mail, where does it get the e-mail
> >>> address? Perl module for sending e-mail or system call to an
> external
> >>> process? I suppose an assumption of a newline (or white space) at
> the
> >>> end of the e-mail address that no longer holds could cause problems
> when
> >>> building a command line.
> >>>>
> >>>> /Sune
> >>>>
> >>
> >