Skip Menu | Logged in as guest | Logout
 
Ticket metadata
Id: 3909
Status: resolved
Priority: 3/0
Queue: vdt-support

Fixed in: 1.10.1k
Fix scheduled: CUR

Owner: Tim Cartwright
Requestors: agopu@indiana.edu
Cc: hayashis@indiana.edu
thomlee@indiana.edu
AdminCc:

More about agopu@indiana.edu
Comments about this user:
No comment entered about this user
This user's 10 highest priority tickets:
Groups this user belongs to:
  • Everyone
  • Unprivileged

New reminder:

Created: Tue Sep 09 13:46:43 2008
Starts: Not set
Started: Not set
Last Contact: Tue Sep 30 16:45:07 2008
Due: Not set
Closed: Tue Sep 30 16:45:07 2008
Updated: Tue Sep 30 16:45:32 2008 by cat



History Brief headersFull headers
CC: Soichi Hayashi <hayashis@indiana.edu>, Tom Lee <thomlee@indiana.edu>
Subject: Requesting additional modules: mod_headers on VDT Apache
Date: Tue, 09 Sep 2008 14:50:52 -0400
To: vdt-support@OPENSCIENCEGRID.ORG
From: Arvind Gopu <agopu@indiana.edu>
Download (untitled) / with headers
text/plain 1.7k
Alain,Tim C/Scot (who I spoke to on the phone about this),

Soichi needs some additional Apache modules for the OSG dashboard he's
working on at the GOC. See emai below for details. Can you let us know
what the protocol to add such modules into VDT ('s apache) are? Thanks
very much!

Cheers,
Arvind

Soichi's request:

>> On 9/5/2008 9:51 AM, Soichi Hayashi pondered:
>>
>>> Tom, Arvind,
>>>
>>> I need a apache module mod_headers and mod_expires installed on apache
>>> instance for RSV-WEB. What are the protocols involved with installing
>>> new apache modules? Can you do this install, or do you want me to do it?
>>>
>>> Thanks,
>>>


For your reference, an email from our sysadmin Tom Lee who compiled it
separately -- ideally we'd *not* like to do that.

...

Which leaves finding the source for Apache 2.2.4 and compiling the
modules ourselves as the least-bad solution. I don't even like doing
this really, since we aren't using the same exact source code that was
used to compile the VDT Apache (did they patch it, and would we know if
they did?). At any rate, I have downloaded (from apache.org) and
compiled Apache 2.2.4 on sonofsam. The source tarball is in /root/dl,
and the build directory is /usr/src/httpd-2.2.4 . I installed things
in /usr/src/httpd-2.2.4/install, because I have no intention that this
Apache build will ever be used for anything other than reference. It
might be good to just leave that build directory where it is, in fact
-- if you need any of the many omitted modules, just copy them from
there (they're in /usr/src/httpd-2.2.4/install/modules), and please
don't change anything without letting people know.

Here's my configure command for reference:

[root@sonofsam httpd-2.2.4]# ./configure
--prefix=/usr/src/httpd-2.2.4/install --enable-mods-shared=most
Download smime.p7s
application/x-pkcs7-signature 3.8k
On Tue Sep 09 13:46:44 2008, Arvind wrote:
> Soichi needs some additional Apache modules for the OSG dashboard he's
> working on at the GOC. See emai below for details. Can you let us know
> what the protocol to add such modules into VDT ('s apache) are? Thanks
> very much!

The protocol is that you email vdt-support and ask us, then we ask you
questions about it. :)

Why do you need these modules? Will they benefit other VDT users, or
just the GOC? How important are they? When do you need them by?

In the past, I briefly talked to Soichi about this, and I think he said
that the GOC is likely to need a steady stream of Apache modules. Do you
see this kind of request recurring? Any idea of what you might need in
the future?

I think we're probably happy to provide them, but I need a deeper
understanding of the situation.

Thanks,
-alain

-----------------------------------------------------------------
Alain Roy vdt-support@opensciencegrid.org
VDT Support http://vdt.cs.wisc.edu/support.html
(Resending, because I forgot to add Soichi and Tom to the ticket.)

On Tue Sep 09 13:46:44 2008, Arvind wrote:

> Soichi needs some additional Apache modules for the OSG dashboard he's
> working on at the GOC. See emai below for details. Can you let us know
> what the protocol to add such modules into VDT ('s apache) are? Thanks
> very much!


The protocol is that you email vdt-support and ask us, then we ask you
questions about it. :)

Why do you need these modules? Will they benefit other VDT users, or
just the GOC? How important are they? When do you need them by?

In the past, I briefly talked to Soichi about this, and I think he said
that the GOC is likely to need a steady stream of Apache modules. Do you
see this kind of request recurring? Any idea of what you might need in
the future?

I think we're probably happy to provide them, but I need a deeper
understanding of the situation.

Thanks,
-alain

-----------------------------------------------------------------
Alain Roy vdt-support@opensciencegrid.org
VDT Support http://vdt.cs.wisc.edu/support.html
CC: "Gopu, Arvind" <agopu@indiana.edu>, "Lee, Thomas Jennings" <thomlee@indiana.edu>
Subject: Re: [vdt-support #3909] Requesting additional modules: mod_headers on VDT Apache
Date: Wed, 10 Sep 2008 11:08:59 -0400
To: "vdt-support@opensciencegrid.org" <vdt-support@OPENSCIENCEGRID.ORG>
From: Soichi Hayashi <hayashis@indiana.edu>
Download (untitled) / with headers
text/plain 1.7k
The reason why I need mod_headers is to allow me to fine tune browser
caching mechanism (such as "304 Not Modified" code) without making
changes to the apache config file itself. This can dramatically increase
the speed of page load. mod_expire is also for performance tuning purpose.

I can't think of what other modules I will be needing in the future..
but I feel good to have all of the standard modules available just in
case - it doesn't hurt anyone to have them in the /modules directory, right?

Alain Roy via RT wrote:
> (Resending, because I forgot to add Soichi and Tom to the ticket.)
>
> On Tue Sep 09 13:46:44 2008, Arvind wrote:
>
>
>> Soichi needs some additional Apache modules for the OSG dashboard he's
>> working on at the GOC. See emai below for details. Can you let us know
>> what the protocol to add such modules into VDT ('s apache) are? Thanks
>> very much!
>>
>
>
> The protocol is that you email vdt-support and ask us, then we ask you
> questions about it. :)
>
> Why do you need these modules? Will they benefit other VDT users, or
> just the GOC? How important are they? When do you need them by?
>
> In the past, I briefly talked to Soichi about this, and I think he said
> that the GOC is likely to need a steady stream of Apache modules. Do you
> see this kind of request recurring? Any idea of what you might need in
> the future?
>
> I think we're probably happy to provide them, but I need a deeper
> understanding of the situation.
>
> Thanks,
> -alain
>
> -----------------------------------------------------------------
> Alain Roy vdt-support@opensciencegrid.org
> VDT Support http://vdt.cs.wisc.edu/support.html
>
>
> --
> View ticket at <http://crt.cs.wisc.edu/Ticket/Display.html?user=guest&pass=guest&id=3909>
> VDT Support: vdt-support@opensciencegrid.org
>
Download smime.p7s
application/x-pkcs7-signature 2.6k
Subject: Re: [vdt-support #3909] Requesting additional modules: mod_headers on VDT Apache
Date: Wed, 10 Sep 2008 10:20:49 -0500
To: vdt-support@OPENSCIENCEGRID.ORG
From: Alain Roy <roy@cs.wisc.edu>
Download (untitled) / with headers
text/plain 919b
On Sep 10, 2008, at 10:13 AM, Soichi Hayashi via RT wrote:
> The reason why I need mod_headers is to allow me to fine tune browser
> caching mechanism (such as "304 Not Modified" code) without making
> changes to the apache config file itself. This can dramatically
> increase
> the speed of page load. mod_expire is also for performance tuning
> purpose.

Fair enough. By when do you need them to be in the VDT? We have to
figure out how to prioritize this work.

Do you think other sites might benefit from them being there?

> I can't think of what other modules I will be needing in the future..
> but I feel good to have all of the standard modules available just in
> case - it doesn't hurt anyone to have them in the /modules
> directory, right?

I would rather have things disabled than enabled if they aren't
needed. It's generally safer to have less software, from a security
perspective.

-alain
CC: "Gopu, Arvind" <agopu@indiana.edu>, "Lee, Thomas Jennings" <thomlee@indiana.edu>
Subject: Re: [vdt-support #3909] Requesting additional modules: mod_headers on VDT Apache
Date: Wed, 10 Sep 2008 11:31:44 -0400
To: "vdt-support@opensciencegrid.org" <vdt-support@OPENSCIENCEGRID.ORG>
From: Soichi Hayashi <hayashis@indiana.edu>
Download (untitled) / with headers
text/plain 1.7k


Alain Roy via RT wrote:
> On Sep 10, 2008, at 10:13 AM, Soichi Hayashi via RT wrote:
>
>> The reason why I need mod_headers is to allow me to fine tune browser
>> caching mechanism (such as "304 Not Modified" code) without making
>> changes to the apache config file itself. This can dramatically
>> increase
>> the speed of page load. mod_expire is also for performance tuning
>> purpose.
>>
>
> Fair enough. By when do you need them to be in the VDT? We have to
> figure out how to prioritize this work.
>
> Do you think other sites might benefit from them being there?
>
>
I don't know what other sites are doing so I don't have specific site
names.. Having these modules there will allow sysadmins to not have to
compile their own modules against the VDT apache - mod_python is used
widely by people who uses Python based web application frameworks, and
currently every site has to hack around to get it compiled against the
VDT apache.

>> I can't think of what other modules I will be needing in the future..
>> but I feel good to have all of the standard modules available just in
>> case - it doesn't hurt anyone to have them in the /modules
>> directory, right?
>>
>
> I would rather have things disabled than enabled if they aren't
> needed. It's generally safer to have less software, from a security
> perspective.
>
>
Having those modules in /module directory will not automatically enable
the them on apache instance. Sysadmin has to add LoadModule directive in
apache configuration files for each modules to enable them. Having those
modules sitting in that directory will have no negative impact.

> -alain
>
>
> --
> View ticket at <http://crt.cs.wisc.edu/Ticket/Display.html?user=guest&pass=guest&id=3909>
> VDT Support: vdt-support@opensciencegrid.org
>
Download smime.p7s
application/x-pkcs7-signature 2.6k
CC: "vdt-support@opensciencegrid.org" <vdt-support@OPENSCIENCEGRID.ORG>, "Lee, Thomas Jennings" <thomlee@indiana.edu>
Subject: Re: [vdt-support #3909] Requesting additional modules: mod_headers on VDT Apache
Date: Wed, 10 Sep 2008 11:39:29 -0400
To: Soichi Hayashi <hayashis@indiana.edu>
From: Arvind Gopu <agopu@indiana.edu>
Download (untitled) / with headers
text/plain 2.4k
On 9/10/2008 11:31 AM, Soichi Hayashi pondered:
> Alain Roy via RT wrote:
>> On Sep 10, 2008, at 10:13 AM, Soichi Hayashi via RT wrote:
>>
>>> The reason why I need mod_headers is to allow me to fine tune browser
>>> caching mechanism (such as "304 Not Modified" code) without making
>>> changes to the apache config file itself. This can dramatically
>>> increase
>>> the speed of page load. mod_expire is also for performance tuning
>>> purpose.
>>>
>>
>> Fair enough. By when do you need them to be in the VDT? We have to
>> figure out how to prioritize this work.
>>
>> Do you think other sites might benefit from them being there?
>>
>>
> I don't know what other sites are doing so I don't have specific site
> names.. Having these modules there will allow sysadmins to not have to
> compile their own modules against the VDT apache - mod_python is used
> widely by people who uses Python based web application frameworks, and
> currently every site has to hack around to get it compiled against the
> VDT apache.
>

As an aside, I think the reason Alain et al have never received such
requests is because most OSG admins use the VDT apache for the default
purposes it's intended to server -- for example, perhaps as a scaffold
for Tomcat to work in case of Gratia. I am guessing most folks use their
own Apache to run their web services but in our case, we're trying to
restrict the number of pieces of software our admin needs to maintain
... since we have the VDT Apache running on the machine, we are hoping
we can use it for our other web services as well.

Cheers,
Arvind

>>> I can't think of what other modules I will be needing in the future..
>>> but I feel good to have all of the standard modules available just in
>>> case - it doesn't hurt anyone to have them in the /modules
>>> directory, right?
>>>
>>
>> I would rather have things disabled than enabled if they aren't
>> needed. It's generally safer to have less software, from a security
>> perspective.
>>
>>
> Having those modules in /module directory will not automatically
> enable the them on apache instance. Sysadmin has to add LoadModule
> directive in apache configuration files for each modules to enable
> them. Having those modules sitting in that directory will have no
> negative impact.
>
>> -alain
>>
>>
>> --
>> View ticket at <http://crt.cs.wisc.edu/Ticket/Display.html?user=guest&pass=guest&id=3909>
>> VDT Support: vdt-support@opensciencegrid.org
>>
>
Download smime.p7s
application/x-pkcs7-signature 3.8k
Subject: Re: [vdt-support #3909] Requesting additional modules: mod_headers on VDT Apache
Date: Fri, 12 Sep 2008 14:30:32 -0500
To: vdt-support@OPENSCIENCEGRID.ORG
From: Alain Roy <roy@cs.wisc.edu>
Download (untitled) / with headers
text/plain 2.2k
Sorry to drop out of the discussion, things got busy this week.

Tim and I are looking into this, but it seems to be very
straightforward to add mod_headers and mod_expires to our Apache
build. One question:

> I don't know what other sites are doing so I don't have specific site
> names.. Having these modules there will allow sysadmins to not have to
> compile their own modules against the VDT apache - mod_python is used
> widely by people who uses Python based web application frameworks, and
> currently every site has to hack around to get it compiled against the
> VDT apache.

I thought you were just asking for mod_headers and mod_expires. Are
you also asking for mod_python? I haven't heard of any sites building
mod_python: are sites beyond the GOC interested in it? Please set me
straight, so we do the right thing here.

>>> I can't think of what other modules I will be needing in the
>>> future..
>>> but I feel good to have all of the standard modules available just
>>> in
>>> case - it doesn't hurt anyone to have them in the /modules
>>> directory, right?
>>>
>>
>> I would rather have things disabled than enabled if they aren't
>> needed. It's generally safer to have less software, from a security
>> perspective.
>>
>>
> Having those modules in /module directory will not automatically
> enable
> the them on apache instance. Sysadmin has to add LoadModule
> directive in
> apache configuration files for each modules to enable them. Having
> those
> modules sitting in that directory will have no negative impact.

In the big picture, it does matter.

1) It's not just technical. System administrators look at what we've
installed. If we have something with a known security problem, even if
it's not obviously used, it scares them. It's easier to convince
someone that it's not a problem if it's not installed.

2) If there is a security problem with these modules, and if we're
shipping them we have to ship the update because we don't know who is
using them.

That said, we're willing to ship mod_headers and mod_expires.

-alain

-----------------------------------------------------------------
Alain Roy vdt-support@opensciencegrid.org
VDT Support http://vdt.cs.wisc.edu/support.html
Download smime.p7s
application/pkcs7-signature 2.7k
CC: "Gopu, Arvind" <agopu@indiana.edu>, "Lee, Thomas Jennings" <thomlee@indiana.edu>
Subject: Re: [vdt-support #3909] Requesting additional modules: mod_headers on VDT Apache
Date: Thu, 18 Sep 2008 11:50:34 -0400
To: "vdt-support@opensciencegrid.org" <vdt-support@OPENSCIENCEGRID.ORG>
From: Soichi Hayashi <hayashis@indiana.edu>
Download (untitled) / with headers
text/plain 2.8k
If you could ship mod_headers and mod_expires, that will help us a lot -
for now.

In the future, if we need modules like mod_python, I will try to compile
it myself. I am hoping that by the time we do that we will have updated
version of VDT installed on our machines so that it will not be as hard
to do.

Thanks,
Soichi


Alain Roy via RT wrote:
> Sorry to drop out of the discussion, things got busy this week.
>
> Tim and I are looking into this, but it seems to be very
> straightforward to add mod_headers and mod_expires to our Apache
> build. One question:
>
>
>> I don't know what other sites are doing so I don't have specific site
>> names.. Having these modules there will allow sysadmins to not have to
>> compile their own modules against the VDT apache - mod_python is used
>> widely by people who uses Python based web application frameworks, and
>> currently every site has to hack around to get it compiled against the
>> VDT apache.
>>
>
> I thought you were just asking for mod_headers and mod_expires. Are
> you also asking for mod_python? I haven't heard of any sites building
> mod_python: are sites beyond the GOC interested in it? Please set me
> straight, so we do the right thing here.
>
>
>>>> I can't think of what other modules I will be needing in the
>>>> future..
>>>> but I feel good to have all of the standard modules available just
>>>> in
>>>> case - it doesn't hurt anyone to have them in the /modules
>>>> directory, right?
>>>>
>>>>
>>> I would rather have things disabled than enabled if they aren't
>>> needed. It's generally safer to have less software, from a security
>>> perspective.
>>>
>>>
>>>
>> Having those modules in /module directory will not automatically
>> enable
>> the them on apache instance. Sysadmin has to add LoadModule
>> directive in
>> apache configuration files for each modules to enable them. Having
>> those
>> modules sitting in that directory will have no negative impact.
>>
>
> In the big picture, it does matter.
>
> 1) It's not just technical. System administrators look at what we've
> installed. If we have something with a known security problem, even if
> it's not obviously used, it scares them. It's easier to convince
> someone that it's not a problem if it's not installed.
>
> 2) If there is a security problem with these modules, and if we're
> shipping them we have to ship the update because we don't know who is
> using them.
>
> That said, we're willing to ship mod_headers and mod_expires.
>
> -alain
>
> -----------------------------------------------------------------
> Alain Roy vdt-support@opensciencegrid.org
> VDT Support http://vdt.cs.wisc.edu/support.html
>
>
>
> --
> View ticket at <http://crt.cs.wisc.edu/Ticket/Display.html?user=guest&pass=guest&id=3909>
> VDT Support: vdt-support@opensciencegrid.org
>
Download smime.p7s
application/x-pkcs7-signature 2.6k
Subject: [vdt-support #3909] SVN commit, rev 8050
To: vdt-support@cs.wisc.edu
From: cat@cs.wisc.edu
Download (untitled) / with headers
text/plain 305b
Commit comment:
Changed the Apache build to include mod_expires and mod_headers for the GOC.


Changed files:
U vdt/branches/vdt-1.10.1-cat-ramt-updates/Apache/nmi/build-apache.pl
U vdt/branches/vdt-1.10.1-cat-ramt-updates/defs

To generate a diff:
svn diff -c 8050 file:///p/condor/workspaces/vdt/svn
Subject: [vdt-support #3909] SVN commit, rev 8112
To: vdt-support@cs.wisc.edu
From: cat@cs.wisc.edu
Download (untitled) / with headers
text/plain 287b
Commit comment:
Move LoadModule directives to VDT config file so that they're preserved (i.e.,
commented out or not) across updates.


Changed files:
U vdt/branches/vdt-1.10.1/Configure-Apache/vdt/setup/configure_apache

To generate a diff:
svn diff -c 8112 file:///p/vdt/workspace/svn
Subject: [vdt-support #3909] SVN commit, rev 8113
To: vdt-support@cs.wisc.edu
From: cat@cs.wisc.edu
Download (untitled) / with headers
text/plain 227b
Commit comment:
Darnit, forgot the 'm' option on regular expressions....


Changed files:
U vdt/branches/vdt-1.10.1/Configure-Apache/vdt/setup/configure_apache

To generate a diff:
svn diff -c 8113 file:///p/vdt/workspace/svn
Download (untitled) / with headers
text/plain 177b
We have added mod_expires and mod_headers to the VDT's Apache build and
configuration (although disabled by default). We expect to release this update
next Monday, October 6th.