RT for crt.cs.wisc.edu
RT for crt.cs.wisc.edu
| # | Mon Sep 22 17:08:05 2008 | gratia-operation@fnal.gov - Ticket created | [Reply] | |||||||||
Hi,
The Gratia services and reporting are now available for packaging for the VDT via https://twiki.grid.iu.edu/bin/view/Accounting/InstallationGuideVDT. Please note the following items from the text of that page:
This upgrade is recommended for everyone running their own collector including the RSV team with their MetricRecord collectors. We would be grateful if this could go into a forthcoming update to OSG 1.0. A related probe release will be forthcoming in a day or so. Please let us know if you have any questions about or problems with this forthcoming release. Thanks, Chris. -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||
| # | Tue Sep 23 09:35:28 2008 | roy - Given to cat | ||
| # | Tue Sep 23 09:41:15 2008 | roy - Correspondence added | [Reply] | |
|
Thanks for the update. I have a few questions below. > Please note the following items from the text of that page: > > HELP NOTE > With release v0.38, we rely on files being placed in > tomcat/v55/common/lib, tomcat/v55/server/lib and > tomcat/v55/common/classes. In addition, log4j.properties should > be copied > from tomcat/v55/gratia to tomcat/v55/common/classes (or merged > if one > already exists). Our recommendation has always been that Gratia > services > be the only thing installed in a given VDT area so contention > for > libraries between different services in the same tomcat > container should > not be an issue. I don't fully understand what needs to be done. For the moment, I've assigned this ticket to Tim Cartwright. Tim: can you evaluate this request to see what the issues are? Once we understand them, and how to deal with them, we'll decide who should actually take this ticket to do the implementation. I don't think it has to be you, but I think you're the best equipped to evaluate the changes to the installation since you have the most knowledge about Tomcat. > This upgrade is recommended for everyone running their own collector > including > the RSV team with their MetricRecord collectors. We would be grateful > if this > could go into a forthcoming update to OSG 1.0. What sort of time line are you requesting? What is the priority of this update? We need to understand, so we can schedule this work properly. I know that effort towards Gratia is changing shortly. If we have questions about this update, who should we address them to? Thanks, -alain ----------------------------------------------------------------- Alain Roy vdt-support@opensciencegrid.org VDT Support http://vdt.cs.wisc.edu/support.html |
||||
| # | Tue Sep 23 09:41:16 2008 | RT_System - Status changed from 'new' to 'open' | ||
| # | Tue Sep 23 09:41:25 2008 | roy - Priority changed from (no value) to '3' | ||
| # | Tue Sep 23 15:38:22 2008 | pcanal@fnal.gov - Correspondence added | [Reply] | |||||||||||
> I know that effort towards Gratia is changing shortly. If we have > questions about this update, who should we address them to? Even-though the effort is ramping down, the communication channel are unchanged (and Chris and I are continuing to be the point of contacts0). Cheers, Philippe. Alain Roy via RT wrote: > Thanks for the update. I have a few questions below. > > >> Please note the following items from the text of that page: >>> >> HELP NOTE >> With release v0.38, we rely on files being placed in >> tomcat/v55/common/lib, tomcat/v55/server/lib and >> tomcat/v55/common/classes. In addition, log4j.properties should >> be copied >> from tomcat/v55/gratia to tomcat/v55/common/classes (or merged >> if one >> already exists). Our recommendation has always been that Gratia >> services >> be the only thing installed in a given VDT area so contention >> for >> libraries between different services in the same tomcat >> container should >> not be an issue. >> > I don't fully understand what needs to be done. For the moment, I've > assigned this ticket to Tim Cartwright. > > Tim: can you evaluate this request to see what the issues are? Once we > understand them, and how to deal with them, we'll decide who should > actually take this ticket to do the implementation. I don't think it has > to be you, but I think you're the best equipped to evaluate the changes > to the installation since you have the most knowledge about Tomcat. > > >> This upgrade is recommended for everyone running their own collector >>> including >> the RSV team with their MetricRecord collectors. We would be grateful >> if this >> could go into a forthcoming update to OSG 1.0. >> > What sort of time line are you requesting? What is the priority of this > update? We need to understand, so we can schedule this work properly. > > I know that effort towards Gratia is changing shortly. If we have > questions about this update, who should we address them to? > > Thanks, > -alain > > ----------------------------------------------------------------- > Alain Roy vdt-support@opensciencegrid.org > VDT Support http://vdt.cs.wisc.edu/support.html > > > |
||||||||||||||
| # | Tue Sep 23 15:38:22 2008 | pcanal@fnal.gov - Correspondence added | [Reply] | |||||||||||
> What sort of time line are you requesting? What is the priority of this > update? We need to understand, so we can schedule this work properly. > I know that effort towards Gratia is changing shortly. If we have > questions about this update, who should we address them to? The next release of Gratia is v1.0 around October 15; this release will contain only minor updates and bug fixes and should be the last for a while, so it would be best if the incorporation of v0.38 could be done before then (so that we have to time to correct any issue in time for October 15). Thanks, Philippe. Alain Roy via RT wrote: > Thanks for the update. I have a few questions below. > > >> Please note the following items from the text of that page: >>> >> HELP NOTE >> With release v0.38, we rely on files being placed in >> tomcat/v55/common/lib, tomcat/v55/server/lib and >> tomcat/v55/common/classes. In addition, log4j.properties should >> be copied >> from tomcat/v55/gratia to tomcat/v55/common/classes (or merged >> if one >> already exists). Our recommendation has always been that Gratia >> services >> be the only thing installed in a given VDT area so contention >> for >> libraries between different services in the same tomcat >> container should >> not be an issue. >> > I don't fully understand what needs to be done. For the moment, I've > assigned this ticket to Tim Cartwright. > > Tim: can you evaluate this request to see what the issues are? Once we > understand them, and how to deal with them, we'll decide who should > actually take this ticket to do the implementation. I don't think it has > to be you, but I think you're the best equipped to evaluate the changes > to the installation since you have the most knowledge about Tomcat. > > >> This upgrade is recommended for everyone running their own collector >>> including >> the RSV team with their MetricRecord collectors. We would be grateful >> if this >> could go into a forthcoming update to OSG 1.0. >> > What sort of time line are you requesting? What is the priority of this > update? We need to understand, so we can schedule this work properly. > > I know that effort towards Gratia is changing shortly. If we have > questions about this update, who should we address them to? > > Thanks, > -alain > > ----------------------------------------------------------------- > Alain Roy vdt-support@opensciencegrid.org > VDT Support http://vdt.cs.wisc.edu/support.html > > > |
||||||||||||||
| # | Tue Sep 23 15:48:24 2008 | chadwick@fnal.gov - Correspondence added | [Reply] | |||||||||||
Philippe, Alain, With the formal handover of Gratia operations to FermiGrid, I have asked Dan Yocum to make some changes in the communication channels: gratia-operation(s) - will become a operations only list. I believe that if it does not already exist, a new list: gratia-development - will be created for gratia development. So the appropriate point of contact may change depending on the focus of the issue - opeations or development. -Keith. At 12:34 PM -0500 9/23/08, Philippe Canal wrote: >>I know that effort towards Gratia is changing shortly. If we have >>>questions about this update, who should we address them to? >Even-though the effort is ramping down, the communication channel >are unchanged >(and Chris and I are continuing to be the point of contacts0). > >Cheers, >Philippe. > >Alain Roy via RT wrote: >>Thanks for the update. I have a few questions below. >> >> >>>Please note the following items from the text of that page: >>>>> >>>HELP NOTE >>> With release v0.38, we rely on files being placed in >>> tomcat/v55/common/lib, tomcat/v55/server/lib and >>> tomcat/v55/common/classes. In addition, log4j.properties should >>>be copied >>> from tomcat/v55/gratia to tomcat/v55/common/classes (or merged >>>if one >>> already exists). Our recommendation has always been that Gratia >>>services >>> be the only thing installed in a given VDT area so contention >>>for >>> libraries between different services in the same tomcat >>>container should >>> not be an issue. >>> >>I don't fully understand what needs to be done. For the moment, I've >>assigned this ticket to Tim Cartwright. >> >>Tim: can you evaluate this request to see what the issues are? Once we >>understand them, and how to deal with them, we'll decide who should >>actually take this ticket to do the implementation. I don't think it has >>to be you, but I think you're the best equipped to evaluate the changes >>to the installation since you have the most knowledge about Tomcat. >> >> >>>This upgrade is recommended for everyone running their own collector >>>>>including >>>the RSV team with their MetricRecord collectors. We would be grateful >>>if this >>>could go into a forthcoming update to OSG 1.0. >>> >>What sort of time line are you requesting? What is the priority of this >>update? We need to understand, so we can schedule this work properly. >>I know that effort towards Gratia is changing shortly. If we have >>questions about this update, who should we address them to? >> >>Thanks, >>-alain >> >>----------------------------------------------------------------- >>Alain Roy vdt-support@opensciencegrid.org >>VDT Support http://vdt.cs.wisc.edu/support.html >> >> |
||||||||||||||
| # | Tue Sep 23 16:04:53 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Keith Chadwick wrote: > Philippe, Alain, We already have grid-accounting, which is the development list. No need > > With the formal handover of Gratia operations to FermiGrid, I have > asked Dan Yocum to make some changes in the communication channels: > > gratia-operation(s) - will become a operations only list. > > I believe that if it does not already exist, a new list: > > gratia-development - will be created for gratia development. > > So the appropriate point of contact may change depending on the focus > of the issue - opeations or development. for a new list. Thanks, Chris. > > -Keith. > > At 12:34 PM -0500 9/23/08, Philippe Canal wrote: >>> I know that effort towards Gratia is changing shortly. If we have >>>>> questions about this update, who should we address them to? >> Even-though the effort is ramping down, the communication channel are >> unchanged >> (and Chris and I are continuing to be the point of contacts0). >> >> Cheers, >> Philippe. >> >> Alain Roy via RT wrote: >>> Thanks for the update. I have a few questions below. >>> >>> >>>> Please note the following items from the text of that page: >>>>>>> >>>> HELP NOTE >>>> With release v0.38, we rely on files being placed in >>>> tomcat/v55/common/lib, tomcat/v55/server/lib and >>>> tomcat/v55/common/classes. In addition, log4j.properties should >>>> be copied >>>> from tomcat/v55/gratia to tomcat/v55/common/classes (or merged >>>> if one >>>> already exists). Our recommendation has always been that Gratia >>>> services >>>> be the only thing installed in a given VDT area so contention >>>> for >>>> libraries between different services in the same tomcat >>>> container should >>>> not be an issue. >>>> >>> I don't fully understand what needs to be done. For the moment, I've >>> assigned this ticket to Tim Cartwright. >>> >>> Tim: can you evaluate this request to see what the issues are? Once we >>> understand them, and how to deal with them, we'll decide who should >>> actually take this ticket to do the implementation. I don't think it >>> has >>> to be you, but I think you're the best equipped to evaluate the changes >>> to the installation since you have the most knowledge about Tomcat. >>> >>> >>>> This upgrade is recommended for everyone running their own collector >>>>>>> including >>>> the RSV team with their MetricRecord collectors. We would be grateful >>>> if this >>>> could go into a forthcoming update to OSG 1.0. >>>> >>> What sort of time line are you requesting? What is the priority of this >>> update? We need to understand, so we can schedule this work properly. >>> I know that effort towards Gratia is changing shortly. If we have >>> questions about this update, who should we address them to? >>> >>> Thanks, >>> -alain >>> >>> ----------------------------------------------------------------- >>> Alain Roy vdt-support@opensciencegrid.org >>> VDT Support http://vdt.cs.wisc.edu/support.html >>> >>> -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Tue Sep 23 17:09:54 2008 | roy - Correspondence added | [Reply] | |||||||||
On Sep 23, 2008, at 4:04 PM, greenc@fnal.gov via RT wrote: >> Philippe, Alain, > We already have grid-accounting, which is the development list. No >> >> With the formal handover of Gratia operations to FermiGrid, I have >> asked Dan Yocum to make some changes in the communication channels: >> >> gratia-operation(s) - will become a operations only list. >> >> I believe that if it does not already exist, a new list: >> >> gratia-development - will be created for gratia development. >> >> So the appropriate point of contact may change depending on the focus >> of the issue - opeations or development. > need > for a new list. Great, thanks. -alain |
||||||||||||
| # | Wed Oct 08 12:40:03 2008 | roy - Correspondence added | [Reply] | |
|
I apologize for our slow response. We've been busy getting VDT 1.10.1k out the door. > HELP NOTE > With release v0.38, we rely on files being placed in > tomcat/v55/common/lib, tomcat/v55/server/lib and > tomcat/v55/common/classes. In addition, log4j.properties should > be copied > from tomcat/v55/gratia to tomcat/v55/common/classes (or merged > if one > already exists). Our recommendation has always been that Gratia > services > be the only thing installed in a given VDT area so contention > for > libraries between different services in the same tomcat > container should > not be an issue. We understand your recommendation. However, we also test Gratia in our nightly tests, and being capable of installing it side-by-side with other web applications is enormously useful, even if it's not the recommended end-user configuration. I looked through the the InstallationGuideVDT web page, and I didn't see a discussion of what libraries are installed into common/lib, nor was it obvious by looking at your tar files. Can you help us understand what is installed there, and the reasoning behind it? We ask not to be contentious, but to understand. We need to understand how this affects what we are doing. We do want to do basic Gratia tests, so... do we need to install Gratia separately from everything else? Run a separate Tomcat instance? Or maybe the conflict isn't severe so we can get away with installing it side-by-side? Are the files likely to conflict with other web-apps so that we should actually have an installation fail when someone tries to install them side-by-side? Thanks for helping us understand! We appreciate your hard work on Gratia. -alain ----------------------------------------------------------------- Alain Roy vdt-support@opensciencegrid.org VDT Support http://vdt.cs.wisc.edu/support.html |
||||
| # | Wed Oct 08 13:39:22 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Alain Roy via RT wrote:
I apologize for our slow response. We've been busy getting VDT 1.10.1k out the door. HELP NOTE
With release v0.38, we rely on files being placed in
tomcat/v55/common/lib, tomcat/v55/server/lib and
tomcat/v55/common/classes. In addition, log4j.properties should
be copied
from tomcat/v55/gratia to tomcat/v55/common/classes (or merged
if one
already exists). Our recommendation has always been that Gratia
services
be the only thing installed in a given VDT area so contention
for
libraries between different services in the same tomcat
container should
not be an issue.
We understand your recommendation. However, we also test Gratia in our nightly tests, and being capable of installing it side-by-side with other web applications is enormously useful, even if it's not the recommended end-user configuration. I looked through the the InstallationGuideVDT web page, and I didn't see a discussion of what libraries are installed into common/lib, nor was it obvious by looking at your tar files. Can you help us understand what is installed there, and the reasoning behind it? We ask not to be contentious, but to understand. We need to understand how this affects what we are doing. We do want to do basic Gratia tests, so... do we need to install Gratia separately from everything else? Run a separate Tomcat instance? Or maybe the conflict isn't severe so we can get away with installing it side-by-side? Are the files likely to conflict with other web-apps so that we should actually have an installation fail when someone tries to install them side-by-side? Thanks for helping us understand! We appreciate your hard work on Gratia.Hi Alain, Here are the contents of the three relevant tar files that get rolled into (I think) gratia-services.tar: [greenc@gratia01] ~/gratia-test/target $ tar tvf common_lib.tar drwxr-xr-x greenc/osg 0 2008-10-08 11:10:53 ./ -rw-r--r-- greenc/osg 391834 2008-10-08 11:10:53 ./log4j-1.2.15.jar -rw-r--r-- greenc/osg 60841 2008-10-08 11:10:53 ./commons-logging-1.1.1.jar [greenc@gratia01] ~/gratia-test/target $ tar tvf common_classes.tar drwxr-xr-x greenc/osg 0 2008-10-08 11:10:53 ./ drwxr-xr-x greenc/osg 0 2008-10-08 11:10:53 ./net/ drwxr-xr-x greenc/osg 0 2008-10-08 11:10:53 ./net/sf/ drwxr-xr-x greenc/osg 0 2008-10-08 11:10:53 ./net/sf/gratia/ drwxr-xr-x greenc/osg 0 2008-10-08 11:10:53 ./net/sf/gratia/util/ -rw-r--r-- greenc/osg 1486 2008-10-08 11:10:53 ./net/sf/gratia/util/TidiedDailyRollingFileAppender$DatedFileFilter.class -rw-r--r-- greenc/osg 1773 2008-10-08 11:10:53 ./net/sf/gratia/util/TidiedDailyRollingFileAppender.class [greenc@gratia01] ~/gratia-test/target $ tar tvf server_lib.tar drwxr-xr-x greenc/osg 0 2008-10-08 11:10:53 ./ -rw-r--r-- greenc/osg 40845 2008-10-08 11:10:53 ./glite-security-trustmanager.jar -rw-r--r-- greenc/osg 60462 2008-10-08 11:10:53 ./glite-security-util-java.jar -rw-r--r-- greenc/osg 1061998 2008-10-08 11:10:53 ./bcprov-jdk14-133.jarThe server_lib.tar is probably not necessary for you since you run under apache, so we can forget that. The common_classes.tar shouldn't interfere with anything else because it's a new class in the net.sf.gratia hierarchy and as such shouldn't step on anyone's toes. The common_lib.tar is necessary for us because it:
I hope this explains our rationale. I'd like us to be able to find a way of moving forward without me having to rip out a whole lot of work. Any way we can do that would be welcomed. Thanks, Chris. -alain ----------------------------------------------------------------- Alain Roy vdt-support@opensciencegrid.org VDT Support http://vdt.cs.wisc.edu/support.html -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Wed Oct 08 13:49:56 2008 | roy - Correspondence added | [Reply] | |||||||||
Thanks Chris! > The server_lib.tar is probably not necessary for you since you run > under > apache, so we can forget that. Is it deployed automatically by the web apps, or will it just be ignored if we don't deploy it? How particular are you about the version that is deployed? How certain are you that we don't need it? > The common_classes.tar shouldn't interfere with anything else > because it's a > new class in the net.sf.gratia hierarchy and as such shouldn't step > on anyone's > toes. Same question: should we deploy this, or is it deployed by the web apps? This does seem safe for us. > The common_lib.tar is necessary for us because it: > > * Enables tomcat container (as distinct from service) logging to be > controlled by log4j.properties. > > * Enables a common initialization of log4j instead of having to > have separate > initialization for all services. Same question again: who deploys this? Tim Cartwright is out today, but he can look at this when he returns. I don't know that the implications are for other web apps. He may also be able to suggest an alternative to you, since he has a lot of experience with Tomcat. Thanks! -alain ----------------------------------------------------------------- Alain Roy vdt-support@opensciencegrid.org VDT Support http://vdt.cs.wisc.edu/support.html |
||||||||||||
| # | Wed Oct 08 14:29:22 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Alain Roy via RT wrote: > Thanks Chris! Hi Alain,> > >> The server_lib.tar is probably not necessary for you since you run >>> under >> apache, so we can forget that. >> > Is it deployed automatically by the web apps, or will it just be > ignored if we don't deploy it? How particular are you about the > version that is deployed? > Thanks for the quick reply. The deployment of these tar files must be done by your packaging procedure into the appropriate areas. Note that you'll also want to run the appropriate cleanup script during the pacman install to remove any obsolete libraries of different versions from these areas. In other words, these tar files will be ignored if they're not packaged by you. > How certain are you that we don't need it? 95%> >> The common_classes.tar shouldn't interfere with anything else >>> because it's a >> new class in the net.sf.gratia hierarchy and as such shouldn't step >> on anyone's >> toes. >> > Same question: should we deploy this, or is it deployed by the web apps? > > This does seem safe for us. > >> The common_lib.tar is necessary for us because it: >>> >> * Enables tomcat container (as distinct from service) logging to be >> controlled by log4j.properties. >> >> * Enables a common initialization of log4j instead of having to >> have separate >> initialization for all services. >> > Same question again: who deploys this? > > Tim Cartwright is out today, but he can look at this when he returns. Thanks. Two consequences I can think of.> I don't know that the implications are for other web apps. He may also > be able to suggest an alternative to you, since he has a lot of > experience with Tomcat. > 1. Any existing log4j jars in services *may* need to be removed (also may not). 2. Any jars which automatically detect log4j jar presence and start using it will need to be configured (or at least defaulted) in the log4j.properties file. You may also need to merge any existing log4j.properties fragments into a single file, which I concede could be tricky. Thanks, Chris. > Thanks! > > -alain > > ----------------------------------------------------------------- > Alain Roy vdt-support@opensciencegrid.org > VDT Support http://vdt.cs.wisc.edu/support.html > > > -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Wed Oct 08 14:34:55 2008 | roy - Correspondence added | [Reply] | |||||||||
Thanks! One more question: how particular are you about the version of log4j? -alain |
||||||||||||
| # | Wed Oct 08 15:04:22 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Alain Roy via RT wrote: > Thanks! I don't think I care as long as it's fairly recent. I believe there were > > One more question: how particular are you about the version of log4j? > problems with a particular version of (I think) commons-logging, so we'd want the latest version as of around now, I think. Thanks, Chris. > -alain > > > -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Mon Oct 13 13:38:58 2008 | cat - Correspondence added | [Reply] | |||||||||
Chris: I have been looking over the emails concerning the Gratia 0.38.3 update and its need for new libraries in Tomcat-global locations. I have a few comments and questions below. > The server_lib.tar is probably not necessary for you since you run > under apache, so we can forget that. This statement surprised me, because many other VDT webapps include the gLite libraries in their own library directories. Furthermore, we explicitly install the BC provider in a Tomcat-global location because most webapps need it and the gLite trustmanager uses it in a way that demands global instantiation. So what is it about the Gratia set up that is different? It is true that we run Tomcat behind Apache, but Apache does pass through the certificate chain, which webapps are able to unroll, examine, and verify. Is that not the role of the gLite and BC components? Even if these libraries are required in a global location, I have argued before in other forums that server/lib is the wrong place to do so. Currently, the VDT installs the BC provider library in common/ lib, where it is accessible both to Tomcat-internal classes AND application classes. > The common_classes.tar shouldn't interfere with anything else > because it's a new class in the net.sf.gratia hierarchy and as such > shouldn't step on anyone's toes. Agreed, to a point. What happens, though, if one of those classes throws an uncaught exception or causes some sort of serious failure? That is, is there the potential to cause greater Tomcat-wide damage or failure when Gratia has code running in a global context? > The common_lib.tar is necessary for us because it: > • Enables tomcat container (as distinct from service) logging to be > controlled by log4j.properties. > • Enables a common initialization of log4j instead of having to have > separate initialization for all services. > I tried putting a separate log4j jar in each of our services and I > remember running into all sorts of trouble. It's possible that we > could make it work but I was running into a dead end. If anyone has > a proven way of getting this going with minimum effort we'd be > grateful. It was hard enough interfacing the old gratia logging into > log4j without having to rip out every message and start again. This gets very confusing. I *think* the net result of putting log4j into common/lib is that Tomcat and webapps that do not provide their own log4j implementation will use the global one, but webapps that DO provide one will use their own. I think. > I hope this explains our rationale. I'd like us to be able to find a > way of moving forward without me having to rip out a whole lot of > work. Any way we can do that would be welcomed. I agree -- we need to find a way to deploy this application without a major rewrite. However, I think the issues are complex enough that I suggest discussing them by phone. Would that be OK? Is there a good time coming up soon to do so? -- Tim |
||||||||||||
| # | Wed Oct 15 10:35:38 2008 | cat - Membership in ticket #4191 added | ||
| # | Fri Oct 17 17:15:37 2008 | cat - Correspondence added | [Reply] | |
|
I talked to Chris Green on the phone today about the questions I had about the Gratia update. This note summarizes the decisions made during that call and separately with Alain. * In a nutshell, we are going to proceed with separating Gratia from other webapps in the same Tomcat installation. We will issue a warning if (a) we are installing Gratia webapps and notice other webapps already in the same Tomcat, or (b) we are installing another webapp and notice Gratia webapps already in the same Tomcat. * Thus, we will need to remove Gratia service from the VDT package and make them into their own test. * We really do NOT need to install the server_lib.tar components, because copies already exist as needed in each individual webapp. It is OK to continue removing bcprov*.jar from each Gratia webapp and letting our Tomcat configure script add the BC provider to its own configuration. * The files in common_classes.tar really do belong in common/classes -- they include special log4j implementation classes that the Gratia developers want available to both Tomcat and their own webapps. Likewise, the common_lib.tar files belong in common/lib. * Put their log4j properties file wherever they say it should go. * For Gratia installations (and only Gratia for now), we must change the "extra" JVM settings to be "-Xmx1024m -XX:MaxPermSize=256m". I think that we do this in configure_tomcat. * Make sure that we are NOT setting up any Gratia log files for rotation; they will do it themselves. I think that that is all Chris and I talked about, but he can add to the ticket if I've missed anything. -- Tim |
||||
| # | Mon Oct 20 13:22:04 2008 | roy - Stolen from cat | ||
| # | Mon Oct 20 13:22:20 2008 | roy - Given to kronenfe | ||
| # | Mon Oct 20 13:55:04 2008 | kronenfe - Correspondence added | [Reply] | |
|
On Tue Sep 23 15:38:22 2008, pcanal@fnal.gov wrote: > The next release of Gratia is v1.0 around October 15; this release will > contain only minor > updates and bug fixes and should be the last for a while, so it would be > best if the > incorporation of v0.38 could be done before then (so that we have to > time to correct any > issue in time for October 15). Has 1.0 been released yet? We plan to release this latest version of Gratia Services/Reporting with the new version of the probes. Is this ok? Thanks, scot |
||||
| # | Mon Oct 20 15:40:56 2008 | pcanal@fnal.gov - Correspondence added | [Reply] | |||||||||||
Hi Scot, 1.0 should be tagged sometime today. Cheers, Philippe. Scot Kronenfeld via RT wrote: > On Tue Sep 23 15:38:22 2008, pcanal@fnal.gov wrote: > >> The next release of Gratia is v1.0 around October 15; this release will >>> contain only minor >> updates and bug fixes and should be the last for a while, so it would be >> best if the >> incorporation of v0.38 could be done before then (so that we have to >> time to correct any >> issue in time for October 15). >> > Has 1.0 been released yet? > > We plan to release this latest version of Gratia Services/Reporting with > the new version of the probes. Is this ok? > > Thanks, > scot > > |
||||||||||||||
| # | Mon Oct 20 16:40:25 2008 | roy - Correspondence added | [Reply] | |||||||||
Great! Is it okay if we release the probes at the same time as the new services? We're putting these in the same branch of our source code repository, and hope that the simultaneous release is okay. -alain On Oct 20, 2008, at 3:41 PM, pcanal@fnal.gov via RT wrote: > http://crt.cs.wisc.edu/Ticket/Display.html?id=4033 > > Hi Scot, > > 1.0 should be tagged sometime today. > > Cheers, > Philippe. > > Scot Kronenfeld via RT wrote: >> On Tue Sep 23 15:38:22 2008, pcanal@fnal.gov wrote: >> >>> The next release of Gratia is v1.0 around October 15; this release >>>>> will >>> contain only minor >>> updates and bug fixes and should be the last for a while, so it >>> would be >>> best if the >>> incorporation of v0.38 could be done before then (so that we have to >>> time to correct any >>> issue in time for October 15). >>> >> Has 1.0 been released yet? >> >> We plan to release this latest version of Gratia Services/Reporting >> with >> the new version of the probes. Is this ok? >> >> Thanks, >> scot >> >> |
||||||||||||
| # | Mon Oct 20 17:08:00 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Alain Roy via RT wrote:
Great! Is it okay if we release the probes at the same time as the new services? We're putting these in the same branch of our source code repository, and hope that the simultaneous release is okay.The probes have also been updated, including an update that is extremely important for high traffic sites. I can upload this tomorrow. Thanks, Chris.l -alain On Oct 20, 2008, at 3:41 PM, pcanal@fnal.gov via RT wrote: http://crt.cs.wisc.edu/Ticket/Display.html?id=4033 Hi Scot, 1.0 should be tagged sometime today. Cheers, Philippe. Scot Kronenfeld via RT wrote: On Tue Sep 23 15:38:22 2008, pcanal@fnal.gov wrote: The next release of Gratia is v1.0 around October 15; this release
will
contain only minor
updates and bug fixes and should be the last for a while, so it
would be
best if the
incorporation of v0.38 could be done before then (so that we have to
time to correct any
issue in time for October 15).
Has 1.0 been released yet?
We plan to release this latest version of Gratia Services/Reporting
with
the new version of the probes. Is this ok?
Thanks,
scot
-- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Tue Oct 21 09:57:25 2008 | pcanal@fnal.gov - Ticket 4243: Ticket created | [Reply] | |||||||||
Hi, The Gratia v1.00 release of the probe, services and reporting is now available for distribution. Release notes may be found at: https://twiki.grid.iu.edu/bin/view/Accounting/GratiaReleaseV1dot00 The Gratia services and reporting are available for packaging for the VDT via https://twiki.grid.iu.edu/bin/view/Accounting/InstallationGuideVDT. for the probes see https://twiki.grid.iu.edu/twiki/bin/view/Accounting/ProbeInstallation. This upgrade is recommended for everyone running their own collector including the RSV team with their MetricRecord collectors. Please let us know if you have any questions about or problems with this rrelease. Thanks, Philippe Canal |
||||||||||||
| # | Tue Oct 21 14:10:42 2008 | roy - Ticket 4243: Merged into ticket #4033 | ||
| # | Tue Oct 21 14:10:44 2008 | roy - Merged into ticket #4033 | ||
| # | Tue Oct 21 14:28:21 2008 | kronenfe - Correspondence added | [Reply] | |
|
The link to download the Gratia probe source does not work. Apparently the file is named slightly differently. http://gratia.fnal.gov/Files/probe/SRPMS/gratia-probe-1.00.src.rpm That page has a good error message though, so as long as the file it is pointing at is correct, I've got the SRPM. -scot |
||||
| # | Tue Oct 21 14:32:50 2008 | pcanal@fnal.gov - Correspondence added | [Reply] | |||||||||||
Hi, The new version of the probe (v1.00) is available in the usual place. Cheers, Philippe greenc@fnal.gov via RT wrote: > Alain Roy via RT wrote: > > Great! > > Is it okay if we release the probes at the same time as the new > services? We're putting these in the same branch of our source code > repository, and hope that the simultaneous release is okay. > > > The probes have also been updated, including an update that is extremely > important for high traffic sites. I can upload this tomorrow. > > Thanks, > Chris.l > > -alain > > On Oct 20, 2008, at 3:41 PM, pcanal@fnal.gov via RT wrote: > > > > http://crt.cs.wisc.edu/Ticket/Display.html?id=4033 > Hi Scot, > > 1.0 should be tagged sometime today. > > Cheers, > Philippe. > > Scot Kronenfeld via RT wrote: > > > On Tue Sep 23 15:38:22 2008, pcanal@fnal.gov wrote: > > > > The next release of Gratia is v1.0 around October 15; this release > will > contain only minor > updates and bug fixes and should be the last for a while, so it > would be > best if the > incorporation of v0.38 could be done before then (so that we have to > time to correct any > issue in time for October 15). > > > > Has 1.0 been released yet? > > We plan to release this latest version of Gratia Services/Reporting > with > the new version of the probes. Is this ok? > > Thanks, > scot > > > > > > > > > > |
||||||||||||||
| # | Tue Oct 21 14:40:20 2008 | pcanal@fnal.gov - Correspondence added | [Reply] | |||||||||||
Hi Scot, Thanks for reporting this problem. The links on the twiki page have been corrected. Cheers, Philippe. Scot Kronenfeld via RT wrote: > The link to download the Gratia probe source does not work. Apparently > the file is named slightly differently. > > http://gratia.fnal.gov/Files/probe/SRPMS/gratia-probe-1.00.src.rpm > > That page has a good error message though, so as long as the file it is > pointing at is correct, I've got the SRPM. > > -scot > > |
||||||||||||||
| # | Thu Oct 23 17:19:04 2008 | kronenfe - Correspondence added | [Reply] | |
|
Gratia-Services and Gratia-Reporting have been upgraded to 1.00 They are available at pacman -get http://vdt.cs.wisc.edu/test-cache/gratia:Gratia-Reporting As noted in the other open Gratia ticket, the probes are also updated in this test cache: pacman -get http://vdt.cs.wisc.edu/test-cache/gratia:Gratia-Condor-Probe etc. I have covered all the Gratia setup points in Tim's summary, but let me know if you see any issues. Thanks, scot |
||||
| # | Thu Oct 23 19:33:30 2008 | roy - Correspondence added | [Reply] | |||||||||
Just to be explicit: can you (the Gratia folks) verify that we've done the new setup for Gratia correctly, before we release it? Thanks, -alain On Oct 23, 2008, at 5:19 PM, Scot Kronenfeld via RT wrote: > http://crt.cs.wisc.edu/Ticket/Display.html?id=4033 > > Gratia-Services and Gratia-Reporting have been upgraded to 1.00 > > They are available at > pacman -get http://vdt.cs.wisc.edu/test-cache/gratia:Gratia-Reporting > > As noted in the other open Gratia ticket, the probes are also > updated in > this test cache: > pacman -get http://vdt.cs.wisc.edu/test-cache/gratia:Gratia-Condor-Probe > etc. > > > I have covered all the Gratia setup points in Tim's summary, but let > me > know if you see any issues. > > Thanks, > scot |
||||||||||||
| # | Fri Oct 24 08:09:57 2008 | weigand@fnal.gov - Correspondence added | [Reply] | |||||||||||
Not a problem... will give it a go now. John Weigand Alain Roy via RT wrote: > Just to be explicit: can you (the Gratia folks) verify that we've done > the new setup for Gratia correctly, before we release it? > > Thanks, > -alain > > On Oct 23, 2008, at 5:19 PM, Scot Kronenfeld via RT wrote: > >> http://crt.cs.wisc.edu/Ticket/Display.html?id=4033 >>> >> Gratia-Services and Gratia-Reporting have been upgraded to 1.00 >> >> They are available at >> pacman -get http://vdt.cs.wisc.edu/test-cache/gratia:Gratia-Reporting >> >> As noted in the other open Gratia ticket, the probes are also >> updated in >> this test cache: >> pacman -get http://vdt.cs.wisc.edu/test-cache/gratia:Gratia-Condor-Probe >> etc. >> >> >> I have covered all the Gratia setup points in Tim's summary, but let >> me >> know if you see any issues. >> >> Thanks, >> scot >> > > |
||||||||||||||
| # | Fri Oct 24 09:20:05 2008 | kronenfe - Reference by ticket #4062 added | ||
| # | Tue Oct 28 13:51:03 2008 | kronenfe - Subject changed from 'Gratia v0.38.3 available for inclusion in next VDT release' to 'Gratia v1.00 available for inclusion in next VDT release' | ||
| # | Tue Oct 28 14:00:28 2008 | kronenfe - Correspondence added | [Reply] | |
|
Sorry if this email is a repeat, I thought I emailed this last Friday, but I cannot find my email if I did... I finished the work upgrading Gratia-Services and Gratia-Reporting in a VDT test cache. Please try it out and let us know if everything is working for you. As I noted in an email last week, the probes have already been updated in the same test cache. pacman -get http://vdt.cs.wisc.edu/test-cache/gratia:Gratia-Reporting Thanks, scot |
||||
| # | Tue Oct 28 14:53:43 2008 | weigand@fnal.gov - Correspondence added | [Reply] | |||||||||||
Sorry for not getting back.... we have been testing and have discovered we will need to send you a new tarball which we are working on and testing. Also there will be some changes to the configure_gratia and for the initd tomcat service. John Weigand Scot Kronenfeld via RT wrote: > Sorry if this email is a repeat, I thought I emailed this last Friday, > but I cannot find my email if I did... > > I finished the work upgrading Gratia-Services and Gratia-Reporting in a > VDT test cache. Please try it out and let us know if everything is > working for you. As I noted in an email last week, the probes have > already been updated in the same test cache. > > pacman -get http://vdt.cs.wisc.edu/test-cache/gratia:Gratia-Reporting > > Thanks, > scot > > |
||||||||||||||
| # | Tue Oct 28 15:10:45 2008 | kronenfe - Correspondence added | [Reply] | |||||||||
> Also there will be some changes to the configure_gratia and for the > initd tomcat service. I made changes to configure_gratia and the tomcat init script already to account for what was in this ticket. Are you saying there will be further changes? Just let me know... |
||||||||||||
| # | Thu Oct 30 08:47:54 2008 | weigand@fnal.gov - Correspondence added | [Reply] | |||||||||||
Scot, Attached are the changes needed to the tomcat initd service and the configure_gratia. I have the old and new in there ... just diff the files. Also the patched v1.00.1 is accessible here: https://twiki.grid.iu.edu/bin/view/Accounting/InstallationGuideVDT John Weigand Scot Kronenfeld via RT wrote: >> Also there will be some changes to the configure_gratia and for the >>> initd tomcat service. >> > I made changes to configure_gratia and the tomcat init script already > to account for what was in this ticket. Are you saying there will be > further changes? Just let me know... > > > |
||||||||||||||
| # | Thu Oct 30 09:47:54 2008 | kronenfe - Correspondence added | [Reply] | |||||||||
Nothing attached...? Upgrading the version of Services and Reporting now. On Thu, Oct 30, 2008 at 8:48 AM, weigand@fnal.gov via RT <vdt-support@opensciencegrid.org> wrote: > Scot, > > Attached are the changes needed to the tomcat initd service and the > configure_gratia. I have the old and new in there ... just diff the files. |
||||||||||||
| # | Thu Oct 30 11:58:00 2008 | weigand@fnal.gov - Correspondence added | [Reply] | |||||||||||
Consider that a test to see if I am as dumb as I think I am... I am :-( I "think" it is there now. John Scot Kronenfeld via RT wrote: > Nothing attached...? > > Upgrading the version of Services and Reporting now. > > On Thu, Oct 30, 2008 at 8:48 AM, weigand@fnal.gov via RT > <vdt-support@opensciencegrid.org> wrote: > >> Scot, >>> >> Attached are the changes needed to the tomcat initd service and the >> configure_gratia. I have the old and new in there ... just diff the files. >> > > |
||||||||||||||
| # | Thu Oct 30 13:59:24 2008 | kronenfe - Correspondence added | [Reply] | |||||||||
I need some clarification on these lines in the Tomcat init script. 98,99d95 < wget --no-check-certificate --certificate="/etc/grid-security/http/httpcert.pem" --private-key="/etc/grid-security/http/httpkey.pem" --dns-timeout=5 --connect-timeout=10 --read-timeout=20 -O - -q "https://gratiax23.fnal.gov:8443/gratia-administration/systemadministration.html?action=stopDatabaseUpdateThreads" >/dev/null 2>&1 < return ## JGWWhat's the wget doing? If it should be included in the VDT's Tomcat init script, I assume we need to update the URL (https://gratiax23.fnal.gov) based on the local Gratia configuration. Doesn't the return statement prevent Tomcat from stopping since it is above the code where Tomcat is actually stopped? -scot On Thu, Oct 30, 2008 at 11:58 AM, weigand@fnal.gov via RT <vdt-support@opensciencegrid.org> wrote: > Consider that a test to see if I am as dumb as I think I am... I am :-( > > I "think" it is there now. > > John > > Scot Kronenfeld via RT wrote: >> Nothing attached...? >>> >> Upgrading the version of Services and Reporting now. >> >> On Thu, Oct 30, 2008 at 8:48 AM, weigand@fnal.gov via RT >> <vdt-support@opensciencegrid.org> wrote: >> >>> Scot, >>>>> >>> Attached are the changes needed to the tomcat initd service and the >>> configure_gratia. I have the old and new in there ... just diff the files. >>> >> >> > > -- > View ticket at <http://crt.cs.wisc.edu/Ticket/Display.html?user=guest&pass=guest&id=4033> > VDT Support: vdt-support@opensciencegrid.org |
||||||||||||
| # | Thu Oct 30 14:06:54 2008 | pcanal@fnal.gov - Correspondence added | [Reply] | |||||||||||
Hi Scott, Yes you need to update the url. It needs to talk to the secure port of the tomcat running the gratia Collector. The point of the wget is to make that all (already started) transactions are entirely completed before tomcat is shutdown (otherwise there is a risk of data loss due to the way tomcat is somewhat abruptly shutting down the services). Cheers, Philippe. Scot Kronenfeld via RT wrote: > I need some clarification on these lines in the Tomcat init script. > > 98,99d95 > < wget --no-check-certificate > --certificate="/etc/grid-security/http/httpcert.pem" > --private-key="/etc/grid-security/http/httpkey.pem" --dns-timeout=5 > --connect-timeout=10 --read-timeout=20 -O - -q > "https://gratiax23.fnal.gov:8443/gratia-administration/systemadministration.html?action=stopDatabaseUpdateThreads" > >> /dev/null 2>&1 > < return ## JGW>> > > What's the wget doing? If it should be included in the VDT's Tomcat > init script, I assume we need to update the URL > (https://gratiax23.fnal.gov) based on the local Gratia configuration. > > Doesn't the return statement prevent Tomcat from stopping since it is > above the code where Tomcat is actually stopped? > > -scot > > On Thu, Oct 30, 2008 at 11:58 AM, weigand@fnal.gov via RT > <vdt-support@opensciencegrid.org> wrote: > >> Consider that a test to see if I am as dumb as I think I am... I am :-( >>> >> I "think" it is there now. >> >> John >> >> Scot Kronenfeld via RT wrote: >> >>> Nothing attached...? >> -->>> >>> Upgrading the version of Services and Reporting now. >>> >>> On Thu, Oct 30, 2008 at 8:48 AM, weigand@fnal.gov via RT >>> <vdt-support@opensciencegrid.org> wrote: >>> >>> >>>> Scot, >>>>>>> >>>> Attached are the changes needed to the tomcat initd service and the >>>> configure_gratia. I have the old and new in there ... just diff the files. >>>> >>>> >>> >> View ticket at <http://crt.cs.wisc.edu/Ticket/Display.html?user=guest&pass=guest&id=4033> >> VDT Support: vdt-support@opensciencegrid.org >> > > |
||||||||||||||
| # | Thu Oct 30 15:01:18 2008 | kronenfe - Correspondence added | [Reply] | |||||||||
On Thu, Oct 30, 2008 at 2:07 PM, pcanal@fnal.gov via RT <vdt-support@opensciencegrid.org> wrote: > The point of the wget is to make that all (already started) transactions > are entirely completed before tomcat is shutdown > (otherwise there is a risk of data loss due to the way tomcat is > somewhat abruptly shutting down the services). Is there a "hook" available in Tomcat to send a message to its webapps upon shutdown? It seems like that would be a more standard way of closing out the database transactions rather than adding Gratia specific code to the Tomcat init script. |
||||||||||||
| # | Thu Oct 30 19:24:57 2008 | pcanal@fnal.gov - Correspondence added | [Reply] | |||||||||||
Hi Scot, I do _not_ know whether such a hook exist or not. However we already had the web interface (that wget tickle) available so we chose to use wget due to lack resource (to find a 'better' alternative). Any suggestion of what do replace it is welcome (the wget tickle a web interface that call a clearly defined java interface so it would not be a problem to call it programatically Cheers, Philipe Scot Kronenfeld via RT wrote: > On Thu, Oct 30, 2008 at 2:07 PM, pcanal@fnal.gov via RT > <vdt-support@opensciencegrid.org> wrote: > >> The point of the wget is to make that all (already started) transactions >>> are entirely completed before tomcat is shutdown >> (otherwise there is a risk of data loss due to the way tomcat is >> somewhat abruptly shutting down the services). >> > Is there a "hook" available in Tomcat to send a message to its webapps > upon shutdown? It seems like that would be a more standard way of > closing out the database transactions rather than adding Gratia > specific code to the Tomcat init script. > > > |
||||||||||||||
| # | Fri Oct 31 14:34:48 2008 | roy - Correspondence added | [Reply] | |||||||||
On Oct 30, 2008, at 7:25 PM, pcanal@fnal.gov via RT wrote: > I do _not_ know whether such a hook exist or not. However we already > had the web interface > (that wget tickle) available so we chose to use wget due to lack > resource (to find a 'better' > alternative). Any suggestion of what do replace it is welcome (the > wget > tickle a web interface > that call a clearly defined java interface so it would not be a > problem > to call it programatically Hi, I'm sorry that we (the VDT team) are stuck on this point. :) Even if we expect Gratia to be installed by itself, our infrastructure still relies on a lot of shared code. We like to avoid apparent hacks when possible because it complicates shared code paths. Even if it's not too hard to write, it's more code to maintain and ensure that it continues to work in the future. So we want to keep things as simple as possible. I know next to nothing about writing Java Servlets, but my understanding is that they have a destroy() method that is called when the container shuts the servlets down. I'm sure things are more complicated for Gratia (you have at least two servlets, right?) but why isn't that sufficient? Thanks, -alain ----------------------------------------------------------------- Alain Roy vdt-support@opensciencegrid.org VDT Support http://vdt.cs.wisc.edu/support.html |
||||||||||||
| # | Fri Oct 31 15:24:15 2008 | kronenfe - Correspondence added | [Reply] | |||||||||
I added a second option to the Tomcat init script, which is the amount of time to sleep in between stop and start when restarting. I left the default at 2 seconds. So you'll want to put this in your scripts that restart Tomcat. tomcat-55 restart 20 |
||||||||||||
| # | Fri Oct 31 16:03:51 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Alain Roy via RT wrote: > On Oct 30, 2008, at 7:25 PM, pcanal@fnal.gov via RT wrote: We have only one servlet, but we do have multiple service entry points > >> I do _not_ know whether such a hook exist or not. However we already >>> had the web interface >> (that wget tickle) available so we chose to use wget due to lack >> resource (to find a 'better' >> alternative). Any suggestion of what do replace it is welcome (the >> wget >> tickle a web interface >> that call a clearly defined java interface so it would not be a >> problem >> to call it programatically >> > Hi, > > I'm sorry that we (the VDT team) are stuck on this point. :) > > Even if we expect Gratia to be installed by itself, our infrastructure > still relies on a lot of shared code. We like to avoid apparent hacks > when possible because it complicates shared code paths. Even if it's > not too hard to write, it's more code to maintain and ensure that it > continues to work in the future. So we want to keep things as simple > as possible. > > I know next to nothing about writing Java Servlets, but my > understanding is that they have a destroy() method that is called when > the container shuts the servlets down. I'm sure things are more > complicated for Gratia (you have at least two servlets, right?) but > why isn't that sufficient? > that aren't servlets. It would take some testing. Chris. > Thanks, > -alain > > ----------------------------------------------------------------- > Alain Roy vdt-support@opensciencegrid.org > VDT Support http://vdt.cs.wisc.edu/support.html > > > -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Fri Oct 31 17:51:17 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
greenc@fnal.gov via RT wrote:
Alain Roy via RT wrote: On Oct 30, 2008, at 7:25 PM, pcanal@fnal.gov via RT wrote: I do _not_ know whether such a hook exist or not. However we already
had the web interface
(that wget tickle) available so we chose to use wget due to lack
resource (to find a 'better'
alternative). Any suggestion of what do replace it is welcome (the
wget
tickle a web interface
that call a clearly defined java interface so it would not be a
problem
to call it programatically
Hi,
I'm sorry that we (the VDT team) are stuck on this point. :)
Even if we expect Gratia to be installed by itself, our infrastructure
still relies on a lot of shared code. We like to avoid apparent hacks
when possible because it complicates shared code paths. Even if it's
not too hard to write, it's more code to maintain and ensure that it
continues to work in the future. So we want to keep things as simple
as possible.
I know next to nothing about writing Java Servlets, but my
understanding is that they have a destroy() method that is called when
the container shuts the servlets down. I'm sure things are more
complicated for Gratia (you have at least two servlets, right?) but
why isn't that sufficient?
We have only one servlet, but we do have multiple service entry points that aren't servlets. It would take some testing. v1.00.2 has the relevant code in the relevant call-out and has been uploaded to the usual place -- wget is no longer neccesary. Chris. PS Happy Hallowe'en! Chris. Thanks, -alain ----------------------------------------------------------------- Alain Roy vdt-support@opensciencegrid.org VDT Support http://vdt.cs.wisc.edu/support.html -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Fri Oct 31 20:56:15 2008 | roy - Correspondence added | [Reply] | |||||||||
On Oct 31, 2008, at 5:51 PM, greenc@fnal.gov via RT wrote: > v1.00.2 has the relevant code in the relevant call-out and has been > uploaded to > the usual place -- wget is no longer neccesary. Wow, that was fast! Thank you! -alain ----------------------------------------------------------------- Alain Roy vdt-support@opensciencegrid.org VDT Support http://vdt.cs.wisc.edu/support.html |
||||||||||||
| # | Mon Nov 03 11:19:25 2008 | weigand@fnal.gov - Correspondence added | [Reply] | |||||||||||
Scot, with the changes Chris recently did to replace the wget in the initd service script, the changes I sent you for configure_gratia are no longer needed. Let me know when you want me to test. John Weigand |
||||||||||||||
| # | Mon Nov 03 11:38:24 2008 | kronenfe - Correspondence added | [Reply] | |||||||||
I have: - updated Gratia-Services and Gratia-Reporting to 1.00.2 - I have added the new JAVA_OPTS requirements to configure_gratia - I have parametrized the sleep amount to the Tomcat init script on restarts (and condrestarts) On Mon, Nov 3, 2008 at 11:19 AM, weigand@fnal.gov via RT <vdt-support@opensciencegrid.org> wrote: > Scot, > > with the changes Chris recently did to replace the wget in the initd > service script, the changes I sent you for configure_gratia are no > longer needed. > > Let me know when you want me to test. > > John Weigand > > > -- > View ticket at <http://crt.cs.wisc.edu/Ticket/Display.html?user=guest&pass=guest&id=4033> > VDT Support: vdt-support@opensciencegrid.org > |
||||||||||||
| # | Tue Nov 04 16:44:25 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Scot Kronenfeld via RT wrote:
I have: - updated Gratia-Services and Gratia-Reporting to 1.00.2 - I have added the new JAVA_OPTS requirements to configure_gratia - I have parametrized the sleep amount to the Tomcat init script on restarts (and condrestarts)Looking into exceptions in the Gratia-Reporting package. We'll keep you posted. Thanks, Chris. On Mon, Nov 3, 2008 at 11:19 AM, weigand@fnal.gov via RT <vdt-support@opensciencegrid.org> wrote: Scot, with the changes Chris recently did to replace the wget in the initd service script, the changes I sent you for configure_gratia are no longer needed. Let me know when you want me to test. John Weigand -- View ticket at <http://crt.cs.wisc.edu/Ticket/Display.html?user=guest&pass=guest&id=4033> VDT Support: vdt-support@opensciencegrid.org -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Wed Nov 12 15:18:35 2008 | kronenfe - Correspondence added | [Reply] | |
|
On Tue Nov 04 16:44:25 2008, greenc@fnal.gov wrote: > Looking into exceptions in the Gratia-Reporting package. We'll keep > you posted. Hi Chris, Any word on the latest set of probes, or the Gratia-Reporting update? Thanks, scot |
||||
| # | Wed Nov 12 15:42:24 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Scot Kronenfeld via RT wrote:
On Tue Nov 04 16:44:25 2008, greenc@fnal.gov wrote: Looking into exceptions in the Gratia-Reporting package. We'll keep
you posted.
Hi Chris, Any word on the latest set of probes, or the Gratia-Reporting update?John will be able to get a probe install from the test cache in the morning. It would be easier if he could do it from the -99 cache, though. Once that's verified I'd like that to be in the main cache and a lettered update ASAP. As for the Gratia-Reporting, there's nothing we can do on this timescale to solve the off-by-one-day problem. I don't know what to tell you. Maybe Philippe can provide direction. Thanks, Chris. Thanks, scot -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Wed Nov 12 15:56:09 2008 | pcanal@fnal.gov - Correspondence added | [Reply] | |||||||||||
Hi Scot, The enabling of 'jmx' for intra-host communication is a pre-requisite for Gratia (at the very least for the time being ... unless somebody shows/tell us that this is unacceptable security risk :) and we somehow get the manpower to write a new solution). jmx is used not only to work around the reporting issue but also for some of internal control and communication between the components (collector, administrations). [I.e. without jmx, The Gratia server is crippled (in ways we can enumerate .. but still)] Cheers, Philippe. Chris Green wrote: > Scot Kronenfeld via RT wrote: >> On Tue Nov 04 16:44:25 2008, greenc@fnal.gov wrote: > John will be able to get a probe install from the test cache in the >> >> >>> Looking into exceptions in the Gratia-Reporting package. We'll keep >>>>> you posted. >>> >> Hi Chris, >> Any word on the latest set of probes, or the Gratia-Reporting update? >> > morning. It would be easier if he could do it from the -99 cache, > though. Once that's verified I'd like that to be in the main cache and > a lettered update ASAP. > > As for the Gratia-Reporting, there's nothing we can do on this > timescale to solve the off-by-one-day problem. I don't know what to > tell you. Maybe Philippe can provide direction. > > Thanks, > Chris. >> Thanks, >>> scot >> >> > > -- > Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. > IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; > chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); > chris.h.green (Google Talk). |
||||||||||||||
| # | Wed Nov 12 16:01:09 2008 | kronenfe - Correspondence added | [Reply] | |||||||||
Thanks for the updates. Putting the probes into 1.10.99 is trickier for us, but I can do this for John tomorrow if it is necessary. I'd like to chat with him tomorrow morning (via YIM is fine) before he installs so that I can understand if it's possible to work out of the test cache instead. Doing a release early next week should be possible if we get the ok tomorrow or Friday. Regarding Gratia-Reporting and 'jmx' I don't know anything about jmx, I was just asking about Gratia-Reporting because Chris said he was looking into exceptions from that package. When you guys are satisfied with the release, we will release it. If jmx is something you need us (the VDT team) to look into further, please provide a little more information. Thanks, scot |
||||||||||||
| # | Wed Nov 12 16:30:26 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Scot Kronenfeld via RT wrote: > Thanks for the updates. All of the "exception" problems had been resolved as artifacts; however > > Putting the probes into 1.10.99 is trickier for us, but I can do this > for John tomorrow if it is necessary. I'd like to chat with him > tomorrow morning (via YIM is fine) before he installs so that I can > understand if it's possible to work out of the test cache instead. > > Doing a release early next week should be possible if we get the ok > tomorrow or Friday. > > > > Regarding Gratia-Reporting and 'jmx' > I don't know anything about jmx, I was just asking about > Gratia-Reporting because Chris said he was looking into exceptions > from that package. When you guys are satisfied with the release, we > will release it. If jmx is something you need us (the VDT team) to > look into further, please provide a little more information. > reports were sometimes off-by-one day due to a pecularity of service startup order. Investigation proved that this was due to the lack of JMX capability in the VDT-installed tomcat upon which we had been relying in our local installs. A chat with Tim over IM indicated that VDT was unwilling to enable this feature without a major investigation into just what had to be done to the VDT tomcat as configured currently; and what security implications there were. We've been trying to get this release out of the door for over a month now and my effort available to spend on development and maintenance for this project has dropped to 25%. John's has dropped to practically zero and we have lost both our BIRT report experts. I think we need to discuss with Alain as leader of the software tools group just what we can do to resolve this ASAP. Thanks, Chris. > Thanks, > scot > > > -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Wed Nov 12 16:46:22 2008 | kronenfe - Correspondence added | [Reply] | |||||||||||
Ok, sorry, I didn't realize there was previous discussion with Tim about JMX. Alain is currently traveling to the site administrator's meeting at Stanford, so I expect he will have limited availability and access to a phone for the next two days. He is generally good about checking email while at conferences, so it might be easiest to lay out any concerns in this ticket for him and Tim to see. -scot |
||||||||||||||
| # | Wed Nov 12 23:16:09 2008 | roy - Correspondence added | [Reply] | |||||||||
On Nov 12, 2008, at 2:30 PM, greenc@fnal.gov via RT wrote: > All of the "exception" problems had been resolved as artifacts; > however > reports were sometimes off-by-one day due to a pecularity of service > startup order. Investigation proved that this was due to the lack of > JMX > capability in the VDT-installed tomcat upon which we had been > relying in > our local installs. A chat with Tim over IM indicated that VDT was > unwilling to enable this feature without a major investigation into > just > what had to be done to the VDT tomcat as configured currently; and > what > security implications there were. We've been trying to get this > release > out of the door for over a month now and my effort available to > spend on > development and maintenance for this project has dropped to 25%. > John's > has dropped to practically zero and we have lost both our BIRT report > experts. I think we need to discuss with Alain as leader of the > software > tools group just what we can do to resolve this ASAP. I've been traveling today (I'm off to the OSG Site Administrator meeting), so I wasn't aware of Tim's conversation over IM with you. I've only been partially following this software release. I don't have a good understanding of what the problems are, how serious they are, or what the impact of JMX is. (I've never heard of it before and don't yet have knowledge of it.) I would appreciate talking to you guys about this. On Thursday, I'll be very actively involved in the meeting in the morning (I'll be giving a long talk), but I can probably duck out for a phone call after lunch, or maybe in the late morning. I'll be on Pacific Time. Let's talk. If possible, let's have Scot involved (since he's been doing the work) and Tim (since he understands Tomcat). Given that I don't understand much yet, some of my questions will be: * What are our existing problems. * Is the Gratia services/reporting update in its current form better than what we have in the VDT already? More to the point, is it worthwhile releasing now, then release an improvement later? * Does it need more work before we release it? From the VDT or from you guys? * What is JMX and what is it's impact on the VDT and the Gratia installation? Thanks, -alain ----------------------------------------------------------------- Alain Roy vdt-support@opensciencegrid.org VDT Support http://vdt.cs.wisc.edu/support.html |
||||||||||||
| # | Thu Nov 13 11:18:33 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Alain Roy via RT wrote: > I've been traveling today (I'm off to the OSG Site Administrator I have a meeting at 10am PST but I should be free by 11.> meeting), so I wasn't aware of Tim's conversation over IM with you. > > I've only been partially following this software release. I don't have > a good understanding of what the problems are, how serious they are, > or what the impact of JMX is. (I've never heard of it before and don't > yet have knowledge of it.) > > I would appreciate talking to you guys about this. On Thursday, I'll > be very actively involved in the meeting in the morning (I'll be > giving a long talk), but I can probably duck out for a phone call > after lunch, or maybe in the late morning. I'll be on Pacific Time. > Let's talk. If possible, let's have Scot involved (since he's been > doing the work) and Tim (since he understands Tomcat). > > Given that I don't understand much yet, some of my questions will be: Thank you,> > * What are our existing problems. > > * Is the Gratia services/reporting update in its current form better > than what we have in the VDT already? More to the point, is it > worthwhile releasing now, then release an improvement later? > > * Does it need more work before we release it? From the VDT or from > you guys? > > * What is JMX and what is it's impact on the VDT and the Gratia > installation? > > Thanks, > -alain > Chris. > ----------------------------------------------------------------- > Alain Roy vdt-support@opensciencegrid.org > VDT Support http://vdt.cs.wisc.edu/support.html > > > -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Fri Nov 14 11:27:10 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Hi, Following discussion with Alain yesterday afternoon, he agreed that we could enable jmxremote management on tomcat if it could be restricted to localhost only. After some investigation, I discovered that this was possible but required changes to the service code in addition to a change to configure_gratia. As it happens, management access via this new method is restricted to a local JConsole and access from within the JVM only. Please find Gratia Services and Reporting tarballs at the usual location: https://twiki.grid.iu.edu/bin/view/Accounting/InstallationGuideVDT configure_gratia is attached to this email. Please let me know if you have trouble receiving it. Please note that it does *not* contain anything to address the issue John W. raised regarding unnecessary slurping of mysql5 configuration files during probe configuration -- if you have something for that the changes will need to be merged. Please let me know if you have any comments or problems. Thanks, Chris. -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Fri Nov 14 11:35:42 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Of course, configure_gratia was missing from previous email. Now attached. Sorry, Chris. -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). Message body not shown because it is too large or is not plain text. |
||||||||||||||
| # | Fri Nov 14 11:40:37 2008 | roy - Correspondence added | [Reply] | |||||||||
On Nov 14, 2008, at 9:33 AM, Chris Green wrote: > Of course, configure_gratia was missing from previous email. Now > attached. Chris-- Was the only difference for JMX the line that extends java_options with -Dcom.sun.management.jmxremote? Thanks, -alain |
||||||||||||
| # | Fri Nov 14 11:44:38 2008 | greenc@fnal.gov - Correspondence added | [Reply] | |||||||||||
Alain Roy via RT wrote:
On Nov 14, 2008, at 9:33 AM, Chris Green wrote: Of course, configure_gratia was missing from previous email. Now
attached.
Chris-- Was the only difference for JMX the line that extends java_options with -Dcom.sun.management.jmxremote?To configure_gratia, yes. Chris. Thanks, -alain -- Chris Green <greenc@fnal.gov>, FNAL CD/SCF/GRID; 'phone (630) 840-2167. IRC: greenc@jabber.fnal.gov, ChrisGreen@jabber.dsd.lbl.gov; chissgreen (AIM, Yahoo); chissg@hotmail.com (MSNM); chris.h.green (Google Talk). |
||||||||||||||
| # | Fri Nov 14 12:11:07 2008 | kronenfe - Correspondence added | [Reply] | |||||||||
Gratia-Service and Gratia-Reporting have been upgraded to 1.00.4 in the gratia test cache. The changes to configure_gratia from Chris have been incorporated. (The probes have not yet been updated, I am waiting on an NMI build to finish for the PBS/LSF probe) |
||||||||||||
| # | Mon Nov 17 09:48:18 2008 | roy - Queue changed from vdt-support to vdt-internal | ||
| # | Mon Nov 17 14:47:00 2008 | kronenfe - Correspondence added | [Reply] | |||||||||
The latest version of Gratia Services/Reporting (1.00.5) is in the VDT's test cache. I think that I heard from John W. that Chris has tested this and said that this is ready to ship, but please confirm that. When we hear the ok from the Gratia developers we will release this. We are doing a lettered update to the VDT this week, and should be able to incorporate this into that release. Thanks, -scot |
||||||||||||
| # | Mon Nov 17 17:28:33 2008 | kronenfe - Reference to ticket #4405 added | ||
| # | Tue Nov 18 09:50:06 2008 | weigand@fnal.gov - Correspondence added | [Reply] | |||||||||||
I reinstalled from the test-cache on gratiax23 this morning 11/18 and tested. It looks good. John Weigand Scot Kronenfeld via RT wrote: > The latest version of Gratia Services/Reporting (1.00.5) is in the > VDT's test cache. I think that I heard from John W. that Chris has > tested this and said that this is ready to ship, but please confirm > that. > > When we hear the ok from the Gratia developers we will release this. > We are doing a lettered update to the VDT this week, and should be > able to incorporate this into that release. > > Thanks, > -scot > > > |
||||||||||||||
| # | Mon Nov 24 14:29:14 2008 | kronenfe - Correspondence added | [Reply] | |
|
The new Gratia-Services and Gratia-Reporting were released today in VDT 1.10.1n. |
||||
| # | Mon Nov 24 14:31:36 2008 | kronenfe - Fix scheduled CUR added | ||
| # | Mon Nov 24 14:31:37 2008 | kronenfe - Fixed in 1.10.1n added | ||
| # | Mon Nov 24 14:31:46 2008 | kronenfe - Status changed from 'open' to 'resolved' | ||
| # | Tue Nov 25 08:40:00 2008 | weigand@fnal.gov - Correspondence added | [Reply] | |||||||||||
Tested installation and functionality this morning from the 1.10.1n cache. Everything looks good. This ticket can be closed. John Weigand Scot Kronenfeld via RT wrote: > The new Gratia-Services and Gratia-Reporting were released today in VDT > 1.10.1n. > > |
||||||||||||||
| # | Tue Nov 25 08:40:02 2008 | RT_System - Status changed from 'resolved' to 'open' | ||
| # | Tue Nov 25 10:56:57 2008 | kronenfe - Status changed from 'open' to 'resolved' | ||
Time to display: 9.913193
»|« RT 3.8.2 Copyright 1996-2008 Best Practical Solutions, LLC.
