Skip Menu | Logged in as guest | Logout
 
New messages
There are unread messages on this ticket. You can jump to the first unread message or jump to the first unread message and mark all messages as seen.
Ticket metadata
The Basics
Id: 4419
Status: resolved
Priority: 3/0
Queue: vdt-support
Custom Fields
Fixed in: (no value)
Fix scheduled: CUR
People
Owner: Alain Roy
Requestors: burt@fnal.gov
Cc: Andrea.Sciaba@cern.ch
catalind@fnal.gov
stefano.belforte@ts.infn.it
tiradani@fnal.gov
AdminCc:
Attachments
smime.p7s
More about burt@fnal.gov
Comments about this user:
No comment entered about this user
This user's 10 highest priority tickets:
Groups this user belongs to:
  • Everyone
Reminders
New reminder:
Dates
Created: Wed Nov 19 14:13:15 2008
Starts: Not set
Started: Not set
Last Contact: Thu Dec 04 13:31:27 2008
Due: Not set
Closed: Mon Dec 08 09:33:27 2008
Updated: Mon Nov 02 22:54:39 2009 by guest
Links
Depends on: (Create)
Depended on by: (Create)
Parents: (Create)
Children: (Create)
Refers to: (Create)
Referred to by: (Create)

History Brief headers — Full headers
# Wed Nov 19 14:13:16 2008 burt@fnal.gov - Ticket created [Reply] 
CC: Tony Tiradani <tiradani@fnal.gov>, Stefano Belforte <stefano.belforte@ts.infn.it>, "Andrea Sciaba'" <Andrea.Sciaba@cern.ch>, Catalin Dumitrescu <catalind@fnal.gov>
Subject: Add "-a" switch back into uberftp?
Date: Wed, 19 Nov 2008 14:07:47 -0600
To: vdt-support@OPENSCIENCEGRID.ORG
From: Burt Holzman <burt@fnal.gov>
Download (untitled) / with headers
text/plain 576b
Hi folks,

We've just noticed an incompatibility between uberftp 1.x and 2.0.
Previously uberftp accepted a -a option and it is currently invoked by
gLite's WMS wrappers when submitting to OSG sites (uberftp foo.bar.baz
-a GSI etc).

As of VDT 1.10.1k, you're shipping uberftp 2.0, which notes -a as an
invalid option and exits.

For backwards-compatibility, is it possible to build uberftp to silently
ignore the -a option? I'm not sure what the timescale is on modifying
the gLite wrappers to do uberftp version detection (although I am
pursuing that as well).

- B
Download smime.p7s
application/x-pkcs7-signature 3.8k
# Wed Nov 19 16:27:38 2008 roy - Taken
# Wed Nov 19 16:28:13 2008 roy - Cc Andrea.Sciaba@cern.ch added
# Wed Nov 19 16:28:17 2008 roy - Cc stefano.belforte@ts.infn.it added
# Wed Nov 19 16:28:18 2008 roy - Cc tiradani@fnal.gov added
# Wed Nov 19 16:28:42 2008 roy - Cc catalind@fnal.gov added
# Wed Nov 19 16:31:44 2008 roy - Correspondence added [Reply] 
Download (untitled) / with headers
text/plain 1.5k
Hi Burt,

My sincere apologies that we didn't catch this sooner!

What does the -a option do in older versions of UberFTP? Is it really
okay to silently ignore it, or do we have to convert it to another
option? Or do we need to add some functionality to UberFTP?

I think that we can do something like make a patch for UberFTP (at
least, if we're not talking about adding major functionality), test it
out with you, and share it with the UberFTP folks so they can integrate
it into a future version. This might be the fastest route to a fix.

Let me know the details of the -a option, and we can work out a patch.

By the way, I'll be in all-day meetings (at Fermilab!) Thursday and
Friday, so I might be slow to respond for a couple of days.

Thanks,
-alain

-----------------------------------------------------------------
Alain Roy vdt-support@opensciencegrid.org
VDT Support http://vdt.cs.wisc.edu/support.html

> Hi folks,
>
> We've just noticed an incompatibility between uberftp 1.x and 2.0.
> Previously uberftp accepted a -a option and it is currently invoked by
> gLite's WMS wrappers when submitting to OSG sites (uberftp foo.bar.baz
> -a GSI etc).
>
> As of VDT 1.10.1k, you're shipping uberftp 2.0, which notes -a as an
> invalid option and exits.
>
> For backwards-compatibility, is it possible to build uberftp to silently
> ignore the -a option? I'm not sure what the timescale is on modifying
> the gLite wrappers to do uberftp version detection (although I am
> pursuing that as well).
# Wed Nov 19 16:31:45 2008 RT_System - Status changed from 'new' to 'open'
# Wed Nov 19 16:32:25 2008 roy - Priority changed from (no value) to '3'
# Wed Nov 19 16:32:26 2008 roy - Fix scheduled CUR added
# Wed Nov 19 16:45:17 2008 burt@fnal.gov - Correspondence added [Reply] 
CC: Andrea.Sciaba@cern.ch, catalind@fnal.gov, stefano.belforte@ts.infn.it, tiradani@fnal.gov
Subject: Re: [vdt-support #4419] Add "-a" switch back into uberftp?
Date: Wed, 19 Nov 2008 16:44:13 -0600
To: vdt-support@OPENSCIENCEGRID.ORG
From: Burt Holzman <burt@fnal.gov>
Download (untitled) / with headers
text/plain 1.4k
Alain Roy via RT wrote:
> Hi Burt,
>
> My sincere apologies that we didn't catch this sooner!
>
> What does the -a option do in older versions of UberFTP? Is it really
> okay to silently ignore it, or do we have to convert it to another
> option? Or do we need to add some functionality to UberFTP?
>
> I think that we can do something like make a patch for UberFTP (at
> least, if we're not talking about adding major functionality), test it
> out with you, and share it with the UberFTP folks so they can integrate
> it into a future version. This might be the fastest route to a fix.
>
> Let me know the details of the -a option, and we can work out a patch.
>
> By the way, I'll be in all-day meetings (at Fermilab!) Thursday and
> Friday, so I might be slow to respond for a couple of days.

I'm in some of those all-day meetings with you. No real functionality
is needed.

According to the 1.2.x uberftp:
-a auth Use auth authentication. GSI and
MSS (NCSA passwordless) authentication methods
are supported. If this option is not used, the
default is GSI. URL style syntax overrides this value.

And the 2.0 changelog at UIUC:
- Removed the -a option to open. Now the authentication mechanism is
implied by the use a password

- B

PS Stefano & Andrea -- this implies that actually the patch to the gLite
wrapper can be much simplier and just remove "-a GSI" altogether, since
it is the default ...
Download smime.p7s
application/x-pkcs7-signature 3.8k
# Mon Nov 24 17:09:11 2008 roy - Correspondence added [Reply] 
Subject: Re: [vdt-support #4419] Add "-a" switch back into uberftp?
Date: Mon, 24 Nov 2008 17:08:13 -0600
To: vdt-support@OPENSCIENCEGRID.ORG
From: Alain Roy <roy@cs.wisc.edu>
Download (untitled) / with headers
text/plain 608b
Burt,

I've looked at the UberFTP code and it's easy to patch.

My question for you: how should I ignore the -a option?

1) I prefer to print a warning that -a is deprecated and ignored. This
will make extra output that could affect your usage of UberFTP.

2) I could silently ignore it. I don't like silently ignoring
arguments, but would do it if it mattered to you.

What do you think?

Thanks,
-alain

-----------------------------------------------------------------
Alain Roy vdt-support@opensciencegrid.org
VDT Support http://vdt.cs.wisc.edu/support.html
# Mon Nov 24 18:02:14 2008 stefano.belforte@cern.ch - Correspondence added [Reply] 
CC: burt@fnal.gov, Andrea.Sciaba@cern.ch, catalind@fnal.gov, stefano.belforte@ts.infn.it, tiradani@fnal.gov
Subject: Re: [vdt-support #4419] Add "-a" switch back into uberftp?
Date: Tue, 25 Nov 2008 01:00:45 +0100
To: vdt-support@OPENSCIENCEGRID.ORG, Marco Cecchi <marco.cecchi@cnaf.infn.it>
From: Stefano Belforte <stefano.belforte@cern.ch>
Download (untitled) / with headers
text/plain 1k
Marco,
would 1) do ? Does the current job wrapper depend on
uberftp stdout/err ?
Not to say that you should not remove -a GSI from
the JbWrapper, but in the meanwhile...
Stefano

On 11/25/2008 12:09 AM, Alain Roy via RT wrote:
> Burt,
>
> I've looked at the UberFTP code and it's easy to patch.
>
> My question for you: how should I ignore the -a option?
>
> 1) I prefer to print a warning that -a is deprecated and ignored. This
> will make extra output that could affect your usage of UberFTP.
>
> 2) I could silently ignore it. I don't like silently ignoring
> arguments, but would do it if it mattered to you.
>
> What do you think?
>
> Thanks,
> -alain
>
> -----------------------------------------------------------------
> Alain Roy vdt-support@opensciencegrid.org
> VDT Support http://vdt.cs.wisc.edu/support.html
>
>

--
Stefano Belforte - I.N.F.N. tel : +39 040 375-6261 (fax: 375-6258)
Area di Ricerca - Padriciano 99 tel mobile: +39 328 010 7327
34012 TRIESTE TS - Italy AIM: stefanobelforte
# Tue Nov 25 09:24:42 2008 burt@fnal.gov - Correspondence added [Reply] 
CC: vdt-support@OPENSCIENCEGRID.ORG, Marco Cecchi <marco.cecchi@cnaf.infn.it>, Andrea.Sciaba@cern.ch, catalind@fnal.gov, stefano.belforte@ts.infn.it, tiradani@fnal.gov
Subject: Re: [vdt-support #4419] Add "-a" switch back into uberftp?
Date: Tue, 25 Nov 2008 09:24:26 -0600
To: Stefano Belforte <stefano.belforte@cern.ch>
From: Burt Holzman <burt@fnal.gov>
Download (untitled) / with headers
text/plain 421b
Stefano Belforte wrote:
> Marco,
> would 1) do ? Does the current job wrapper depend on
> uberftp stdout/err ?
> Not to say that you should not remove -a GSI from
> the JbWrapper, but in the meanwhile...

Hi Alain (and Marco and Stefano and everyone),

The code in the job wrapper just checks the exit status of uberftp, so
more stdout should be fine. Marco can correct me if I'm wrong from my
cursory reading..

- B
Download smime.p7s
application/x-pkcs7-signature 3.8k
# Tue Nov 25 13:21:44 2008 marco.cecchi@cnaf.infn.it - Correspondence added [Reply] 
CC: vdt-support@OPENSCIENCEGRID.ORG, Marco Cecchi <marco.cecchi@cnaf.infn.it>, Andrea.Sciaba@cern.ch, catalind@fnal.gov, stefano.belforte@ts.infn.it, tiradani@fnal.gov
Subject: Re: [vdt-support #4419] Add "-a" switch back into uberftp?
Date: Tue, 25 Nov 2008 20:16:17 +0100
To: Burt Holzman <burt@fnal.gov>, Stefano Belforte <stefano.belforte@cern.ch>
From: Marco Cecchi <marco.cecchi@cnaf.infn.it>
Download (untitled) / with headers
text/plain 538b
Burt Holzman wrote:
> Stefano Belforte wrote:
>> Marco,
>> would 1) do ? Does the current job wrapper depend on
>> uberftp stdout/err ?
>> Not to say that you should not remove -a GSI from
>> the JbWrapper, but in the meanwhile...
>
> Hi Alain (and Marco and Stefano and everyone),
>
> The code in the job wrapper just checks the exit status of uberftp, so
> more stdout should be fine.

correct. I apologize for replying this late.
Option -a is going to be removed starting from patch 2562, code already
committed to CVS.


Marco.
# Tue Nov 25 13:32:29 2008 roy - Correspondence added [Reply] 
Subject: Re: [vdt-support #4419] Add "-a" switch back into uberftp?
Date: Tue, 25 Nov 2008 13:28:27 -0600
To: vdt-support@OPENSCIENCEGRID.ORG
From: Alain Roy <roy@cs.wisc.edu>
Download (untitled) / with headers
text/plain 1k
On Nov 25, 2008, at 1:21 PM, Marco Cecchi via RT wrote:

> http://crt.cs.wisc.edu/Ticket/Display.html?id=4419
>
> Burt Holzman wrote:
>> Stefano Belforte wrote:
>>> Marco,
>>> would 1) do ? Does the current job wrapper depend on
>>> uberftp stdout/err ?
>>> Not to say that you should not remove -a GSI from
>>> the JbWrapper, but in the meanwhile...
>>
>> Hi Alain (and Marco and Stefano and everyone),
>>
>> The code in the job wrapper just checks the exit status of uberftp,
>> so
>> more stdout should be fine.
>
> correct. I apologize for replying this late.
> Option -a is going to be removed starting from patch 2562, code
> already
> committed to CVS.

I understand how to patch UberFTP. The holiday will slow me down, but
I can probably release a patch next week if you like. Should I bother,
or will your workaround be in place sooner?

Thanks,
-alain

-----------------------------------------------------------------
Alain Roy vdt-support@opensciencegrid.org
VDT Support http://vdt.cs.wisc.edu/support.html
# Wed Dec 03 10:34:15 2008 roy - Comments added [Reply] 
Subject: [vdt-support #4419] SVN commit, rev 8389
To: vdt-support@cs.wisc.edu
From: roy@cs.wisc.edu
Download (untitled) / with headers
text/plain 828b
Commit comment:
Updated UberFTP from 2.0 to 2.0p1. Two major changes.
1) Added a patch so that -a (an old option) gives a warning instead of
an error. I've communicated with the UberFTP developer, and this will
be rolled into a future release.

2) Some tweaks to the name of the tarball/RPM to have a better version
number. Instead of being named by the VDT version, it's by the UberFTP
version.


Changed files:
U vdt/branches/vdt-1.10.1/UberFTP/nmi/build-uberftp
U vdt/branches/vdt-1.10.1/UberFTP/nmi/cmdfile
A vdt/branches/vdt-1.10.1/UberFTP/nmi/deprecated-arg.patch
U vdt/branches/vdt-1.10.1/UberFTP/nmi/glue.in
A vdt/branches/vdt-1.10.1/UberFTP/nmi/spelling.patch
U vdt/branches/vdt-1.10.1/UberFTP/nmi/uberftp.in
U vdt/branches/vdt-1.10.1/defs

To generate a diff:
svn diff -c 8389 file:///p/vdt/workspace/svn
# Wed Dec 03 15:23:13 2008 roy - Correspondence added [Reply] 
Download (untitled) / with headers
text/plain 1.8k
Not hearing back from you, I went ahead and patched UberFTP. I think
it's ready for release, which we'll do in the next day or two. You can
try it out now from a test cache.

pacman -get http://vdt.cs.wisc.edu/vdt_11099_cache:UberFTP

It looks like this:

% uberftp -a gsi vdt-rhas4-amd64
Warning: the -a option is deprecated, ignoring.
220 vdt-rhas4-amd64.cs.wisc.edu GridFTP Server 2.7 (gcc64dbg,
1204845443-63) [VDT patched 4.0.7] ready.
230 User roy logged in.
UberFTP>

Thanks,
-alain
-----------------------------------------------------------------
Alain Roy vdt-support@opensciencegrid.org
VDT Support http://vdt.cs.wisc.edu/support.html


On Tue Nov 25 13:32:29 2008, roy wrote:
> On Nov 25, 2008, at 1:21 PM, Marco Cecchi via RT wrote:
>
> > http://crt.cs.wisc.edu/Ticket/Display.html?id=4419
> >
> > Burt Holzman wrote:
> >> Stefano Belforte wrote:
> >>> Marco,
> >>> would 1) do ? Does the current job wrapper depend on
> >>> uberftp stdout/err ?
> >>> Not to say that you should not remove -a GSI from
> >>> the JbWrapper, but in the meanwhile...
> >>
> >> Hi Alain (and Marco and Stefano and everyone),
> >>
> >> The code in the job wrapper just checks the exit status of uberftp,
> >> so
> >> more stdout should be fine.
> >
> > correct. I apologize for replying this late.
> > Option -a is going to be removed starting from patch 2562, code
> > already
> > committed to CVS.
>
> I understand how to patch UberFTP. The holiday will slow me down, but
> I can probably release a patch next week if you like. Should I bother,
> or will your workaround be in place sooner?
>
> Thanks,
> -alain
>
> -----------------------------------------------------------------
> Alain Roy vdt-support@opensciencegrid.org
> VDT Support http://vdt.cs.wisc.edu/support.html
# Wed Dec 03 16:37:13 2008 roy - Correspondence added [Reply] 
Download (untitled) / with headers
text/plain 330b
Oh, by the way, I shared the patch with the author of UberFTP and he's
agreed to put it into a future release of UberFTP.

-alain

-----------------------------------------------------------------
Alain Roy vdt-support@opensciencegrid.org
VDT Support http://vdt.cs.wisc.edu/support.html
# Thu Dec 04 03:00:24 2008 stefano.belforte@ts.infn.it - Correspondence added [Reply] 
CC: burt@fnal.gov, andrea.sciaba@cern.ch, catalind@fnal.gov, stefano.belforte@ts.infn.it, tiradani@fnal.gov
Subject: Re: [vdt-support #4419] Add "-a" switch back into uberftp?
Date: Thu, 04 Dec 2008 09:59:10 +0100 (CET)
To: vdt-support@OPENSCIENCEGRID.ORG
From: stefano.belforte@ts.infn.it
Download (untitled) / with headers
text/plain 807b
thanks Roy,
even if we have managed to protect us against this problem
currently, I think to thave this patch in the installed UberFTP
will make things smoother and safer.
The gLite WMS wrapper has also been modified not to use
-a switch, but it will take a bit before that is in the installed
release.
Stefano

> Oh, by the way, I shared the patch with the author of UberFTP and he's
> agreed to put it into a future release of UberFTP.
>
> -alain
>
> -----------------------------------------------------------------
> Alain Roy vdt-support@opensciencegrid.org
> VDT Support http://vdt.cs.wisc.edu/support.html
>
>
> --
> View ticket at
> <http://crt.cs.wisc.edu/Ticket/Display.html?user=guest&pass=guest&id=4419>
> VDT Support: vdt-support@opensciencegrid.org
>
# Thu Dec 04 13:31:10 2008 roy - Correspondence added [Reply] 
Download (untitled) / with headers
text/plain 429b
Hi,

The new, patched UberFTP was released in VDT 1.10.1p today (4-Dec-2008).

http://vdt.cs.wisc.edu/releases/1.10.1/release-p.html

I'm resolving this ticket for now, but do let us know if you have any
other problems.

-alain

-----------------------------------------------------------------
Alain Roy vdt-support@opensciencegrid.org
VDT Support http://vdt.cs.wisc.edu/support.html
# Mon Dec 08 09:33:17 2008 roy - Comments added [Reply] 
Download (untitled) / with headers
text/plain 22b
Released in 1.10.1p.
# Mon Dec 08 09:33:27 2008 roy - Status changed from 'open' to 'resolved'
# Mon Nov 02 22:54:39 2009 guest - Reminder 'CgOFBUxgrGvfatxK' added