Skip Menu | Logged in as guest | Logout
 
Ticket metadata
Id: 3625
Status: resolved
Priority: 3/0
Queue: vdt-internal

Fixed in: 1.10.1e
Fix scheduled: CUR

Owner: Scot Kronenfeld
Requestors: Alain Roy
Cc:
AdminCc:

New reminder:

Created: Mon Jun 23 16:51:43 2008
Starts: Not set
Started: Tue Jun 24 12:43:36 2008
Last Contact: Not set
Due: Not set
Closed: Thu Jun 26 13:02:22 2008
Updated: Thu Jun 26 13:02:41 2008 by kronenfe



History Brief headersFull headers
Subject: Update Fermi SRM Client to 1.8.0 patch level 15p7
Date: Mon, 23 Jun 2008 16:46:34 -0500
To: vdt-support@OPENSCIENCEGRID.ORG
From: Alain Roy <roy@cs.wisc.edu>
Download (untitled) / with headers
text/plain 7.7k


Begin forwarded message:

> From: Timur Perelmutov <timur@fnal.gov>
> Date: June 23, 2008 2:55:25 PM CDT
> To: Alain Roy <roy@cs.wisc.edu>
> Cc: Tanya Levshina <tlevshin@fnal.gov>, Dan Bradley
> <dan@hep.wisc.edu>, "cms-t1@fnal.gov" <cms-t1@fnal.gov>, cms-t2 <cms-t2@fnal.gov
> >, Abhishek Singh Rana <rana@fnal.gov>, Gene Oleynik
> <oleynik@fnal.gov>, Dmitry Litvintsev <litvinse@fnal.gov>, Neha
> Sharma <neha@fnal.gov>, Ted Hesselroth <tdh@fnal.gov>
> Subject: Re: srmcp trouble in OSG 1.0.0
>
> New Client rpm is now available from http://www.dcache.org/downloads/1.8.0/index.shtml
>
> Thanks,
> Timur
>
> Alain Roy wrote:
>> I'm happy to ugprade the Fermi SRM client. Let me know when it's
>> available, and we'll release it.
>>
>> -alain
>>
>> On Jun 20, 2008, at 4:53 PM, Tanya Levshina wrote:
>>> Hi Timur,
>>>
>>> We can pretty easily do vdt release of dcache server (witch is a
>>> stand alone package in vdt) but this will not replace the fermi
>>> srm client that is in OSG 1.0.
>>> I will ask Alain when he thinks srm client patch could be
>>> incorporated in vdt release and I do not know the mechanism of
>>> OSG upgrade.
>>>
>>> Tanya
>>>
>>> ----- Original Message -----
>>> From: Timur Perelmutov <timur@fnal.gov>
>>> Date: Friday, June 20, 2008 4:46 pm
>>> Subject: Re: srmcp trouble in OSG 1.0.0
>>> To: Dan Bradley <dan@hep.wisc.edu>
>>> Cc: "cms-t1@fnal.gov" <cms-t1@fnal.gov>, cms-t2 <cms-t2@fnal.gov>,
>>> Abhishek Singh Rana <rana@fnal.gov>, Gene Oleynik
>>> <oleynik@fnal.gov>, Tanya Levshina <tlevshin@fnal.gov>, Dmitry
>>> Litvintsev <litvinse@fnal.gov>
>>>
>>>
>>>> Hi Dan, All,
>>>>
>>>> The problem is that the gridftp server in response to the close
>>>> command
>>>> used not to wait for the correct reply sending to complete, and to
>>>> terminate the door sometimes prematurely. the old grdiftp client
>>>> build
>>>>
>>>> into the srmcp used to ignore this problem. Recent changes made the
>>>> client more demanding. This was not noted earlier, because we were
>>>> testing the new client with the newer servers. Dmitry has fixed the
>>>> client problem now as well, so it will become compatible with the
>>>> old
>>>>
>>>> servers once again. The new client will become available in the
>>>> upcomming dCache 1.8.0 15p7 release (expected on Monday next week)
>>>> and
>>>> in the VDT on or before the Monday, June 30 .
>>>>
>>>> To confirm that the problem is indeed fixed, we ask you to test the
>>>> srm
>>>> client from p7 release candidate available at
>>>> https://srm.fnal.gov/twiki/pub/SrmProject/SrmClient/dcache-srmclient-1.8.0-15p7rc.noarch.rpm
>>>> .
>>>>
>>>> Best regards,
>>>> Timur
>>>>
>>>> Dan Bradley wrote:
>>>>> Hello,
>>>>>
>>>>> We have installed the worker node client from OSG 1.0.0 and this
>>>>> has
>>>>
>>>>> caused sporadic failure of srmcp in the Wisconsin T2.
>>>>>
>>>>> Here is the version of the srmcp client where we observe the
>>>>> problem:
>>>>>
>>>>> $ srm -version
>>>>> Storage Resource Manager (SRM) implementation version 2.0.3
>>>>> Copyright (c) 2002-2008 Fermi National Accelerator Laboratory
>>>>> Specification Version 2.0 by SRM Working Group
>>>>> (http://sdm.lbl.gov/srm-wg)
>>>>>
>>>>>
>>>>> $ vdt-version | grep SRM
>>>>> SRM Fermi Client 1.8.0-15p3
>>>>>
>>>>> We have observed the problem with file --> srm and srm --> file
>>>>> transfers. The file gets copied, but srmcp has a java exception
>>>>> during shutdown, so it exits with a non-zero status. This
>>>>> exception
>>>>
>>>>> during shutdown happens about half the time. If we instead use
>>>>> our
>>>>
>>>>> previous installed version of the srmcp client, we never observe
>>>> this
>>>>> problem. That working version is:
>>>>>
>>>>> $ srm -version
>>>>> Storage Resource Manager (SRM) CP Client version 2.0
>>>>> Copyright (c) 2002-2006 Fermi National Accelerator Laboratory
>>>>>
>>>>> $ vdt-version | grep SRM
>>>>> SRM Fermi (V1) Client 1.8.0-4
>>>>>
>>>>> We have tried similar transfer tests from FNAL srm to local file
>>>>> in
>>>>
>>>>> Wisconsin using the problematic version of srmcp, but we have not
>>>>> observed the failure in that case. We have only observed it when
>>>>> doing transfers to the Wisconsin SRM server to/from a local file
>>>>> in
>>>>
>>>>> Wisconsin.
>>>>>
>>>>> Here is an example of what we see when the exception happens:
>>>>>
>>>>> ...
>>>>> GridftpClient: gridFTPWrite() wrote 20000bytes
>>>>> GridftpClient: closing client :
>>>>> org.dcache.srm.util.GridftpClient$FnalGridFTPClient@427be8c2
>>>>> setting file request -2146549979 status to Done
>>>>> copy failed with the error
>>>>> java.io.IOException:
>>>>> at
>>>>>
>>>> org
>>>> .globus
>>>> .ftp.extended.GridFTPInputStream.readMsg(GridFTPInputStream.java:
>>>> 130)
>>>>
>>>>>
>>>>> at
>>>>> org
>>>>> .globus
>>>>> .gsi.gssapi.net.GssInputStream.hasData(GssInputStream.java:86)
>>>>> at
>>>>> org
>>>>> .globus.gsi.gssapi.net.GssInputStream.read(GssInputStream.java:60)
>>>>> at sun.nio.cs.StreamDecoder
>>>>> $CharsetSD.readBytes(StreamDecoder.java:411)
>>>>> at sun.nio.cs.StreamDecoder
>>>>> $CharsetSD.implRead(StreamDecoder.java:453)
>>>>> at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:183)
>>>>> at java.io.InputStreamReader.read(InputStreamReader.java:167)
>>>>> at java.io.BufferedReader.fill(BufferedReader.java:136)
>>>>> at java.io.BufferedReader.readLine(BufferedReader.java:299)
>>>>> at java.io.BufferedReader.readLine(BufferedReader.java:362)
>>>>> at org.globus.ftp.vanilla.Reply.(Reply.java:71)
>>>>> at
>>>>> org
>>>>> .globus
>>>>> .ftp.vanilla.FTPControlChannel.read(FTPControlChannel.java:262)
>>>>> at
>>>>>
>>>> org
>>>> .globus
>>>> .ftp.vanilla.FTPControlChannel.exchange(FTPControlChannel.java:305)
>>>>
>>>>>
>>>>> at
>>>>>
>>>> org
>>>> .globus
>>>> .ftp.vanilla.FTPControlChannel.execute(FTPControlChannel.java:330)
>>>>
>>>>>
>>>>> at org.globus.ftp.FTPClient.close(FTPClient.java:921)
>>>>> at org.dcache.srm.util.GridftpClient.close(GridftpClient.java:651)
>>>>> at gov.fnal.srm.util.Copier.javaGridFtpCopy(Copier.java:626)
>>>>> at gov.fnal.srm.util.Copier.copy(Copier.java:493)
>>>>> at gov.fnal.srm.util.Copier.run(Copier.java:321)
>>>>> at java.lang.Thread.run(Thread.java:595)
>>>>> Exception in thread "main" java.io.IOException:
>>>>> at
>>>>>
>>>> org
>>>> .globus
>>>> .ftp.extended.GridFTPInputStream.readMsg(GridFTPInputStream.java:
>>>> 130)
>>>>
>>>>>
>>>>> at
>>>>> org
>>>>> .globus
>>>>> .gsi.gssapi.net.GssInputStream.hasData(GssInputStream.java:86)
>>>>> at
>>>>> org
>>>>> .globus.gsi.gssapi.net.GssInputStream.read(GssInputStream.java:60)
>>>>> at sun.nio.cs.StreamDecoder
>>>>> $CharsetSD.readBytes(StreamDecoder.java:411)
>>>>> at sun.nio.cs.StreamDecoder
>>>>> $CharsetSD.implRead(StreamDecoder.java:453)
>>>>> at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:183)
>>>>> at java.io.InputStreamReader.read(InputStreamReader.java:167)
>>>>> at java.io.BufferedReader.fill(BufferedReader.java:136)
>>>>> at java.io.BufferedReader.readLine(BufferedReader.java:299)
>>>>> at java.io.BufferedReader.readLine(BufferedReader.java:362)
>>>>> at org.globus.ftp.vanilla.Reply.(Reply.java:71)
>>>>> at
>>>>> org
>>>>> .globus
>>>>> .ftp.vanilla.FTPControlChannel.read(FTPControlChannel.java:262)
>>>>> at
>>>>>
>>>> org
>>>> .globus
>>>> .ftp.vanilla.FTPControlChannel.exchange(FTPControlChannel.java:305)
>>>>
>>>>>
>>>>> at
>>>>>
>>>> org
>>>> .globus
>>>> .ftp.vanilla.FTPControlChannel.execute(FTPControlChannel.java:330)
>>>>
>>>>>
>>>>> at org.globus.ftp.FTPClient.close(FTPClient.java:921)
>>>>> at org.dcache.srm.util.GridftpClient.close(GridftpClient.java:651)
>>>>> at gov.fnal.srm.util.Copier.javaGridFtpCopy(Copier.java:626)
>>>>> at gov.fnal.srm.util.Copier.copy(Copier.java:493)
>>>>> at gov.fnal.srm.util.Copier.run(Copier.java:321)
>>>>> at java.lang.Thread.run(Thread.java:595)
>>>>>
>>>>>
>>>>> Thanks in advance for any help!
>>>>>
>>>>> --Dan
>>>>
>>
>
Download smime.p7s
application/pkcs7-signature 2.7k