Transfer

TRANS-#Number#

Nr.

Parameter

Example

0200

 

JobMode_Transfer

1

Sets the JobMode to be used in the Transfer step

0201

 

DeleteLogfilesAtStart_Transfer

Yes

If this option is set to “Yes”, the log file is deleted in the beginning before each Transfer run. This is useful if many runs are expected which only wait for new data.

0202

TransBinary

<ColdBinDirectory>/<ENV_OS>/smbclient

 

This parameter specifies the path and filename of an executable command that is used to transfer files. In JobMode 1, for example, the Samba Client is used (smbclient).

 

Most of the following parameters represent settings that are required by any kind of file transfer tool such as typically user credentials and connection parameters. Further details, however, can depend on the exact tool that is used.

0203

 

TransUserName

myFileShareUser

The username of the login credentials for file transfer

In JobMode 1 is a Samba file share user

0204

 

TransUserPass

myPassWord012XaBcD

The password of the login credentials for file transfer

In JobMode 1 is a Samba file share user’s password

0205

 

TransWorkgroup

Workgroup

The workgroup expected by the file transfer tool

In JobMode 1 is a Samba file share workgroup

0206

 

TransShare

//78.113.123.189/myShare

This parameter specifies the source location from which files are transferred.

In JobMode 1 the Samba format is used with IP/ name (e.g. //78.113.123.189/myShare).

Subdirectories are specified via <TransWorkDir>.

0207

 

TransWorkDir

<SpoolType>

This parameter specifies the working directory on the remote share. It must be left empty if the top level directory is to be used.

0208

 

TransTimeStampCheckDir

timestamp<SpoolType>

This parameter specifies the name of a directory that is used for temporal coordination.

This directory is recreated on the file share in each connection to enable a comparison of system times and it must not contain any files. In any file transfer session only such files are transferred, which are older than this directory.

This is also needed for technical reasons since the time can differ between the source and the target system, and enables the internal mechanism to restrict the processing scope to files with some given age condition (such as a minimum age).

0209

TransFileNameMask

0-9]{4}_[0-9]{10}_DTI[0-9]{5}.<IndexFileExtension>

 

This parameter specifies a filename pattern based on a regular expression to determine which files are to be transferred from the source location. The pattern represents a complete filename with its file type extension.

In JobMode 1 this pattern refers to the indexing file (whereas the content file is automatically associated and managed along the way).

 

Regular expression quick guide:

  • [0-9]{4} exactly 4 digits, e.g. 0000, 0001, 0002 up to 9999

  • [B9a#] one of the characters “B”, “9”, “a” or “#”

  • [e-h] one of the characters “e”, “f”, “g” or “h”

  • (SIG|RECH) the string “SIG” or the string “RECH”

  • . an arbitrary character

  • [0-9]+ at least one digit, but any more digits are also allowed

 

Also see appendix “Regular Expressions” in [UM AdminClient], which provides a few more control elements and examples.

0210

TransAcceptLogFile

<ColdLogsBaseDirectory>/
<SpoolType>/transfer.log

 

This parameter specifies a log filename. If this is set, a special log file is generated which lists all files processed in the Transfer step (similar to <AcceptSummaryLogFile>).

If this value is left empty, no such file is generated.

0211

 

TransIgnoreConnectErrors

No

If this option is set to “Yes”, no error notification is sent in case of a connection failure with the remote system, and further retry attempts are triggered later on.

It is strongly recommended only setting this option to “Yes” once an initial connection was tested successfully, because otherwise initial configuration mistakes may be overlooked and remote systems which were not reachable from the beginnings may remain undiscovered for a long time!

A maximum number of retries is set via <TransIgnoreConnectErrorsRetryCount>, where the default is 100, which means that the Transfer retries are stopped after 100 failed connection attempts. An empty input directory does not count as a failed connection.

By default after 10 connection failures an automated e-mail is sent. If a successful connection can be re-established after such a failure, a success notification is sent. The exact number for triggering this e-mail notification is set via <TransIgnoreConnectErrorsSendEmailOnRetry>. If the value 0 is set for this parameter, the mechanism is deactivated.

0212

TransInputDirectory

<ColdDocsBaseDirectory>/
<SpoolType>/<SpoolType.Generation>

 

In JobModes where files are moved from the local host to a remote host, this directory represents the input directory on the local host.

0213

 

TransRenameFileTo

Delivery_<SpoolType.Generation>

If a single file is transferred in JobMode 50 or 60, this can be renamed before the Transfer step. The new name is specified with this parameter. This is not supported for multiple files.

0214

 

TransAckFileContent

MD5

This parameter specifies the content that is written into an OK file. If “MD5” is set, an MD5 checksum is calculated and written into the OK file.

0215

 

TransAckFileExtension

ok

This parameter specifies the file type extension that is used for an OK file, which signals a successful file transfer. The OK file always has the same name as the file that is transferred, with this extension that is appended.

0216

 

TransConfigFile

<ColdConfigDirectory>/transfer.ini

InJobMode 98 – transfer management multiple Transfer modes can be managed via an additional configuration file whose name (and path) is set with this parameter.

0217

 

TransDeleteTransferedFiles

Yes

If this option is set to “Yes”, all successfully transferred files in JobMode 50 and 60 are deleted from the source directory. Otherwise, the original files remain available after transfer.

0218

 

TransCheckMinimumDiskFree

1000

This parameter checks if enough space is available on the peer in an SFTP transfer. In this case an SSH login and the execution of the command “df -k” must be possible with the given user credentials. If the space is not enough, a retry attempt is undertaken later on.

The value 0 deactivates this check. Otherwise the number is a size in megabyte (MB), i.e. a value of 1000 indicates a size of 1 gigabyte (GB).

0219

 

TransferMode

binary

This parameter specifies a transfer mode in JobMode 14, which can be one of “binary” or “ascii”.

0220

 

TransChmod

660

In case of an SFTP transfer an additional command to change file permissions can be executed for each file. This number parameter is used in the underlying “chmod” command: chmod <number>

0221

 

TransAdditionalCommand

get 'ZH051.Z.TGA69H(-0)' tga69H.<Generation>.txt

In an SFTP transfer an additional command can be executed, which is specified via this parameter. This is explicitly required in JobMode 19, for example, in a scenario where files, which do not yet exist, need to be fetched and must be generated on the fly.

0222

 

TransMoveTransferedFilesTo

/finished

This parameter sets a directory for moving transferred files. SCP uses the rename command to achieve this (used in JobMode 13 and 14). If no directory is set with this parameter, no move is executed.

0223

 

TransDirectoryListCmd

ls –l

With this parameter the list directory command “ls -l” must be set, which is used before a transfer to show the content of a directory via SFTP. However, there are SFTP servers which require a different command such as only “ls” (without the parameter “-l“) or the command “dir” (on a Windows system).

This parameter is commented out by default.

0224

 

TransCreateReadyFile

ready.txt

If a filename is set via this parameter, an empty file with this name is generated in the target directory after transfer.

0226

 

TransAdditionalCustomerCopy

<ColdSpoolBaseDirectory>/<SpoolType>/
<SpoolType.Generation>

If specified, it refers to the directory where a copy of the transferred files is stored.

0227

 

TransDestroyFileExtension

ok

If a file extension is set via this parameter, in JobMode 11 files with this extension are deleted after transfer, whereas the remaining files are moved to the path <DataInputPath>.

0228

 

TransIgnoreConnectErrorsRetryCount

100

See <TransIgnoreConnectErrors> (TRANS-0211)

0229

 

TransIgnoreConnectErrorsSendEmailOnRetry

10

See <TransIgnoreConnectErrors> (TRANS-0211)

0230

 

TransIgnoreFiles

No

This parameter is used for JobModes where files AND subdirectories can be transferred from the input directory (for example in JobMode 60).

If set to “Yes”, no files are transferred.

Also see <TransIgnoreDirs> (TRANS-0231)

0231

 

TransIgnoreDirs

No

This parameter is used for JobModes where files AND subdirectories can be transferred from the input directory (for example in JobMode 60).

If set to “Yes”, no directories are transferred.

Also see <TransIgnoreFiles> (TRANS-0230)

0232

TransNotification

No

If set to “Yes”, when transfer gets finished, an overview of all data manipulating actions is sent via e-mail to <TransEmailRecipients>. The e-mail system must be configured in advance and <eMailNotification> must be also activated.

0233

TransEmailRecipients

{9}

This is the recipient e-mail address of the transfer notification. Placeholders {i} are populated from <TransInputFile>.

0234

TransEmailSubject

Status – ImageMaster legal audit export

The e-mail subject of the transfer notification. Placeholders {i} are populated from <TransInputFile>.

0235

TransEmailText

The requested audit export with number {4}: is now ready. You can retrieve it from [FILES]

The text used for the notification e-mail if there are transfer files. There are the following placeholders:

  • Placeholders {i} are populated from <TransInputFile>
  • [ENTER] is replaced by a line break
  • [FILES] is replaced by the names of the transfer files
0236

TransEmailTextNoTransferFiles

The requested audit export with number {4} has no hits

The text used for the notification e-mail, if there are no transfer files. There are the following placeholders:

  • Placeholders {i} are populated from <TransInputFile>
  • [ENTER] is replaced by a line break

0237

TransInputFile

<ColdSpoolBaseDirectory>/<SpoolType>/

<SpoolType.Generation>/index.csv

Input file from which the placeholders {i} are filled.

0238

TransFileNameIgnoreInNotificationMask

NO-HITS\.tar\.gz$

Regular expression indicating which transfer files are not listed in the notification e-mail. This allows filtering out "NO-DATA" flag files.

0240

TransRequiredFreeDiskSpaceOrRetry

Yes

Supported in JobMode 11:

Determines the behavior when there is no disk space for download:

  • By default the behavior is set to “No” and processing is stopped with an error.

  • With the alternative setting “Yes” processing is halted in status “Retry”.

0241

TransFileInfoMask

^([FILETYPEREGEX])([^ ])[ ][^ ][ ]([0-9A-Za-z-_\.\?])[ ]([0-9A-Za-z-_\.\?])[ ][^ ][ ]([0-9])[ ](.)[ ](.+)$

Regular expression which filters the entries of the file listing created by <TransDirectoryListCmd> command. There must be exactly 7 capturing groups defined in the regular expression.

The default mask is adapted to the listing using the “ls -l” command.

0242

TransMaximumDirsDownload

1

This is the maximum number of files that will be transferred in one transfer run.

Table 104: Transfer configuration parameters