JobMode 12 – SFTP get

Parameter

Value

File Number

1 – <MaximumFilesSpool>

Source File

sftp://<TransShare>[:/<TransWorkDir>]/<TransFileNameMask>

Output

<DataInputPath>/<TransFileNameMask>

Configuration Parameters

<DataInputPath>

<LastModificationTime>

<MaximumFilesSpool>

<TransAcceptLogFile >

<TransBinary>

<TransCreateReadyFile>

<TransFileNameMask>

<TransShare>

<TransTimeStampCheckDir>

<TransUserName>

<TransWorkDir>

Table 184: Transfer: JobMode 12 – SFTP get

This JobMode fetches files via an external SFTP tool (i.e. no internal Perl implementation is used).

This JobMode is based on automated file transfers, which requires the setup of public/private key authentication without a password (cue: ssh-keygen -t rsa).

A connection to <TransShare> is established and the directory <TransWorkDir> is changed into. All files matching the pattern <TransFileNameMask> are copied into a temporary directory and file sizes are verified with an expected size. Successfully received files are moved into <DataInputPath> and deleted in the remote location.

If the parameter <TransTimeStampCheckDir> is set, a directory with this name is created in the remote location to obtain the time from this remote system. This allows handling files with a minimum age based on <LastModificationTime>.

Example configuration for sftp://sysadm@53.113.173.116:/cache/input

TransBinary        = /bin/sftp
TransUserName      = sysadm
TransShare         = 53.113.173.116
TransWorkDir       = /cache/input
TransFileNameMask  = [0-9]+\.<IndexFileExtension>
TransAcceptLogFile = <ColdLogsBaseDirectory>/<SpoolType>/trans_<SpoolType>.log
LastModificationTime = 0.007
TransTimeStampCheckDir = timestamp<SpoolType>