Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
outlinh1. true
outlinh1. true
1printablefalse
2stylh1. none
3indent20px

Server-to-Server File Transfer without touchdown

File Transfer Schema

Graphviz
 digraph "Example: Server -to-Server ServerFile Transfer" {
rankdir=LR;

edge [color="#31CEF0"];

source_server [label="Data Source (sFTP)"];
target_server  [label="Data Target (FTP)"];
jadeyade_client  [label="JADEYADE Client \n API \n JITL Job"];
jadeyade_config [label="JADEYADE Configuration"];

source_server->target_server [label="data transfer"];
source_server->jade>yade_client  [dir=both label="commands" color="grey"];
source_server->jade>yade_client  [dir=both label="polling" color="blue"];
jadeyade_client->target_server  [dir=both label="commands"  color="grey"];
jadeyade_config->jade>yade_client [color="green"];

}

Configuration Example

A profile definition for Server-to-Server transferFile Transfer, from SFTP to FTP:

Code Block
languagetext
 [ftp_server_2_server_with_polling]
 ssh_auth_method=password
 
 source_user            = kb
 source_password        = *****
 source_ssh_auth_method = password
 source_host            = wilma.sos
 source_protocol        = sftp
 source_port            = 22
 
 target_user            = test
 target_password        = *****
 target_host            = 8of9.sos
 target_protocol        = ftp
 target_port            = 21
 
 file_spec              = ^.*\.txt$
 operation              = copy

  poll_interval         = 60
  poll_minfiles         = 1
  poll_timeout          = 0
 
 log_filename=$\{TEMP\}/sosftphistory.log

In this example all files with the file name extension .txt should be transferred from the server wilma via SFTP to the server 8of9 by FTP. JADE YADE will do the polling on the source server for specific files.

...

Code Block
languagebash
 jade.sh -settings=name_of_settings_file -profile=ftp_server_2_server_with_polling

To make the profile more reusable and more readable it is possible to organize profiles in a way by fragments like this:

Code Block
 [wilma_as_source]
 ssh_auth_method=password
 
 source_user            = kb
 source_password        = *****
 source_ssh_auth_method = password
 source_host            = wilma.sos
 source_protocol        = sftp
 source_port            = 22

 [8of9_as_target]
 target_user     = test
 target_password = *****
 target_host     = 8of9.sos
 target_protocol = ftp
 target_port     = 21

 [globals]
 log_filename    = ${TEMP}/sosftphistory.log

 [globals_polling]
  poll_interval  = 60
  poll_minfiles  = 1
  poll_timeout   = 0

The profiles profile fragments for wilma as source and 8of9 as target are defined once. They could be used as many times as needed. There is a globals profile as well.

Now we will specify the profile againusing fragments:

Code Block
languagetext
 [ftp_server_2_server_with_polling]
 include        = globals , globals_polling
 source_include = wilma_as_source
 target_include = 8of9_as_target
 operation      = move
 file_spec      = ^.*\.txt$
   
 [ftp_more]
 include        = wilma_as_source,8of9_as_target
 operation      = move
 file_spec      = ^.*\.(txt|pdf|dat)$
 source_folder  = /outbound/daily
 target_folder  = /inbound/transfer

The include parameter will include the named profile snippets in the order they are defined. The globals profile is included automatically, no need to specifiy it in an include parameter.
The profiles have to be defined in the same settings file.

See also