You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 34 Next »

Server to Server Transfer (S2S) is unique key feature of JADE. It provides the possibility of setting up a number of transfers using a Single Sever, without installing clients/agents on each source/target server.

JADE Implementation Architecture

JADE Implementation Architecture Details

JADE has the following main components:

  1. CLI (Command Line Interface) executed on shell level
  2. User Application (API)
  3. JITL scheduling component of JADE
  4. JADE Engine
  5. Options Engine
  6. JADE Engine Interface
  7. VFS (Virtual File System) Interface (Data Provider)
    • FTP
    • SFTP
    • FTPS
    • WebDAV
    • CIFS
    • Local (native copy)

JADE Server-to-Server Data Transfer

Warning: : syntax error in line 1 near '>'

JADE can transfer data using an intermediate server from a Source Server to Target Server (S2S) without touchdown on an intermediate server.

S2S implementation details:

  1. JADE uses "Streams" (or in common terminology: Pipe) to transfer data from Source to Target.
  2. JADE opens an input stream from source server and output stream to target server.
  3. JADE can use different Data Provider as Source and Target for S2S operation.
  4. By default JADE transfer 32Kb chunks from input to output stream. One can increase the buffer size by setting the buffer_size parameter, but a larger buffer size may not result in a higher transfer speed.
  5. JADE can process the content of the buffer between source and target transfer. By doing In-Memory operations, even for multistage processing,JADE dramatically improves the transfer speed.
    1. Calculate Hashes
    2. Reserved for further development
      1. Filtering
      2. Encoding/Decoding
      3. Encryption/Decryption
  6. JADE transfers data from the Source Server to the Target Server without "Touchdown" meaning that during transfer data is never written to the file system on intermediate server (where JADE is running). JADE's key unique feature is "In-Memory" transfer. During transfer JADE does not copy any data to the memory, but only chunks, whose size is defined with the buffer_size parameter.

For more information about JADE Server to Server Transfer configuration see JADE server to server transfer

JADE has a generic implementation for Virtual file Systems or Data Providers, which make it easy to implement new protocols.

  • No labels