Scope
- This documentation explains how to download and compile the sources for the JobScheduler Engine and all its components.
In case that you wanted to build exclusively YADE, see How to build YADE from the sources. - The sources have to be downloaded from the Git repositories. JobScheduler is available from https://github.com/sos-berlin
- Additional tools will be referenced in this documentation if required to compile the sources.
Prerequisites
As mentioned above, additional tools have to be downloaded and configured following the below order:
Git
- You can find the Git download and documentation here.
- SOS uses Git 1.7.9.2. You can download the latest release from here.
Java
- To compile individual JobScheduler releases, different Java versions are required:
- SOS uses the 1.8.0_74 build of the Java JDK to build JobScheduler release 1.9.0 and above.
- To compile the
scheduler-engine
for the correct target platform:- check if the system variable
$JAVA_HOME
is set to the installation path of your JDK installation. - check if
$JAVA_HOME/bin
is in your$PATH
global variable.
- check if the system variable
Maven
- You can find the Maven documentation here.
- SOS uses Maven 3.3.9. You can download the latest Release from here.
- Maven's
/bin
folder has to be added to the global variablePATH
in order to take effect. - No further configuration is required for Maven in order to compile. If further configuration is wanted, for example to receive certain 3rd Party libraries from an official Maven2 repository, e.g. http://repo1.maven.org/maven2, then you have to configure the settings.xml file.
Perl
- Perl 5, starting from 5.12.
- You can find the downloads here.
- No further configuration is required for Perl.
C++ Compiler
Set up a development environment for Linux. You will need the following packages:
gcc
- GNU Compiler, starting from version 4.8.5- zlib-devel
- binutils (version corresponding to
gcc
)
Download from the Source Repositories
Prepare a folder in your file system where you can clone the repositories to and change into this folder.
Repository for the JobScheduler Engine Documentation
Execute the following command:
git clone git@github.com:sos-berlin/scheduler-engine-doc.git
to download the project "scheduler-engine-doc
" into the folder.
Repository for the JobScheduler Engine
Execute the following command in your Git Shell:
git clone git@github.com:sos-berlin/scheduler-engine.git
to download the project "scheduler-engine
".
Hint
After you download the project "all" and all its submodules, the submodules are in a state called "detached Head", which means that references to the submodules point to a commit, which is not the latest in the current branch. To make sure to point to the latest commit of the current branch execute the following commands in your Git Shell:
git checkout origin/master git submodule foreach "git checkout origin/master"
in which master
is the name of the local branch and origin/master
is the name of the remote branch with the latest development version of the components. Other available branches are e.g. release/1.9
, release/1.8
, release/1.7
.
Downloading a released version
To be able to build an already released version (e.g. release 1.10.3) you check out the tag like that:
git checkout v1.10.3 git submodule foreach "git checkout v1.10.3"
To be able to build a non-released version or a release under construction (e.g. release 1.10.4) you check out the branch like this:
git checkout release/1.10 git submodule foreach "git checkout release/1.10"
Building the Projects
Preparation
Before you can start to build the projects you have to make sure that some required libraries are available for the build, which are not available from official public Maven repositories.
You can download the jar files and have to publish them to your local Maven repository in order to make these libraries available for the build.
The libraries to download are:
ojdbc6
webdavclient4j-core
- hostware (or use the version from an existing JobScheduler (x86) installation)
To publish these libraries to your local Maven repository ( $HOME/.m2/
) use the goal install-file
from the maven-install-plugin
.
Command for ojdbc6:
mvn org.apache.maven.plugins:maven-install-plugin:2.3.1:install-file -DgroupId=com.oracle -DartifactId=ojdbc6 -Dversion=11.1.0.7.0-Production -Dpackaging=jar -Dfile=<path-to-the-downloaded-library>/ojdbc6.jar -DlocalRepositoryPath=<path-to-your-local-maven-repository>
Command for webdavclient4j-core:
mvn org.apache.maven.plugins:maven-install-plugin:2.3.1:install-file -DgroupId=webdavclient4j -DartifactId=webdavclient4j-core -Dversion=0.92 -Dpackaging=jar -Dfile=<path-to-the-downloaded-library>/webdavclient4j-core-0.92.jar -DlocalRepositoryPath=<path-to-your-local-maven-repository>
Command for hostware:
mvn org.apache.maven.plugins:maven-install-plugin:2.3.1:install-file -DgroupId=sos -DartifactId=hostware -Dversion=1.0.0 -Dpackaging=jar -Dfile=<path-to-the-downloaded-library>/hostware-1.0.0.jar -DlocalRepositoryPath=<path-to-your-local-maven-repository>
The values for groupId, artifactId
and version
parameters in the above examples are those that are already defined in the build configuration. When publishing the libraries with these values, the libraries will be found in your local Maven repository and can be used without modifying the configuration.
Build order
Since the projects depend on each other, you have to make sure that the projects are built in the proper order:
scheduler-engine-doc
scheduler-engine
Compile the JobScheduler Engine Documentation
Switch to the folder you have downloaded the scheduler-engine-doc
project into, which might look like <PATH_TO_MY_GIT_REPOS>/scheduler-engine-doc
.
Type mvn clean install
on the command line for building the project including all internal tests - these are tests developed by SOS that check the functionalities of the compiled sources. To compile without the tests, compile it the following way: mvn clean install -DskipTests.
Compile the JobScheduler Engine
Switch to the folder you have downloaded the scheduler-engine
project to, which might look like <PATH_TO_MY_GIT_REPOS>/scheduler-engine.
Type the Maven command for installing on the command line for building the project including all internal tests - these are tests developed by SOS that check the functionalities of the compiled sources:
mvn clean install -Psolaris
In order to check if JobScheduler can be compiled, you can use a first compilation without tests, use the following command:
mvn clean install -Psolaris -DskipTests
In order to compile with tests completely even though some tests failed, use the following command:
mvn clean install -Psolaris -D maven.test.failure.ignore=true | tee maven.log
This last command after the pipe "tee maven.log" will write a log file in order to see which tests failed when compiling.
Generated libraries location
After the build has completed you find all created .jar
files in
- the target folder under each project and subproject.
- the local ./m2 repository in your home folder (
$HOME/.m2/repository/com/sos-berlin
)
At this point you already have all the library files to update an exisiting JobScheduler installation in your system.
You can find the specific libraries for the different platform in the target folder of the engine-setup:
./scheduler-engine/engine-setup/target/setup/scheduler.linux-***/bin
scheduler
./scheduler-engine/engine-setup/target/setup/scheduler.linux-***/lib
Support
Commercial License
If you purchased a Commercial License with the Service Request Support Option, then the build process will be supported by our Support Team should you face problems. The applicable service level is the same as for severity level "minor", see Product Maintenance.
Open Source License
If you use the Open Source License then the build process will be supported by using our Community Resources. A forum for build issues is available at SourceForge, see Build Process Forum
Troubleshooting
Error: "File zlib-xxx was not found
"