Atlassian uses cookies to improve your browsing experience, perform analytics and research, and conduct advertising. Accept all cookies to indicate that you agree to our use of cookies on your device.
Atlassian uses cookies to improve your browsing experience, perform analytics and research, and conduct advertising. Accept all cookies to indicate that you agree to our use of cookies on your device. Atlassian cookies and tracking notice, (opens new window)
We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup.
Note that you can EITHER use the script below to install Java and all the requirements dependencies OR install manually Java and the dependencies as explained into the page.
Then launch the script with this command (you need to be logged in as root):
source init_datafari_7_x_dependencies.sh
This script will install Java, all the dependencies needed and will set the open files limit configuration. You have the details of all that the script does by looking at OPTION 2 below.
You can also choose to install only dependencies and not Java by using parameter nojava when running the script :
source init_datafari_7_x_dependencies.sh nojava
OPTION 2 - DOING IT MANUALLY (RISKIER)
OS requirements
Debian 13 (Trixie), or Ubuntu 26.04 (Resolute) Environment 64 bits (a Docker image is available if you are on Windows environment) (available both for Datafari CE or Datafari EE).
CentOS or RedHat 10 and CentOS Stream 10 or Almalinux 10 (available only for Datafari EE)
Java requirements
Java version 21 only mandatory installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH, see the annex below to view how to do it)
Dependences requirements
Depending on your OS, the list is not the same.
For Debian/Ubuntu users :
apt-get install wget curl jq debconf python3 python-is-python3 sudo vim nano netcat libc6-dev unzip lsof procps apache2 libapache2-mod-jk nftables systemd zip procps iputils-ping bc netcat-openbsd libaprutil1-dbd-pgsql libpq5 -y
Optional: You need a user member of the sudo group to start Datafari (or it can be root user) :
visudo
# add the line below root ALL=(ALL:ALL) ALL
your_user ALL=NOPASSWD: ALL
Optional: Make sure that the machine is always up to date (in particular for the email alerts scheduler), by enabling ntpdate, for example :
ntpdate 0.fr.pool.ntp.org
ANNEXES
Set JAVA_HOME variable
# For example if you want Eclipse Temurin JDK 21 in Debian 12
apt install -y wget apt-transport-https gpg
wget -qO - https://packages.adoptium.net/artifactory/api/gpg/key/public | gpg --dearmor | tee /etc/apt/trusted.gpg.d/adoptium.gpg > /dev/null
echo "deb https://packages.adoptium.net/artifactory/deb $(awk -F= '/^VERSION_CODENAME/{print$2}' /etc/os-release) main" | tee /etc/apt/sources.list.d/adoptium.list
apt-get update
apt install temurin-21-jdk
# Set Java Home
echo 'export JAVA_HOME=/usr/lib/jvm/temurin-21-jdk' >> /etc/profile
echo 'export PATH=$PATH:$JAVA_HOME/bin' >> /etc/profile
# Load the file
source /etc/profile
Troubleshooting for setting the locale If you still have an error like "perl: warning: Setting locale failed." Do the additionnal steps : check the sshd configuration :
nano /etc/ssh/sshd_config
and comment the line :
#AcceptEnv LANG LC_*
Then relaunch the sshd service :
/etc/init.d/ssh restart
Add the locale variables to .bashrc configuration file :
We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup.
Note that you can EITHER use the script below to install Java and all the requirements dependencies OR install manually Java and the dependencies as explained into the page.
Then launch the script with this command (you need to be logged in as root):
source init_datafari_7_x_dependencies.sh
This script will install Java, all the dependencies needed and will set the open files limit configuration. You have the details of all that the script does by looking at OPTION 2 below.
You can also choose to install only dependencies and not Java by using parameter nojava when running the script :
source init_datafari_7_x_dependencies.sh nojava
OPTION 2 - DOING IT MANUALLY (RISKIER)
OS requirements
Debian 13 (Trixie), or Ubuntu 24.04 (Numbat) Environment 64 bits (a Docker image is available if you are on Windows environment) (available both for Datafari CE or Datafari EE). NB : Ubuntu 26.04 (Resolute) is not yet supported, if you are into Ubuntu you have to use Ubuntu 24.04 only, otherwise Datafari will not work.
CentOS or RedHat 9 and CentOS Stream 9 or Almalinux 9 (available only for Datafari EE)
Java requirements
Java version 21 only mandatory installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH, see the annex below to view how to do it)
Dependences requirements
Depending on your OS, the list is not the same.
For Debian/Ubuntu users :
apt-get install wget curl jq debconf python3 python-is-python3 sudo vim nano netcat libc6-dev unzip lsof procps apache2 libapache2-mod-jk nftables systemd zip procps iputils-ping bc netcat-openbsd libaprutil1-dbd-pgsql libpq5 -y
Optional: You need a user member of the sudo group to start Datafari (or it can be root user) :
visudo
# add the line below root ALL=(ALL:ALL) ALL
your_user ALL=NOPASSWD: ALL
Optional: Make sure that the machine is always up to date (in particular for the email alerts scheduler), by enabling ntpdate, for example :
ntpdate 0.fr.pool.ntp.org
ANNEXES
Set JAVA_HOME variable
# For example if you want Eclipse Temurin JDK 21 in Debian 12
apt install -y wget apt-transport-https gpg
wget -qO - https://packages.adoptium.net/artifactory/api/gpg/key/public | gpg --dearmor | tee /etc/apt/trusted.gpg.d/adoptium.gpg > /dev/null
echo "deb https://packages.adoptium.net/artifactory/deb $(awk -F= '/^VERSION_CODENAME/{print$2}' /etc/os-release) main" | tee /etc/apt/sources.list.d/adoptium.list
apt-get update
apt install temurin-21-jdk
# Set Java Home
echo 'export JAVA_HOME=/usr/lib/jvm/temurin-21-jdk' >> /etc/profile
echo 'export PATH=$PATH:$JAVA_HOME/bin' >> /etc/profile
# Load the file
source /etc/profile
Troubleshooting for setting the locale If you still have an error like "perl: warning: Setting locale failed." Do the additionnal steps : check the sshd configuration :
nano /etc/ssh/sshd_config
and comment the line :
#AcceptEnv LANG LC_*
Then relaunch the sshd service :
/etc/init.d/ssh restart
Add the locale variables to .bashrc configuration file :
We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup.
Note that you can EITHER use the script below to install Java and all the requirements dependencies OR install manually Java and the dependencies as explained into the page.
Then launch the script with this command (you need to be logged in as root):
source init_datafari_6_2_dependencies.sh
This script will install Java, all the dependencies needed and will set the open files limit configuration. You have the details of all that the script does by looking at OPTION 2 below.
You can also choose to install only dependencies and not Java by using parameter nojava when running the script :
source init_datafari_6_2_dependencies.sh nojava
OPTION 2 - DOING IT MANUALLY (RISKIER)
OS requirements
Debian 12 (Bookworm), or Ubuntu 22.04 (Jammy) Environment 64 bits (a Docker image is available if you are on Windows environment) (available both for Datafari CE or Datafari EE) (Ubuntu 24.04 is not supported for now because of an issue with the default version of Python installed into this OS (3.12) and Cassandra, see https://gitlab.datafari.com/datafari-community/datafari/-/issues/1007)
CentOS or RedHat 9 and CentOS Stream 9 (available only for Datafari EE)
Java requirements
Java version 11 only mandatory installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH, see the annex below to view how to do it)
Optional: You need a user member of the sudo group to start Datafari (or it can be root user) :
visudo
# add the line below root ALL=(ALL:ALL) ALL
your_user ALL=NOPASSWD: ALL
Optional: Make sure that the machine is always up to date (in particular for the email alerts scheduler), by enabling ntpdate, for example :
ntpdate 0.fr.pool.ntp.org
ANNEXES
Set JAVA_HOME variable
# For example if you want OpenJDK JDK 11 in Debian 10
apt-get install openjdk-11-jdk
# Set Java Home
nano /etc/profile
#in the file add the line :
export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64
# Load the file
source /etc/profile
Troubleshooting for setting the locale If you still have an error like "perl: warning: Setting locale failed." Do the additionnal steps : check the sshd configuration :
nano /etc/ssh/sshd_config
and comment the line :
#AcceptEnv LANG LC_*
Then relaunch the sshd service :
/etc/init.d/ssh restart
Add the locale variables to .bashrc configuration file :
We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup.
Note that you can EITHER use the script below to install Java and all the requirements dependencies OR install manually Java and the dependencies as explained into the page.
OPTION 1 - USING THE SCRIPT
Download script to install Java and dependencies
You can download an init script (.sh) for Datafari :
Then launch the script with this command :
source init_datafari_6_dependencies.sh
This script will install Java, all the dependencies needed and will set the open files limit configuration. You have the details of all that the script does by looking at OPTION 2 below.
OPTION 2 - DOING IT MANUALLY (RISKIER)
OS requirements
Debian 12 (Bookworm), or Ubuntu 22.04 (Jammy) Environment 64 bits (a Docker image is available if you are on Windows environment) (available both for Datafari CE or Datafari EE) (Ubuntu 24.04 is not supported for now because of an issue with the default version of Python installed into this OS (3.12) and Cassandra, see https://gitlab.datafari.com/datafari-community/datafari/-/issues/1007)
CentOS or RedHat 8 or 9 and CentOS Stream 8 or 9 (available only for Datafari EE)
Java requirements
Java version 11 only mandatory installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH, see the annex below to view how to do it)
Optional: You need a user member of the sudo group to start Datafari (or it can be root user) :
visudo
# add the line below root ALL=(ALL:ALL) ALL
your_user ALL=NOPASSWD: ALL
Optional: Make sure that the machine is always up to date (in particular for the email alerts scheduler), by enabling ntpdate, for example :
ntpdate 0.fr.pool.ntp.org
ANNEXES
Set JAVA_HOME variable
# For example if you want OpenJDK JDK 11 in Debian 10
apt-get install openjdk-11-jdk
# Set Java Home
nano /etc/profile
#in the file add the line :
export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64
# Load the file
source /etc/profile
Troubleshooting for setting the locale If you still have an error like "perl: warning: Setting locale failed." Do the additionnal steps : check the sshd configuration :
nano /etc/ssh/sshd_config
and comment the line :
#AcceptEnv LANG LC_*
Then relaunch the sshd service :
/etc/init.d/ssh restart
Add the locale variables to .bashrc configuration file :
Valid from 5.5.1 The documentation below is valid from Datafari v5.5.1 upwards Looking for hardware requirements ? See We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup. For all installations of Datafari : OS requirements : Debian 11 (Bullseye) or 12, or Ubuntu 20.04 (Focal) or 22.04 (Jammy) Environment 64 bits (a Docker image is available if you are on Windows environment) (available both for Datafari CE or Datafari EE) CentOS or RedHat 8 or 9 and CentOS Stream 8 or 9 (available only for Datafari EE) Recommended versions are Debian 12 or Ubuntu Jammy Download dependencies scripts You can download an init script (.sh) for Datafari : For Debian or Ubuntu users : For RedHat or CentOs users : You can launch the script with this command : source init_server_datafari.sh => It will install all the needed dependencies and increase the open files limit configuration. Debian/Ubuntu installation This part of the documentation is for Debian/Ubuntu users, if you are on CentOS please go to the next section. You need to have a Java JDK 11 (the JDK is mandatory if you use ELK, otherwise JRE is sufficient) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile : # For example if you want OpenJDK JDK 11 in Debian 10
apt-get install openjdk-11-jdk
# Set Java Home
nano /etc/profile
#in the file add the line :
export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64
# Load the file
source /etc/profile For now, Java 11 is the only version of Java supported by Datafari On Debian 9 you have to add this prior to the installation of Java : echo 'deb http://ftp.debian.org/debian stretch-backports main' | sudo tee /etc/apt/sources.list.d/stretch-backports.list
apt-get update Mandatory dependencies : apt-get install bash curl debconf unzip sudo libc6-dev jq lsof apache2 libapache2-mod-jk iptables iptables-persistent zip iputils-ping systemd procps bc -y -q Python is supported in version 2.7+ or 3+. Centos/RedHat installation You need to have a Java JDK 11 (the JDK is mandatory if you use ELK, otherwise JRE is sufficient) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile : yum update -y
echo "install java"
yum install java-11-openjdk-devel -y
echo 'export JAVA_HOME=/usr/lib/jvm/java-11' >> /etc/profile
source /etc/profile yum install python3 -y
alternatives --set python /usr/bin/python3
update-alternatives --install /usr/bin/python python /usr/bin/python3 1
yum install centos-release-scl -y
yum install epel-release -y
yum install sclo-cassandra3-jffi -y
yum install jq -y
yum install lsof -y
yum groupinstall "Development tools" -y
yum install curl -y
yum install perl-Test-Simple perl-version perl-Data-Dumpe -y
yum install httpd -y
yum install mod_ssl -y
yum install libapache2-mod-jk
yum install nano -y
yum install iptables-services -y
yum install nc -y
yum install iputils -y
yum install unzip -y
yum install bc -y In the Datafari 5.0 version on Centos version only, only Python 2.7 version is supported. For all Operating Systems You need a user member of the sudo group to start Datafari (or it can be root user) : visudo
# add the line below root ALL=(ALL:ALL) ALL
your_user ALL=NOPASSWD: ALL Increase Open Files limit configuration Change the setting in /etc/security/limits.conf : echo 'root soft nofile 100000' >> /etc/security/limits.conf
echo 'root hard nofile 100000' >> /etc/security/limits.conf
echo 'datafari soft nofile 100000' >> /etc/security/limits.conf
echo 'datafari hard nofile 100000' >> /etc/security/limits.conf
echo '* soft nofile 100000' >> /etc/security/limits.conf
echo '* hard nofile 100000' >> /etc/security/limits.conf
echo 'root soft nproc 100000' >> /etc/security/limits.conf
echo 'root hard nproc 100000' >> /etc/security/limits.conf
echo 'datafari soft nproc 100000' >> /etc/security/limits.conf
echo 'datafari hard nproc 100000' >> /etc/security/limits.conf
echo '* soft nproc 100000' >> /etc/security/limits.conf
echo '* hard nproc 100000' >> /etc/security/limits.conf Then reboot the machine to enable those parameters Make sure that the machine is always uptodate (in particular for the email alerts scheduler), by enabling: ntpdate 0.fr.pool.ntp.org Set the locale setting (in the example with fr_FR but can be replaced with your locale) : apt-get install locales
locale-gen fr_FR.UTF-8
dpkg-reconfigure locales If you still have an error like "perl: warning: Setting locale failed."
Do the additionnal steps :
check the sshd configuration : nano /etc/ssh/sshd_config and comment the line : #AcceptEnv LANG LC_* Then relaunch the sshd service : /etc/init.d/ssh restart Add the locale variables to .bashrc configuration file : nano ~/.bashrc Add the lines : export LC_ALL="fr_FR.UTF-8"
export LANG="fr_FR.UTF-8"
export LANGUAGE="fr_FR.UTF-8" For PostgreSQL :
PostgreSQL needs to have the variables LANG and LC_* set. To check them, launch the command : locale If LC_ALL and LC_TYPE are not filled, enter this (for English language): export LC_ALL="en_US.UTF-8"
export LC_CTYPE="en_US.UTF-8" You can also add the line to /etc/profile then. For OS X users : if you obtain the message : Cannot set LC_CTYPE to default locale: No such file or directory when you launch locale command, it might be because your terminal automatically sets environment variables when you log in from Mac to a Linux server : see . To turn if off, uncheck the checkbox here : In iTerm it is in the profile -> Terminal tab. In Terminal, it is in the Terminal -> Preferences -> Profiles -> Advanced tab Set the timezone if needeed :
Check the local zonetime that matches your region in /usr/share/zoneinfo. Then create a symlink from /etc/localtime (example here with Paris time) : sudo rm /etc/localtime
sudo ln -s /usr/share/zoneinfo/Europe/Paris /etc/localtime
Valid from 5.5 The documentation below is valid for Datafari v5.5 only Looking for hardware requirements ? See We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup. For all installations of Datafari : OS requirements : Debian 10 (Buster) or 11 (Bullseye), or Ubuntu 20.04 (Focal) or 22.04 (Jammy) Environment 64 bits (a Docker image is available if you are on Windows environment) (available both for Datafari CE or Datafari EE) CentOS or RedHat 7, 8 or 9 and CentOS Stream 7, 8 or 9 (available only for Datafari EE) Recommended versions are Debian 11 or Ubuntu Jammy Download dependencies scripts You can download an init script (.sh) for Datafari : For Debian or Ubuntu users : For RedHat or CentOs users : You can launch the script with this command : source init_server_datafari.sh => It will install all the needed dependencies and increase the open files limit configuration. Debian/Ubuntu installation This part of the documentation is for Debian/Ubuntu users, if you are on CentOS please go to the next section. You need to have a Java JDK 11 (the JDK is mandatory if you use ELK, otherwise JRE is sufficient) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile : # For example if you want OpenJDK JDK 11 in Debian 10
apt-get install openjdk-11-jdk
# Set Java Home
nano /etc/profile
#in the file add the line :
export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64
# Load the file
source /etc/profile For now, Java 11 is the only version of Java supported by Datafari On Debian 9 you have to add this prior to the installation of Java : echo 'deb http://ftp.debian.org/debian stretch-backports main' | sudo tee /etc/apt/sources.list.d/stretch-backports.list
apt-get update Mandatory dependencies : apt-get install curl debconf unzip sudo libc6-dev jq lsof apache2 openssl libapache2-mod-jk iptables iptables-persistent python zip Python is supported in version 2.7+ or 3+. Centos/RedHat installation You need to have a Java JDK 11 (the JDK is mandatory if you use ELK, otherwise JRE is sufficient) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile : yum update -y
echo "install java"
yum install java-11-openjdk-devel -y
echo 'export JAVA_HOME=/usr/lib/jvm/java-11' >> /etc/profile
source /etc/profile yum install centos-release-scl epel-release sclo-cassandra3-jffi python27
source /etc/profile
yum install jq lsof
yum groupinstall "Development tools"
yum install curl perl-Test-Simple perl-version perl-Data-Dumpe dpkg-devel dpkg-dev httpd mod_ssl iptables-services nc zip In the Datafari 5.0 version on Centos version only, only Python 2.7 version is supported. For all Operating Systems You need a user member of the sudo group to start Datafari (or it can be root user) : visudo
# add the line below root ALL=(ALL:ALL) ALL
your_user ALL=NOPASSWD: ALL Increase Open Files limit configuration Change the setting in /etc/security/limits.conf : echo 'root soft nofile 100000' >> /etc/security/limits.conf
echo 'root hard nofile 100000' >> /etc/security/limits.conf
echo 'datafari soft nofile 100000' >> /etc/security/limits.conf
echo 'datafari hard nofile 100000' >> /etc/security/limits.conf
echo '* soft nofile 100000' >> /etc/security/limits.conf
echo '* hard nofile 100000' >> /etc/security/limits.conf
echo 'root soft nproc 100000' >> /etc/security/limits.conf
echo 'root hard nproc 100000' >> /etc/security/limits.conf
echo 'datafari soft nproc 100000' >> /etc/security/limits.conf
echo 'datafari hard nproc 100000' >> /etc/security/limits.conf
echo '* soft nproc 100000' >> /etc/security/limits.conf
echo '* hard nproc 100000' >> /etc/security/limits.conf Then reboot the machine to enable those parameters Make sure that the machine is always uptodate (in particular for the email alerts scheduler), by enabling: ntpdate 0.fr.pool.ntp.org Set the locale setting (in the example with fr_FR but can be replaced with your locale) : apt-get install locales
locale-gen fr_FR.UTF-8
dpkg-reconfigure locales If you still have an error like "perl: warning: Setting locale failed."
Do the additionnal steps :
check the sshd configuration : nano /etc/ssh/sshd_config and comment the line : #AcceptEnv LANG LC_* Then relaunch the sshd service : /etc/init.d/ssh restart Add the locale variables to .bashrc configuration file : nano ~/.bashrc Add the lines : export LC_ALL="fr_FR.UTF-8"
export LANG="fr_FR.UTF-8"
export LANGUAGE="fr_FR.UTF-8" For PostgreSQL :
PostgreSQL needs to have the variables LANG and LC_* set. To check them, launch the command : locale If LC_ALL and LC_TYPE are not filled, enter this (for English language): export LC_ALL="en_US.UTF-8"
export LC_CTYPE="en_US.UTF-8" You can also add the line to /etc/profile then. For OS X users : if you obtain the message : Cannot set LC_CTYPE to default locale: No such file or directory when you launch locale command, it might be because your terminal automatically sets environment variables when you log in from Mac to a Linux server : see . To turn if off, uncheck the checkbox here : In iTerm it is in the profile -> Terminal tab. In Terminal, it is in the Terminal -> Preferences -> Profiles -> Advanced tab Set the timezone if needeed :
Check the local zonetime that matches your region in /usr/share/zoneinfo. Then create a symlink from /etc/localtime (example here with Paris time) : sudo rm /etc/localtime
sudo ln -s /usr/share/zoneinfo/Europe/Paris /etc/localtime
Valid from 5.3 The documentation below is valid from Datafari v5.3 upwards Looking for hardware requirements ? See We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup. For all installations of Datafari : OS requirements : Debian 10 (Buster) or 11 (Bullseye) or Ubuntu 20.04 (Focal) or 22.04 (Jammy) Environment 64 bits (a Docker image is available if you are on Windows environment) CentOS or RedHat 7 and CentOS Stream 8 (only for Datafari EE) Recommended version are Debian 11 or Ubuntu Jammy Download dependencies scripts You can download an init script (.sh) for Datafari : For Debian or Ubuntu users : For RedHat or CentOs users : You can launch the script with this command :
source init_server_datafari.sh => It will install all the needed dependencies and increase the open files limit configuration. Debian/Ubuntu installation This part of the documentation is for Debian/Ubuntu users, if you are on CentOS please go to the next section. You need to have a Java JDK 11 (the JDK is mandatory if you use ELK, otherwise JRE is sufficient) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile : # For example if you want OpenJDK JDK 11 in Debian 10
apt-get install openjdk-11-jdk
# Set Java Home
nano /etc/profile
#in the file add the line :
export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64
# Load the file
source /etc/profile For now, Java 11 is the only version of Java supported by Datafari On Debian 9 you have to add this prior to the installation of Java : echo 'deb http://ftp.debian.org/debian stretch-backports main' | sudo tee /etc/apt/sources.list.d/stretch-backports.list
apt-get update Mandatory dependencies : apt-get install curl debconf unzip sudo libc6-dev jq lsof apache2 openssl libapache2-mod-jk iptables iptables-persistent python zip Python is supported in version 2.7+ or 3+. Centos/RedHat installation You need to have a Java JDK 11 (the JDK is mandatory if you use ELK, otherwise JRE is sufficient) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile : yum update -y
echo "install java"
yum install java-11-openjdk-devel -y
echo 'export JAVA_HOME=/usr/lib/jvm/java-11' >> /etc/profile
source /etc/profile yum install centos-release-scl epel-release sclo-cassandra3-jffi python27
source /etc/profile
yum install jq lsof
yum groupinstall "Development tools"
yum install curl perl-Test-Simple perl-version perl-Data-Dumpe dpkg-devel dpkg-dev httpd mod_ssl iptables-services nc zip In the Datafari 5.0 version on Centos version only, only Python 2.7 version is supported. For all Operating Systems You need a user member of the sudo group to start Datafari (or it can be root user) : visudo
# add the line below root ALL=(ALL:ALL) ALL
your_user ALL=NOPASSWD: ALL Increase Open Files limit configuration Change the setting in /etc/security/limits.conf : echo 'root soft nofile 100000' >> /etc/security/limits.conf
echo 'root hard nofile 100000' >> /etc/security/limits.conf
echo 'datafari soft nofile 100000' >> /etc/security/limits.conf
echo 'datafari hard nofile 100000' >> /etc/security/limits.conf
echo '* soft nofile 100000' >> /etc/security/limits.conf
echo '* hard nofile 100000' >> /etc/security/limits.conf
echo 'root soft nproc 100000' >> /etc/security/limits.conf
echo 'root hard nproc 100000' >> /etc/security/limits.conf
echo 'datafari soft nproc 100000' >> /etc/security/limits.conf
echo 'datafari hard nproc 100000' >> /etc/security/limits.conf
echo '* soft nproc 100000' >> /etc/security/limits.conf
echo '* hard nproc 100000' >> /etc/security/limits.conf Then reboot the machine to enable those parameters Make sure that the machine is always uptodate (in particular for the email alerts scheduler), by enabling: ntpdate 0.fr.pool.ntp.org Set the locale setting (in the example with fr_FR but can be replaced with your locale) : apt-get install locales
locale-gen fr_FR.UTF-8
dpkg-reconfigure locales If you still have an error like "perl: warning: Setting locale failed."
Do the additionnal steps :
check the sshd configuration : nano /etc/ssh/sshd_config and comment the line : #AcceptEnv LANG LC_* Then relaunch the sshd service : /etc/init.d/ssh restart Add the locale variables to .bashrc configuration file : nano ~/.bashrc Add the lines : export LC_ALL="fr_FR.UTF-8"
export LANG="fr_FR.UTF-8"
export LANGUAGE="fr_FR.UTF-8" For PostgreSQL :
PostgreSQL needs to have the variables LANG and LC_* set. To check them, launch the command : locale If LC_ALL and LC_TYPE are not filled, enter this (for English language): export LC_ALL="en_US.UTF-8"
export LC_CTYPE="en_US.UTF-8" You can also add the line to /etc/profile then. For OS X users : if you obtain the message : Cannot set LC_CTYPE to default locale: No such file or directory when you launch locale command, it might be because your terminal automatically sets environment variables when you log in from Mac to a Linux server : see . To turn if off, uncheck the checkbox here : In iTerm it is in the profile -> Terminal tab. In Terminal, it is in the Terminal -> Preferences -> Profiles -> Advanced tab Set the timezone if needeed :
Check the local zonetime that matches your region in /usr/share/zoneinfo. Then create a symlink from /etc/localtime (example here with Paris time) : sudo rm /etc/localtime
sudo ln -s /usr/share/zoneinfo/Europe/Paris /etc/localtime
Valid from 5.0 to 5.2 The documentation below is valid from Datafari v5.0 upwards Looking for hardware requirements ? See We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup. For all installations of Datafari : OS requirements : Debian 9+ or Ubuntu 16+ Environment 64 bits (a Docker image is available if you are on Windows environment) CentOS or RedHat 7.0+ (only for Datafari EE) Recommended version is Debian 10 Download dependencies scripts You can download an init script (.sh) for Datafari : The scripts are attached to this page : https://datafari.atlassian.net/wiki/pages/viewpageattachments.action?pageId=110788634
init_server_datafari_5_debian_10.sh for Debian 10 users init_server_datafari_5_debian_9.sh for Debian 9 users init_server_datafari_5_centos.sh for Centos/RedHat users You can launch the script with this command :
source init_server_datafari.sh => It will install all the needed dependencies and increase the open files limit configuration. Debian/Ubuntu installation This part of the documentation is for Debian/Ubuntu users, if you are on CentOS please go to the next section. You need to have a Java JDK 11 (the JDK is mandatory if you use ELK, otherwise JRE is sufficient) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile : # For example if you want OpenJDK JDK 11 in Debian 10
apt-get install openjdk-11-jdk
# Set Java Home
nano /etc/profile
#in the file add the line :
export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64
# Load the file
source /etc/profile For now, Java 11 is the only version of Java supported by Datafari On Debian 9 you have to add this prior to the installation of Java : echo 'deb http://ftp.debian.org/debian stretch-backports main' | sudo tee /etc/apt/sources.list.d/stretch-backports.list
apt-get update Mandatory dependencies : apt-get install curl debconf unzip sudo libc6-dev jq lsof apache2 openssl libapache2-mod-jk iptables iptables-persistent python zip Python is supported in version 2.7+ or 3+. Centos/RedHat installation You need to have a Java JDK 11 (the JDK is mandatory if you use ELK, otherwise JRE is sufficient) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile : yum update -y
echo "install java"
yum install java-11-openjdk-devel -y
echo 'export JAVA_HOME=/usr/lib/jvm/java-11' >> /etc/profile
source /etc/profile yum install centos-release-scl epel-release sclo-cassandra3-jffi python27
source /etc/profile
yum install jq lsof
yum groupinstall "Development tools"
yum install curl perl-Test-Simple perl-version perl-Data-Dumpe dpkg-devel dpkg-dev httpd mod_ssl iptables-services nc zip In the Datafari 5.0 version on Centos version only, only Python 2.7 version is supported. For all Operating Systems You need a user member of the sudo group to start Datafari (or it can be root user) : visudo
# add the line below root ALL=(ALL:ALL) ALL
your_user ALL=NOPASSWD: ALL Increase Open Files limit configuration Change the setting in /etc/security/limits.conf : echo 'root soft nofile 100000' >> /etc/security/limits.conf
echo 'root hard nofile 100000' >> /etc/security/limits.conf
echo 'datafari soft nofile 100000' >> /etc/security/limits.conf
echo 'datafari hard nofile 100000' >> /etc/security/limits.conf
echo '* soft nofile 100000' >> /etc/security/limits.conf
echo '* hard nofile 100000' >> /etc/security/limits.conf
echo 'root soft nproc 100000' >> /etc/security/limits.conf
echo 'root hard nproc 100000' >> /etc/security/limits.conf
echo 'datafari soft nproc 100000' >> /etc/security/limits.conf
echo 'datafari hard nproc 100000' >> /etc/security/limits.conf
echo '* soft nproc 100000' >> /etc/security/limits.conf
echo '* hard nproc 100000' >> /etc/security/limits.conf Then reboot the machine to enable those parameters Make sure that the machine is always uptodate (in particular for the email alerts scheduler), by enabling: ntpdate 0.fr.pool.ntp.org Set the locale setting (in the example with fr_FR but can be replaced with your locale) : apt-get install locales
locale-gen fr_FR.UTF-8
dpkg-reconfigure locales If you still have an error like "perl: warning: Setting locale failed."
Do the additionnal steps :
check the sshd configuration : nano /etc/ssh/sshd_config and comment the line : #AcceptEnv LANG LC_* Then relaunch the sshd service : /etc/init.d/ssh restart Add the locale variables to .bashrc configuration file : nano ~/.bashrc Add the lines : export LC_ALL="fr_FR.UTF-8"
export LANG="fr_FR.UTF-8"
export LANGUAGE="fr_FR.UTF-8" For PostgreSQL :
PostgreSQL needs to have the variables LANG and LC_* set. To check them, launch the command : locale If LC_ALL and LC_TYPE are not filled, enter this (for English language): export LC_ALL="en_US.UTF-8"
export LC_CTYPE="en_US.UTF-8" You can also add the line to /etc/profile then. For OS X users : if you obtain the message : Cannot set LC_CTYPE to default locale: No such file or directory when you launch locale command, it might be because your terminal automatically sets environment variables when you log in from Mac to a Linux server : see https://askubuntu.com/a/778672. To turn if off, uncheck the checkbox here : In iTerm it is in the profile -> Terminal tab. In Terminal, it is in the Terminal -> Preferences -> Profiles -> Advanced tab Set the timezone if needeed :
Check the local zonetime that matches your region in /usr/share/zoneinfo. Then create a symlink from /etc/localtime (example here with Paris time) : sudo rm /etc/localtime
sudo ln -s /usr/share/zoneinfo/Europe/Paris /etc/localtime
Valid from 4.1 up to 5.0 excluded The documentation below is valid from Datafari v4.1.0 upwards
Looking for RAM config ? The allocation of RAM per software component is at the bottom of this page.
We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup.
Download dependencies scripts You can download an init script (.sh) for Datafari :
init_server_datafari.sh : for Debian users
You can launch the script with this command :
source init_server_datafari.sh => It will install all the needed dependencies and increase the open files limit configuration.
For all installations of Datafari : OS requirements : Debian 7+ or Ubuntu 16+ Environment 64 bits (a Docker image is available if you are on Windows environment) CentOS or RedHat 7.0+ (only for Datafari EE) Recommended versions are Debian 9 and Debian 8 (if you are on Debian 7 you will need to add the testing repo in /etc/apt/sources.list) Starting from Datafari 4.1, Datafari does not embed its own Java component. You need to have a Java JRE 8 (or JDK 8) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile :
# For example if you want OpenJDK JRE 8
apt-get install openjdk-8-jre
# Set Java Home
nano /etc/profile
#in the file add the line :
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
# Load the file
source /etc/profile For now, Java 8 is the only version of Java supported by Datafari Debian/Ubuntu environment : requires unzip, sudo, libc6-dev, jq, lsof apt-get install curl debconf unzip sudo libc6-dev jq lsof netcat -y
Datafari needs Python v 2.7.x. !! If you have only Python v3, please install Python2 (for Ubuntu 16.04 for example, install the package python-minimal) apt-get install python -y
Needs a user member of the sudo group to start Datafari (or can be root user) : visudo
# add the line below root ALL=(ALL:ALL) ALL
your_user ALL=NOPASSWD: ALL
Make sure that the machine is always uptodate (in particular for the email alerts scheduler), by enabling: ntpdate 0.fr.pool.ntp.org
Set the locale setting (in the example with fr_FR but can be replaced with your locale) : apt-get install locales
locale-gen fr_FR.UTF-8
dpkg-reconfigure locales If you still have an error like "perl: warning: Setting locale failed."
Do the additionnal steps :
check the sshd configuration : nano /etc/ssh/sshd_config and comment the line :
#AcceptEnv LANG LC_* Then relaunch the sshd service : /etc/init.d/ssh restart Add the locale variables to .bashrc configuration file : nano ~/.bashrc Add the lines : export LC_ALL="fr_FR.UTF-8"
export LANG="fr_FR.UTF-8"
export LANGUAGE="fr_FR.UTF-8"
For PostgreSQL :
PostgreSQL needs to have the variables LANG and LC_* set. To check them, launch the command :
locale
If LC_ALL and LC_TYPE are not filled, enter this (for English language):
export LC_ALL="en_US.UTF-8"
export LC_CTYPE="en_US.UTF-8"
You can also add the line to /etc/profile then. For OS X users : if you obtain the message : Cannot set LC_CTYPE to default locale: No such file or directory when you launch locale command, it might be because your terminal automatically sets environment variables when you log in from Mac to a Linux server : see https://askubuntu.com/a/778672. To turn if off, uncheck the checkbox here : In iTerm it's in the profile -> Terminal tab. In Terminal, it's in the Terminal -> Preferences -> Profiles -> Advanced tab
Increase Open Files limit configuration For Debian, change the setting in /etc/security/limits.conf :
root soft nofile 100000
root hard nofile 100000
* soft nofile 100000
* hard nofile 100000
root soft nproc 100000
root hard nproc 100000
* soft nproc 100000
* hard nproc 100000
Then reboot the machine to enable those parameters
Set the timezone if needeed :
Check the local zonetime that matches your region in /usr/share/zoneinfo. Then create a symlink from /etc/localtime (example here with Paris time) : sudo rm /etc/localtime
sudo ln -s /usr/share/zoneinfo/Europe/Paris /etc/localtime
For Redhat/Centos : install Java : yum update -y
echo "install java"
yum install java-1.8.0-openjdk-devel -y
echo 'export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk' >> /etc/profile
source /etc/profile
install dependencies : yum install centos-release-scl -y
yum install epel-release -y
yum install sclo-cassandra3-jffi -y
yum install python27 -y
#scl enable python27 bash
source /etc/profile
yum install jq -y
yum install lsof -y
yum groupinstall "Development tools" -y
yum install curl -y
yum install perl-Test-Simple perl-version perl-Data-Dumpe -y
yum install dpkg-devel dpkg-dev -y
yum install httpd -y
yum install mod_ssl -y
yum install nano -y
yum install nc -y
For a distributed Datafari: ManifoldCF: check the Apache ManifoldCF website recommandations and the above recommandations ELK: check the Elastic website recommandations Datafari main server : Chek the above recommandations SolrCloud servers: Chek the above recommandations