Valid from 5.5.1The documentation below is valid from Datafari v5.5.1 upwards |
Looking for hardware requirements ? |
We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup.
For all installations of Datafari :
OS requirements :
Debian 11 (Bullseye) or 12, or Ubuntu 20.04 (Focal) or 22.04 (Jammy) Environment 64 bits (a Docker image is available if you are on Windows environment) (available both for Datafari CE or Datafari EE)
CentOS or RedHat 8 or 9 and CentOS Stream 8 or 9 (available only for Datafari EE)
Recommended versions are Debian 12 or Ubuntu Jammy
You can download an init script (.sh) for Datafari :
For Debian or Ubuntu users :
For RedHat or CentOs users :
You can launch the script with this command :
source init_server_datafari.sh |
=> It will install all the needed dependencies and increase the open files limit configuration.
This part of the documentation is for Debian/Ubuntu users, if you are on CentOS please go to the next section.
You need to have a Java JDK 11 (the JDK is mandatory if you use ELK, otherwise JRE is sufficient) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile :
# For example if you want OpenJDK JDK 11 in Debian 10 apt-get install openjdk-11-jdk # Set Java Home nano /etc/profile #in the file add the line : export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64 # Load the file source /etc/profile |
For now, Java 11 is the only version of Java supported by Datafari
On Debian 9 you have to add this prior to the installation of Java :
echo 'deb http://ftp.debian.org/debian stretch-backports main' | sudo tee /etc/apt/sources.list.d/stretch-backports.list apt-get update |
Mandatory dependencies :
apt-get install bash curl debconf unzip sudo libc6-dev jq lsof apache2 libapache2-mod-jk iptables iptables-persistent zip iputils-ping systemd procps bc -y -q |
Python is supported in version 2.7+ or 3+.
You need to have a Java JDK 11 (the JDK is mandatory if you use ELK, otherwise JRE is sufficient) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile :
yum update -y echo "install java" yum install java-11-openjdk-devel -y echo 'export JAVA_HOME=/usr/lib/jvm/java-11' >> /etc/profile source /etc/profile |
yum install python3 -y alternatives --set python /usr/bin/python3 update-alternatives --install /usr/bin/python python /usr/bin/python3 1 yum install centos-release-scl -y yum install epel-release -y yum install sclo-cassandra3-jffi -y yum install jq -y yum install lsof -y yum groupinstall "Development tools" -y yum install curl -y yum install perl-Test-Simple perl-version perl-Data-Dumpe -y yum install httpd -y yum install mod_ssl -y yum install libapache2-mod-jk yum install nano -y yum install iptables-services -y yum install nc -y yum install iputils -y yum install unzip -y yum install bc -y |
In the Datafari 5.0 version on Centos version only, only Python 2.7 version is supported.
You need a user member of the sudo group to start Datafari (or it can be root user) :
visudo # add the line below root ALL=(ALL:ALL) ALL your_user ALL=NOPASSWD: ALL |
Increase Open Files limit configuration
Change the setting in /etc/security/limits.conf
:
echo 'root soft nofile 100000' >> /etc/security/limits.conf echo 'root hard nofile 100000' >> /etc/security/limits.conf echo 'datafari soft nofile 100000' >> /etc/security/limits.conf echo 'datafari hard nofile 100000' >> /etc/security/limits.conf echo '* soft nofile 100000' >> /etc/security/limits.conf echo '* hard nofile 100000' >> /etc/security/limits.conf echo 'root soft nproc 100000' >> /etc/security/limits.conf echo 'root hard nproc 100000' >> /etc/security/limits.conf echo 'datafari soft nproc 100000' >> /etc/security/limits.conf echo 'datafari hard nproc 100000' >> /etc/security/limits.conf echo '* soft nproc 100000' >> /etc/security/limits.conf echo '* hard nproc 100000' >> /etc/security/limits.conf |
Then reboot the machine to enable those parameters
Make sure that the machine is always uptodate (in particular for the email alerts scheduler), by enabling:
ntpdate 0.fr.pool.ntp.org |
Set the locale setting (in the example with fr_FR but can be replaced with your locale) :
apt-get install locales locale-gen fr_FR.UTF-8 dpkg-reconfigure locales |
If you still have an error like "perl: warning: Setting locale failed."
Do the additionnal steps :
check the sshd configuration :
nano /etc/ssh/sshd_config |
and comment the line :
#AcceptEnv LANG LC_* |
Then relaunch the sshd service :
/etc/init.d/ssh restart |
Add the locale variables to .bashrc configuration file :
nano ~/.bashrc |
Add the lines :
export LC_ALL="fr_FR.UTF-8" export LANG="fr_FR.UTF-8" export LANGUAGE="fr_FR.UTF-8" |
For PostgreSQL :
PostgreSQL needs to have the variables LANG and LC_* set. To check them, launch the command :
locale |
If LC_ALL and LC_TYPE are not filled, enter this (for English language):
export LC_ALL="en_US.UTF-8" export LC_CTYPE="en_US.UTF-8" |
You can also add the line to /etc/profile then.
For OS X users : if you obtain the message : Cannot set LC_CTYPE to default locale: No such file or directory when you launch locale command, it might be because your terminal automatically sets environment variables when you log in from Mac to a Linux server : see https://askubuntu.com/a/778672 . To turn if off, uncheck the checkbox here :
In iTerm it is in the profile -> Terminal tab.
In Terminal, it is in the Terminal -> Preferences -> Profiles -> Advanced tab
Set the timezone if needeed :
Check the local zonetime that matches your region in /usr/share/zoneinfo. Then create a symlink from /etc/localtime (example here with Paris time) :
sudo rm /etc/localtime sudo ln -s /usr/share/zoneinfo/Europe/Paris /etc/localtime |
We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup. For all installations of Datafari :
Download dependencies scriptsYou can download an init script (.sh) for Datafari :
You can launch the script with this command :
=> It will install all the needed dependencies and increase the open files limit configuration. Debian/Ubuntu installationThis part of the documentation is for Debian/Ubuntu users, if you are on CentOS please go to the next section.
On Debian 9 you have to add this prior to the installation of Java :
Mandatory dependencies :
Python is supported in version 2.7+ or 3+. Centos/RedHat installation
In the Datafari 5.0 version on Centos version only, only Python 2.7 version is supported. For all Operating Systems
|
We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup. For all installations of Datafari :
Download dependencies scriptsYou can download an init script (.sh) for Datafari :
You can launch the script with this command :
=> It will install all the needed dependencies and increase the open files limit configuration. Debian/Ubuntu installationThis part of the documentation is for Debian/Ubuntu users, if you are on CentOS please go to the next section.
On Debian 9 you have to add this prior to the installation of Java :
Mandatory dependencies :
Python is supported in version 2.7+ or 3+. Centos/RedHat installation
In the Datafari 5.0 version on Centos version only, only Python 2.7 version is supported. For all Operating Systems
|
We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup. For all installations of Datafari :
Download dependencies scriptsYou can download an init script (.sh) for Datafari : The scripts are attached to this page : https://datafari.atlassian.net/wiki/pages/viewpageattachments.action?pageId=110788634 init_server_datafari_5_debian_9.sh for Debian 9 users init_server_datafari_5_centos.sh for Centos/RedHat users You can launch the script with this command : => It will install all the needed dependencies and increase the open files limit configuration. Download dependencies scriptsYou can download an init script (.sh) for Datafari : The scripts are attached to this page : https://datafari.atlassian.net/wiki/pages/viewpageattachments.action?pageId=110788634 init_server_datafari_5_debian_9.sh for Debian 9 users init_server_datafari_5_centos.sh for Centos/RedHat users You can launch the script with this command : => It will install all the needed dependencies and increase the open files limit configuration. Debian/Ubuntu installationThis part of the documentation is for Debian/Ubuntu users, if you are on CentOS please go to the next section.
On Debian 9 you have to add this prior to the installation of Java :
Mandatory dependencies :
Python is supported in version 2.7+ or 3+. Centos/RedHat installation
In the Datafari 5.0 version on Centos version only, only Python 2.7 version is supported. For all Operating Systems
|
We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup.
For all installations of Datafari :
install Java :
install dependencies :
For a distributed Datafari:
|