Page Comparison

View file
name init_server_datafari_5_ubuntu_debian.sh

Valid from 5.5.1

The documentation below is valid from Datafari v5.5.1 upwards

apt-get install bash curl debconf unzip sudo libc6-dev jq lsof apache2 openssl libapache2-mod-jk iptables iptables-persistent python zip zip iputils-ping systemd procps bc -y -q

yum install python3 centos-release-scl epel-release sclo-cassandra3-jffi python27 
source /etc/profile
yum install jq lsof 
yum groupinstall "Development tools" 
yum install curl y
alternatives --set python /usr/bin/python3
update-alternatives --install /usr/bin/python python /usr/bin/python3 1
yum install centos-release-scl -y
yum install epel-release -y
yum install sclo-cassandra3-jffi -y
yum install jq -y
yum install lsof -y
yum groupinstall "Development tools" -y
yum install curl -y
yum install perl-Test-Simple perl-version perl-Data-Dumpe dpkg-devel dpkg-dev httpd-y
yum install httpd -y
yum install mod_ssl -y
yum install libapache2-mod-jk
yum install nano -y
yum install iptables-services -y
yum install nc zip -y
yum install iputils -y
yum install unzip -y
yum install bc -y

We detail here the software requirements for the machines used in your Datafari setup. It may vary based on your setup.

For all installations of Datafari :

• • OS requirements :

    • Debian 7+ or Ubuntu 16+ Environment 64 bits (a Docker image is available if you are on Windows environment)

    • CentOS or RedHat 7.0+ (only for Datafari EE)

  • Recommended versions are Debian 9 and Debian 8 (if you are on Debian 7 you will need to add the testing repo in /etc/apt/sources.list)

  • Starting from Datafari 4.1, Datafari does not embed its own Java component. You need to have a Java JRE 8 (or JDK 8) installed on your environment (and you need to set the JAVA_HOME variable for all users and have the java executable in the PATH). To set it, we recommend to set it in /etc/profile :
    

    Code Block
    # For example if you want OpenJDK JRE 8 apt-get install openjdk-8-jre # Set Java Home nano /etc/profile #in the file add the line : export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 # Load the file source /etc/profile

    For now, Java 8 is the only version of Java supported by Datafari

  • Debian/Ubuntu environment : requires unzip, sudo, libc6-dev, jq, lsof

    Code Block
    apt-get install curl debconf unzip sudo libc6-dev jq lsof netcat -y

    
    

  • Datafari needs Python v 2.7.x. !! If you have only Python v3, please install Python2 (for Ubuntu 16.04 for example, install the package python-minimal)

    Code Block
    apt-get install python -y

    
    

  • Needs a user member of the sudo group to start Datafari (or can be root user)  :

    Code Block
    visudo # add the line below root ALL=(ALL:ALL) ALL your_user ALL=NOPASSWD: ALL

    
    

  • Make sure that the machine is always uptodate (in particular for the email alerts scheduler), by enabling: 

    Code Block
    ntpdate 0.fr.pool.ntp.org

    
    

  • Set the locale setting (in the example with fr_FR but can be replaced with your locale) : 

    Code Block
    apt-get install locales locale-gen fr_FR.UTF-8 dpkg-reconfigure locales

    If you still have an error like "perl: warning: Setting locale failed."
    Do the additionnal steps :
    check the sshd configuration :

    Code Block
    nano /etc/ssh/sshd_config

    and comment the line :
    

    Code Block
    #AcceptEnv LANG LC_*

    Then relaunch the sshd service :

    Code Block
    /etc/init.d/ssh restart

    Add the locale variables to .bashrc configuration file :

    Code Block
    nano ~/.bashrc

    Add the lines :

    Code Block
    export LC_ALL="fr_FR.UTF-8" export LANG="fr_FR.UTF-8" export LANGUAGE="fr_FR.UTF-8"

    
    

    For PostgreSQL : 
    PostgreSQL needs to have the variables LANG and LC_* set. To check them, launch the command :
    

    Code Block
    locale

    
    If LC_ALL and LC_TYPE are not filled, enter this (for English language):
    

    Code Block
    export LC_ALL="en_US.UTF-8" export LC_CTYPE="en_US.UTF-8"

     You can also add the line to /etc/profile then.

    For OS X users : if you obtain the message : Cannot set LC_CTYPE to default locale: No such file or directory when you launch locale command, it might be because your terminal automatically sets environment variables when you log in from Mac to a Linux server : see https://askubuntu.com/a/778672. To turn if off, uncheck the checkbox here : 

    In iTerm it's in the profile -> Terminal tab.

    In Terminal, it's in the Terminal -> Preferences -> Profiles -> Advanced tab

    
    

  • Increase Open Files limit configuration

    For Debian, change the setting in /etc/security/limits.conf : 
    

    Code Block
    root soft nofile 100000 root hard nofile 100000 * soft nofile 100000 * hard nofile 100000 root soft nproc 100000 root hard nproc 100000 * soft nproc 100000 * hard nproc 100000

    
    Then reboot the machine to enable those parameters
    
    
    

  • Set the timezone if needeed :
    Check the local zonetime that matches your region in /usr/share/zoneinfo. Then create a symlink from /etc/localtime (example here with Paris time) :

    Code Block
    sudo rm /etc/localtime sudo ln -s /usr/share/zoneinfo/Europe/Paris /etc/localtime

    
    

  • For Redhat/Centos :

install Java :

yum update -y
echo "install java"
yum install java-1.8.0-openjdk-devel -y 
echo 'export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk' >> /etc/profile
source /etc/profile

install dependencies :

yum install centos-release-scl -y
yum install epel-release -y
yum install sclo-cassandra3-jffi -y
yum install python27 -y
#scl enable python27 bash
source /etc/profile
yum install jq -y
yum install lsof -y
yum groupinstall "Development tools" -y
yum install curl -y
yum install perl-Test-Simple perl-version perl-Data-Dumpe -y
yum install dpkg-devel dpkg-dev -y
yum install httpd -y
yum install mod_ssl -y
yum install nano -y
yum install nc -y

For a distributed Datafari:

• ManifoldCF: check the Apache ManifoldCF website recommandations and the above recommandations

• ELK: check the Elastic website recommandations

• Datafari main server : Chek the above recommandations

• SolrCloud servers: Chek the above recommandations