Configure ELK

By default, aside from Kibana, Elasticsearch and Logstash are automatically configured by Datafari on the first start, to fit with your installation directory and be ready to run.
If, for some reasons like an architecture decision, you move one or more of these components to a different place than the installation directory of Datafari, you will have to modify the ELK environment parameters located in [DATAFARI_HOME]/elk/scripts/set-elk-env.sh and maybe also the [DATAFARI_HOME]/elk/scripts/start-elk.sh and [DATAFARI_HOME]/elk/scripts/stop-elk.sh scripts.

The first time you run Datafari, go to the admin UI and to the 'ELK Configuration' page (Statistics/ELK Configuration). You will find this UI:

Let explain the 2 options:

• "ON/OFF" button : Should ELK start when Datafri is running ? (Note that if you swich to ON, it will immediately start ELK)
• Kibana URI : The URI to reach Kibana. e.g http://locahost:5601

Once you have started ELK (be aware that the average time for ELK to be 100% operational is 15 seconds), click on any statistic tab ('Usage Statistics', 'Corpus Statistics' or 'Corpus Over Time Statistics'). You should see the following page :

You need to configure the indexes which will be used for the dashboards. To do so, type 'monitoring' as Index name and click 'Create':

The index should have been found by Kibana and you should see the following page:

Now click on the "Add New" button, and repeat the same steps with the index name 'statistics':

Now click on the "Objects" tab and then on the "Import" button:

And import the [DATAFARI_HOME]/elk/save/datafari-kibana.json file:

Check that you have exactly the same things as the screenshot: 3 Dashboards, 3 Searches and 13 Visualizations. If it is the case congratulations ! Your ELK is now fully configured and if you click, in the Datafari admin UI, on any statistic tab ('Usage Statistics', 'Corpus Statistics' or 'Corpus Over Time Statistics'), you will now see the corresponding dashboard: