[DEPRECATED] Content Analysis Over Time
- Julien Massiera
- Cedric
Deprecated
This documentation is deprecated as of Datafari version 5.2. Kibana has been replaced by Apache Zeppelin and the new “dashboards” are presented in the following documentation: [DEPRECATED] Analytic Stack (Apache Zeppelin)
Valid from 5.0
The documentation below is valid from Datafari v5.0 upwards
This dashboard is based on the Core Monitoring logs generated by Datafari, which are inserted by Logstash in Elasticsearch under the "monitoring/logs" index.
It shows, like the Content Analysis dashboard, the documents distribution in the core, but over the time.
There is one line chart by distribution type which are by default doc language, doc type and doc source. As you may have understood, each chart is based on a facet : language, source and extension.
You can create more charts, based on other facets by learning how Kibana works, and how our ELK works as well.
Kibana works with time events and we decided by default to have one time event by day. It means that we have only one Elasticsearch document by facet value by day. Thus, those "daily documents" are updated each hour by Datafari when a monitoring iteration happens, and we keep the data to display in Kibana up to date. This also means that you will only see one dot per day for each value. If you want more values per day, you need to change the Kibana time event which is yet only configurable in the code of Datafari.
Valid from 3.0
The documentation below is valid from Datafari v3.0 upwards
This dashboard is based on the Core Monitoring logs generated by Datafari, which are inserted by Logstash in Elasticsearch under the "monitoring/logs" index.
It shows, like the Content Analysis dashboard, the documents distribution in the core, but over the time.
There is one line chart by distribution type which are by default doc language, doc type and doc source. As you may have understood, each chart is based on a facet : language, source and extension.
You can create more charts, based on other facets by learning how Kibana works, and how our ELK works as well.
Kibana works with time events and we decided by default to have one time event by day. It means that we have only one Elasticsearch document by facet value by day. Thus, those "daily documents" are updated each hour by Datafari when a monitoring iteration happens, and we keep the data to display in Kibana up to date. This also means that you will only see one dot per day for each value. If you want more values per day, you need to change the Kibana time event which is yet only configurable in the code of Datafari.