{"type":"doc","content":[{"type":"panel","attrs":{"panelType":"info"},"content":[{"type":"heading","attrs":{"level":3},"content":[{"text":"Valid from 5.0","type":"text"}]},{"type":"paragraph","content":[{"text":"The documentation below is valid from Datafari 5.0 upwards","type":"text"}]}]},{"type":"paragraph","content":[{"text":"For now Datafari is preconfigured to display its menu and functionalities (not to be mixed up with the languages that can be analysed at the indexing phase) for English, French, German, Italian, Arabic, Brazilian Portuguese and Russian. See further below for the default languages that can be analysed at the indexing and search phases.","type":"text","marks":[{"type":"textColor","attrs":{"color":"#444444"}}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Step-by-step guide for an existing Datafari","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"For the internationalization of the user interface :","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The folder to store the i18n config files is here : /opt/datafari/tomcat/webapps/Datafari/resources/js/AjaxFranceLabs/locale. Just open it and add your new language. For example if you add German translation, put here a file named de.json.","type":"text"},{"type":"hardBreak"},{"text":"Also add a new entry in all the i18n files corresponding to your new language. For example to add Spanish language, we added the following entry in all the i18n files :","type":"text"}]},{"type":"codeBlock","content":[{"text":"\"es_locale\" : \"Español\" ","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":" For now, we need to add the new language in a Java class. So you will need to download the source code of Datafari, modify the class and upload it to your Datafari server. The class that needs to be modified is this one : com.francelabs.datafari.utils.LanguageUtils.java located in the datafari-webapp module. You need to modify the following line by adding your language :","type":"text"}]},{"type":"codeBlock","content":[{"text":"public static final List availableLanguages = Arrays.asList(\"en\", \"fr\", \"it\", \"ar\", \"ru\");","type":"text"}]},{"type":"paragraph","content":[{"text":"Then recompile the source code. When you are done, just send back the file $YOUR_DATAFARI_PROJECT/datafari-webapp/target/classes/com/francelabs/datafari/utils/LanguageUtils.class into your Datafari server to this location : /opt/datafari/tomcat/webapps/Datafari/WEB-INF/classes/com/francelabs/datafari/utils.","type":"text"},{"type":"hardBreak"},{"text":"Then you need to restart Datafari to load your changes.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add the new language in /opt/datafari/tomcat/webapps/Datafari/resources/js/AjaxFranceLabs/i18njs.js :","type":"text"}]},{"type":"codeBlock","content":[{"text":"availableLanguages : [ 'en', 'fr', 'it', 'ar', 'ru' ],","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a file with the new language : LOCALE.json , for example es.json into the folder /opt/datafari/tomcat/webapps/Datafari/resources/customs/i18n","type":"text"},{"type":"hardBreak"},{"text":"Add this content into it :","type":"text"}]},{"type":"codeBlock","content":[{"text":"{}","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"NB : no error on the content : it is really only : ","type":"text"},{"text":"{} ","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"For the internationalization of the language detection, indexing and search by the Datafari Solr engine :","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Modify the Solr schema to handle the new language","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add the stopwords file specific to your language. In order to do so, download the Solr version of current version of Datafari here : ","type":"text"},{"text":"https://archive.apache.org/dist/lucene/solr/8.5.2/solr-8.5.2.tgz","type":"text","marks":[{"type":"link","attrs":{"href":"https://archive.apache.org/dist/lucene/solr/8.5.2/solr-8.5.2.tgz"}}]},{"text":" then open the folder solr-8.5.2/server/solr/configsets/_default/conf/lang and search the stopwords file corresponding to your language. ","type":"text"},{"type":"hardBreak"},{"text":"Then add it to this location into your Datafari server : /opt/datafari/solr/solrcloud/FileShare/conf/lang/","type":"text"},{"type":"hardBreak"},{"text":"Then you need to push the file to Zookeeper. To do so, go to the admin UI of Datafari and click on Search Engine Configuration / System Configuration manager menu then click on push my modifications button then apply my modifications (see the page ","type":"text"},{"type":"inlineCard","attrs":{"url":"https://datafari.atlassian.net/wiki/spaces/DATAFARI/pages/34603014"}},{"text":" for more explanations)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add the fieldtype of your language. In order to do so, download the Solr version of current version of Datafari here : ","type":"text"},{"text":"https://archive.apache.org/dist/lucene/solr/8.5.2/solr-8.5.2.tgz","type":"text","marks":[{"type":"link","attrs":{"href":"https://archive.apache.org/dist/lucene/solr/8.5.2/solr-8.5.2.tgz"}}]},{"text":" then open the file solr-8.5.2/server/solr/configsets/_default/conf/managed-schema and search the fieldtype corresponding to your language. ","type":"text"},{"type":"hardBreak"},{"text":"For example, if we want to add Russian language, the Solr configuration is this one : ","type":"text"}]},{"type":"codeBlock","content":[{"text":" \n \n \n \n \n \n \n \n \n ","type":"text"}]},{"type":"paragraph","content":[{"text":"We have to add it into our Datafari server. Edit the file /opt/datafari/solr/solrcloud/FileShare/conf/customs_schema/custom_fieldTypes.incl and adapt the previous code to put into it (you can look at the file /opt/datafari/solr/solrcloud/FileShare/conf/customs_schema/custom_fieldTypes.incl.example to help you) : ","type":"text"}]},{"type":"codeBlock","content":[{"text":"{\n \"name\":\"text_ru\",\n \"class\":\"solr.TextField\",\n \"positionIncrementGap\":\"100\",\n \"analyzer\" : {\n \"tokenizer\":{\n \"class\":\"solr.StandardTokenizerFactory\" },\n \"filters\":[{\n \"class\":\"solr.LowerCaseFilterFactory\" },\n { \"class\":\"solr.StopFilterFactory\",\"ignoreCase\":\"true\",\"words\":\"lang/stopwords_ru.txt\",\"format\":\"snowball\" },\n { \"class\":\"solr.SnowballPorterFilterFactory\",\"language\":\"Russian\"\n }]\n }\n}","type":"text"}]},{"type":"paragraph","content":[{"text":"Add the new fieldType to Solr by launching the script ","type":"text"},{"text":"addCustomSchemaInfo.sh","type":"text","marks":[{"type":"link","attrs":{"href":"http://addCustomSchemaInfo.sh"}}]},{"text":" located into /opt/datafari/solr/solrcloud/FileShare/conf/customs_schema : ","type":"text"}]},{"type":"codeBlock","content":[{"text":"cd /opt/datafari/solr/solrcloud/FileShare/conf/customs_schema\nbash addCustomSchemaInfo.sh","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add fields specific to your new language : ","type":"text"},{"type":"hardBreak"},{"text":"You will notice that we have two fields which are language specific, namely content and title. Therefore, we have \"","type":"text"},{"text":"content_en","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"title_en","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"content_fr","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"title_fr","type":"text","marks":[{"type":"em"}]},{"text":"\", “title_de”, “content_de”. You need to create your specific \"","type":"text"},{"text":"content_xy","type":"text","marks":[{"type":"em"}]},{"text":"\" and \"","type":"text"},{"text":"title_xy","type":"text","marks":[{"type":"em"}]},{"text":"\" fields for your new language and configure them with the fieldType you just added previously. We want them to be indexed, stored and multiValued.","type":"text"},{"type":"hardBreak"},{"text":"We have to add them into our Datafari server. Edit the file /opt/datafari/solr/solrcloud/FileShare/conf/customs_schema/custom_fields.incl and create the two fields like below (you can look at the file /opt/datafari/solr/solrcloud/FileShare/conf/customs_schema/custom_fields.incl.example to help you). For example here is the config for Russian language : ","type":"text"}]},{"type":"codeBlock","content":[{"text":"{\n \"name\":\"title_ru\",\n \"type\":\"text_ru\",\n \"stored\":true,\n \"multiValued\":\"true\",\n \"indexed\":\"true\",\n}\n&&\n{\n \"name\":\"title_ru\",\n \"type\":\"text_ru\",\n \"stored\":true,\n \"multiValued\":\"true\",\n \"indexed\":\"true\",\n}","type":"text"}]},{"type":"paragraph","content":[{"text":"Add the new fieldType to Solr by launching the script ","type":"text"},{"text":"addCustomSchemaInfo.sh","type":"text","marks":[{"type":"link","attrs":{"href":"http://addCustomSchemaInfo.sh"}}]},{"text":" located into /opt/datafari/solr/solrcloud/FileShare/conf/customs_schema : ","type":"text"}]},{"type":"codeBlock","content":[{"text":"cd /opt/datafari/solr/solrcloud/FileShare/conf/customs_schema\nbash addCustomSchemaInfo.sh","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Modify the dedicated Solr updateprocessor which is declared in the ","type":"text"},{"text":"/opt/datafari/solr/solrcloud/FileShare/conf/solrconfig.xml","type":"text","marks":[{"type":"strong"}]},{"text":", that you can find at ","type":"text"},{"text":"updateRequestProcessorChainDatafari, ","type":"text","marks":[{"type":"em"}]},{"text":"which detects the languages based on the fields content and title. By default, we use English, French and German. In order to add a new language, add the new language to the element","type":"text"},{"text":" \"langid.whitelist","type":"text","marks":[{"type":"em"}]},{"text":"\" :","type":"text"}]},{"type":"codeBlock","content":[{"text":"\n content,title\n language\n true\n en,fr,de\n en\n","type":"text"}]},{"type":"paragraph","content":[{"text":"Then you need to push your changes to Zookeeper. To do so, go to the admin UI of Datafari and click on Search Engine Configuration / System Configuration manager menu then click on push my modifications button then apply my modifications (see the page ","type":"text"},{"type":"inlineCard","attrs":{"url":"https://datafari.atlassian.net/wiki/spaces/DATAFARI/pages/34603014"}},{"text":" for more explanations)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Finally change the Index fields relevancy weights Configuration. Indeed you need to add your new fields : title_xy and content_xy into the search algorithm. You can do it directly by the Datafari Admin UI : go to Search Engine Configuration → Fields Weight. Then click on the button add a field to add the two fields. For example for Russian we add : ","type":"text"},{"type":"hardBreak"},{"text":"title_ru 50","type":"text"},{"type":"hardBreak"},{"text":"content_ru 10 ","type":"text"},{"type":"hardBreak"},{"text":"(more explanations here : ","type":"text"},{"type":"inlineCard","attrs":{"url":"https://datafari.atlassian.net/wiki/spaces/DATAFARI/pages/17858566"}},{"text":" ","type":"text"}]},{"type":"mediaSingle","attrs":{"layout":"center","width":55.0},"content":[{"type":"media","attrs":{"width":1767,"id":"d845e99a-961b-46f2-aab4-a275e709abaf","collection":"contentId-6979589","type":"file","height":879}}]}]}]},{"type":"rule"},{"type":"expand","attrs":{"title":"Valid from 4.4 to 4.6"},"content":[{"type":"panel","attrs":{"panelType":"info"},"content":[{"type":"heading","attrs":{"level":3},"content":[{"text":"Valid from 4.4 to 4.6","type":"text"}]},{"type":"paragraph","content":[{"text":"The documentation below is valid from Datafari 4.4 upwards","type":"text"}]}]},{"type":"paragraph","content":[{"text":"For now Datafari is preconfigured to display its menu and functionalities (not to be mixed up with the languages that can be analysed at the indexing phase) for English, French, German, Italian, Arabic, Brazilian Portuguese and Russian. See further below for the default languages that can be analysed at the indexing and search phases.","type":"text","marks":[{"type":"textColor","attrs":{"color":"#444444"}}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Step-by-step guide","type":"text"}]},{"type":"paragraph","content":[{"text":"For the internationalization of the user interface, we use the i18n java library:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The folder to store the i18n config files is here : ","type":"text"},{"text":"datafari/WebContent/js/AjaxFranceLabs/locale","type":"text","marks":[{"type":"strong"}]},{"text":". Just open it and add your new language. For example if you add German translation, put here a file named de.json.","type":"text"},{"type":"hardBreak"},{"text":"Also add a new entry in all the i18n files corresponding to your new language. For example to add Spanish language, we added the following entry in all the i18n files :","type":"text"}]},{"type":"codeBlock","content":[{"text":"\"es_locale\" : \"Español\" ","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":" Add the new langage in the Java class com.francelabs.datafari.utils.LanguageUtils.java :","type":"text"}]},{"type":"codeBlock","content":[{"text":"public static final List availableLanguages = Arrays.asList(\"en\", \"fr\", \"it\", \"ar\", \"ru\");","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add the new language in WebContent/js/AjaxFranceLabs/i18njs.js :","type":"text"}]},{"type":"codeBlock","content":[{"text":"availableLanguages : [ 'en', 'fr', 'it', 'ar', 'ru' ],","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"For Datafari Enterprise Edition only : create a file with the new language : LOCALE.json , for example es.json into the folder /opt/datafari/tomcat/webapps/Datafari/customs/i18n","type":"text"},{"type":"hardBreak"},{"text":"Add this content into it :","type":"text"}]},{"type":"paragraph","content":[{"text":"{}","type":"text","marks":[{"type":"textColor","attrs":{"color":"#ffffff"}}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Finally launch the ant script datafari-dev.xml to take into Datafari the modifications (if you are in development mode).","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"For the internationalization of the language detection, indexing and search by the Datafari Solr engine, follow these steps:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Modify the dedicated Solr updateprocessor which is declared in the ","type":"text"},{"text":"DATAFARI_HOME/solr/solr_home/FileShare/conf/solrconfig.xml","type":"text","marks":[{"type":"strong"}]},{"text":", that you can find at ","type":"text"},{"text":"updateRequestProcessorChainDatafari, ","type":"text","marks":[{"type":"em"}]},{"text":"which detects the languages based on the fields content and title. By default, we use English and French. In order to add a new language, modify the new language to the element","type":"text"},{"text":" \"langid.whitelist","type":"text","marks":[{"type":"em"}]},{"text":"\".","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Modify the Solr schema to handle the new language, which you will find at ","type":"text"},{"text":"DATAFARI_HOME/solr/solr_home/FileShare/conf/schema.xml","type":"text","marks":[{"type":"strong"}]},{"text":". You will notice that we already have the following two fields which are language specific, namely content and title. Therefore, we have \"","type":"text"},{"text":"content_en","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"title_en","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"content_fr","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"title_fr","type":"text","marks":[{"type":"em"}]},{"text":"\". You need to create your specific \"","type":"text"},{"text":"content_xy","type":"text","marks":[{"type":"em"}]},{"text":"\" and \"","type":"text"},{"text":"title_xy","type":"text","marks":[{"type":"em"}]},{"text":"\" fields for your new language.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Modify the searchrequesthandler named select in the ","type":"text"},{"text":"DATAFARI_HOME/solr/solr_home/FileShare/conf/solrconfig.xml","type":"text","marks":[{"type":"strong"}]},{"text":". There, change the parameters ","type":"text"},{"text":"qf","type":"text","marks":[{"type":"em"}]},{"text":" et ","type":"text"},{"text":"pf","type":"text","marks":[{"type":"em"}]},{"text":" : put the following new fields: ","type":"text"},{"text":"title_xy","type":"text","marks":[{"type":"em"}]},{"text":" and ","type":"text"},{"text":"content_xy","type":"text","marks":[{"type":"em"}]},{"text":" to the existing chain of parameters.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Now you can restart your Datafari for the changes to be taken into account.","type":"text"}]}]}]}]},{"type":"rule"},{"type":"expand","attrs":{"title":"Valid from 4.0 to 4.3"},"content":[{"type":"panel","attrs":{"panelType":"info"},"content":[{"type":"heading","attrs":{"level":3},"content":[{"text":"Valid from 4.0 to 4.3","type":"text"}]},{"type":"paragraph","content":[{"text":"The documentation below is valid from Datafari 4.0 upwards","type":"text"}]}]},{"type":"paragraph","content":[{"text":"For now Datafari is preconfigured for English, French, Italian, Arabic, Brazilian Portuguese and Russian. Still, its aim is to have a global reach, so the steps to enable additional languages is rather straightforward and can be found here. In case you did it, please contact us so that we can integrate it in the next releases of Datafari !","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Step-by-step guide","type":"text"}]},{"type":"paragraph","content":[{"text":"For the internationalization of the user interface, we use the i18n java library:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The folder to store the i18n config files is here : ","type":"text"},{"text":"datafari/WebContent/js/AjaxFranceLabs/locale","type":"text","marks":[{"type":"strong"}]},{"text":". Just open it and add your new language. For example if you add German translation, put here a file named de.json.","type":"text"},{"type":"hardBreak"},{"text":"Also add a new entry in all the i18n files corresponding to your new language. For example to add Spanish language, we added the following entry in all the i18n files :","type":"text"}]},{"type":"codeBlock","content":[{"text":"\"es_locale\" : \"Español\" ","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":" Add the new langage in the Java class com.francelabs.datafari.utils.LanguageUtils.java :","type":"text"}]},{"type":"codeBlock","content":[{"text":"public static final List availableLanguages = Arrays.asList(\"en\", \"fr\", \"it\", \"ar\", \"ru\");","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add the new language in WebContent/js/AjaxFranceLabs/i18njs.js :","type":"text"}]},{"type":"codeBlock","content":[{"text":"availableLanguages : [ 'en', 'fr', 'it', 'ar', 'ru' ],","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"For Datafari Enterprise Edition only : create a file with the new language : LOCALE.json , for example es.json into the folder /opt/datafari/tomcat/webapps/Datafari/customs/i18n","type":"text"},{"type":"hardBreak"},{"text":"Add this content into it :","type":"text"}]},{"type":"codeBlock","content":[{"text":"{}","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Finally launch the ant script datafari-dev.xml to take into Datafari the modifications (if you are in development mode).","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"For the internationalization of the language detection, indexing and search by the Datafari Solr engine, follow these steps:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Modify the dedicated Solr updateprocessor which is declared in the ","type":"text"},{"text":"DATAFARI_HOME/solr/solr_home/FileShare/conf/solrconfig.xml","type":"text","marks":[{"type":"strong"}]},{"text":", that you can find at ","type":"text"},{"text":"updateRequestProcessorChainDatafari, ","type":"text","marks":[{"type":"em"}]},{"text":"which detects the languages based on the fields content and title. By default, we use English and French. In order to add a new language, modify the new language to the element","type":"text"},{"text":" \"langid.whitelist","type":"text","marks":[{"type":"em"}]},{"text":"\".","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Modify the Solr schema to handle the new language, which you will find at ","type":"text"},{"text":"DATAFARI_HOME/solr/solr_home/FileShare/conf/schema.xml","type":"text","marks":[{"type":"strong"}]},{"text":". You will notice that we already have the following two fields which are language specific, namely content and title. Therefore, we have \"","type":"text"},{"text":"content_en","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"title_en","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"content_fr","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"title_fr","type":"text","marks":[{"type":"em"}]},{"text":"\". You need to create your specific \"","type":"text"},{"text":"content_xy","type":"text","marks":[{"type":"em"}]},{"text":"\" and \"","type":"text"},{"text":"title_xy","type":"text","marks":[{"type":"em"}]},{"text":"\" fields for your new language.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Modify the searchrequesthandler named select in the ","type":"text"},{"text":"DATAFARI_HOME/solr/solr_home/FileShare/conf/solrconfig.xml","type":"text","marks":[{"type":"strong"}]},{"text":". There, change the parameters ","type":"text"},{"text":"qf","type":"text","marks":[{"type":"em"}]},{"text":" et ","type":"text"},{"text":"pf","type":"text","marks":[{"type":"em"}]},{"text":" : put the following new fields: ","type":"text"},{"text":"title_xy","type":"text","marks":[{"type":"em"}]},{"text":" and ","type":"text"},{"text":"content_xy","type":"text","marks":[{"type":"em"}]},{"text":" to the existing chain of parameters.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Now you can restart your Datafari for the changes to be taken into account.","type":"text"}]}]}]},{"type":"panel","attrs":{"panelType":"info"},"content":[{"type":"paragraph","content":[{"text":"You can either send us your new language either directly or using github, either way is fine by us as the modifications are not huge. We will send you a ","type":"text"},{"text":"cool Datafari T-Shirt","type":"text","marks":[{"type":"strong"}]},{"text":" if you share that with us, so that you can show the community you are a real Datafarian ","type":"text"},{"type":"emoji","attrs":{"id":"1f642","text":"🙂","shortName":":slight_smile:"}}]}]}]},{"type":"rule"},{"type":"expand","attrs":{"title":"Valid from 3.2 up to 4.0 excluded"},"content":[{"type":"panel","attrs":{"panelType":"info"},"content":[{"type":"heading","attrs":{"level":3},"content":[{"text":"Valid from 3.2 up to 4.0 excluded","type":"text"}]},{"type":"paragraph","content":[{"text":"The documentation below is valid from Datafari 3.2 upwards","type":"text"}]}]},{"type":"paragraph","content":[{"text":"For now Datafari is preconfigured for English, French, Italian, Arabic, Brazilian Portuguese and Russian. Still, its aim is to have a global reach, so the steps to enable additional languages is rather straightforward and can be found here. In case you did it, please contact us so that we can integrate it in the next releases of Datafari !","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Step-by-step guide","type":"text"}]},{"type":"paragraph","content":[{"text":"For the internationalization of the user interface, we use the i18n java library:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The folder to store the i18n config files is here : ","type":"text"},{"text":"datafari/WebContent/js/AjaxFranceLabs/locale","type":"text","marks":[{"type":"strong"}]},{"text":". Just open it and add your new language. For example if you add German translation, put here a file named de.json.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":" Add the new langage in the Java class com.francelabs.datafari.utils.LanguageUtils.java :","type":"text"}]},{"type":"codeBlock","content":[{"text":"public static final List availableLanguages = Arrays.asList(\"en\", \"fr\", \"it\", \"ar\", \"ru\");","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add the new language in WebContent/js/AjaxFranceLabs/i18njs.js :","type":"text"}]},{"type":"codeBlock","content":[{"text":"availableLanguages : [ 'en', 'fr', 'it', 'ar', 'ru' ],","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add the new language in WebContent/js/parameters.js :","type":"text"}]},{"type":"codeBlock","content":[{"text":"availableLanguages : [ 'en', 'fr', 'it', 'ar', 'ru' ],","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Finally launch the ant script datafari-dev.xml to take into Datafari the modifications (if you are in development mode).","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"For the internationalization of the language detection, indexing and search by the Datafari Solr engine, follow these steps:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Modify the dedicated Solr updateprocessor which is declared in the ","type":"text"},{"text":"DATAFARI_HOME/solr/solr_home/FileShare/conf/solrconfig.xml","type":"text","marks":[{"type":"strong"}]},{"text":", that you can find at ","type":"text"},{"text":"updateRequestProcessorChainDatafari, ","type":"text","marks":[{"type":"em"}]},{"text":"which detects the languages based on the fields content and title. By default, we use English and French. In order to add a new language, modify the new language to the element","type":"text"},{"text":" \"langid.whitelist","type":"text","marks":[{"type":"em"}]},{"text":"\".","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Modify the Solr schema to handle the new language, which you will find at ","type":"text"},{"text":"DATAFARI_HOME/solr/solr_home/FileShare/conf/schema.xml","type":"text","marks":[{"type":"strong"}]},{"text":". You will notice that we already have the following two fields which are language specific, namely content and title. Therefore, we have \"","type":"text"},{"text":"content_en","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"title_en","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"content_fr","type":"text","marks":[{"type":"em"}]},{"text":"\", \"","type":"text"},{"text":"title_fr","type":"text","marks":[{"type":"em"}]},{"text":"\". You need to create your specific \"","type":"text"},{"text":"content_xy","type":"text","marks":[{"type":"em"}]},{"text":"\" and \"","type":"text"},{"text":"title_xy","type":"text","marks":[{"type":"em"}]},{"text":"\" fields for your new language.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Modify the searchrequesthandler named select in the ","type":"text"},{"text":"DATAFARI_HOME/solr/solr_home/FileShare/conf/solrconfig.xml","type":"text","marks":[{"type":"strong"}]},{"text":". There, change the parameters ","type":"text"},{"text":"qf","type":"text","marks":[{"type":"em"}]},{"text":" et ","type":"text"},{"text":"pf","type":"text","marks":[{"type":"em"}]},{"text":" : put the following new fields: ","type":"text"},{"text":"title_xy","type":"text","marks":[{"type":"em"}]},{"text":" and ","type":"text"},{"text":"content_xy","type":"text","marks":[{"type":"em"}]},{"text":" to the existing chain of parameters.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Now you can restart your Datafari for the changes to be taken into account.","type":"text"}]}]}]},{"type":"panel","attrs":{"panelType":"info"},"content":[{"type":"paragraph","content":[{"text":"You can either send us your new language either directly or using github, either way is fine by us as the modifications are not huge. We will send you a ","type":"text"},{"text":"cool Datafari T-Shirt","type":"text","marks":[{"type":"strong"}]},{"text":" if you share that with us, so that you can show the community you are a real Datafarian ","type":"text"},{"type":"emoji","attrs":{"id":"1f642","text":"🙂","shortName":":slight_smile:"}}]}]}]},{"type":"paragraph","content":[{"type":"hardBreak"}]}],"version":1}