{"type":"doc","content":[{"type":"panel","attrs":{"panelType":"info"},"content":[{"type":"paragraph","content":[{"text":"Deprecated from Datafari 5.4","type":"text","marks":[{"type":"strong"}]},{"type":"hardBreak"},{"text":"Starting from Datafari 5.4, SearchProxy API is deprecated and we use ","type":"text"},{"text":"Search API by default (subpart of Datafari API)","type":"text","marks":[{"type":"link","attrs":{"href":"/wiki/spaces/DATAFARI/pages/1672871937"}}]}]}]},{"type":"rule"},{"type":"expand","attrs":{"title":"Valid from 4.1 to 5.3"},"content":[{"type":"panel","attrs":{"panelType":"info"},"content":[{"type":"heading","attrs":{"level":3},"content":[{"text":"Valid from 4.1 to 5.3","type":"text"}]},{"type":"paragraph","content":[{"text":"The documentation below is valid from Datafari v4.1.0 up to Datafari 5.3","type":"text"}]}]},{"type":"paragraph","content":[{"text":"The SearchProxy API is a servlet that is the bridge between the search UI and Solr. It handles the queries done by the user through the search UI, transforms them into Solr queries, executes them and returns back the response.","type":"text"}]},{"type":"paragraph","content":[{"text":"To make your own search UI you only need to submit queries to this API with an HTTP GET request that matches the format described in this documentation and then handle the response.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Request the SearchProxy API","type":"text","marks":[{"type":"strong"}]},{"type":"hardBreak"},{"text":"The entry point of the SearchProxy servlet is the following : ","type":"text"},{"text":"http://DATAFARI_MAIN_SERVER_ADDRESS:8080/Datafari/SearchProxy","type":"text","marks":[{"type":"link","attrs":{"href":"http://DATAFARI_MAIN_SERVER_ADDRESS:8080/Datafari/SearchProxy"}}]}]},{"type":"paragraph","content":[{"text":"To the entry point, you well need to specify the Solr request handler you want to reach. By default there are 2 request handler available : ","type":"text"},{"text":"/select","type":"text","marks":[{"type":"code"}]},{"text":" for the main search request handler, or ","type":"text"},{"text":"/suggest","type":"text","marks":[{"type":"code"}]},{"text":" for search suggestions (used to display autocomplete values when the user is typing in the search bar). With regards to AjaxFranceLabs, we usually call the ","type":"text"},{"text":"/suggest","type":"text","marks":[{"type":"code"}]},{"text":" request handler whenever there is a keystroke and the ","type":"text"},{"text":"/select","type":"text","marks":[{"type":"code"}]},{"text":" request handler whenever there is a search query. If you want to inspire from an example take a look at our documentation and the corresponding code : ","type":"text"},{"text":"AjaxFranceLabs Framework architecture and mechanism","type":"text","marks":[{"type":"link","attrs":{"href":"/wiki/spaces/DATAFARI/pages/5832714"}}]},{"type":"hardBreak"},{"text":"For example, if you want to request the SearchProxy API to send search queries, you will use an HTTP GET request to ","type":"text"},{"text":"http://DATAFARI_MAIN_SERVER_ADDRESS:8080/Datafari/SearchProxy/select","type":"text","marks":[{"type":"code"}]},{"type":"hardBreak"},{"text":"Depending on the custom Solr configuration you have done, you can of course reach more Solr request handlers but due to security reasons, we have limited the number of allowed features for request handlers. The ","type":"text"},{"text":"SearchProxy ","type":"text","marks":[{"type":"code"}]},{"text":"servlet will allow and recognize the basic request handlers ","type":"text"},{"text":"/select","type":"text","marks":[{"type":"code"}]},{"text":" and ","type":"text"},{"text":"/suggest,","type":"text","marks":[{"type":"code"}]},{"text":" plus the request handlers used for two features. These features are: the ","type":"text"},{"text":"autocomplete module for advanced search fields","type":"text","marks":[{"type":"link","attrs":{"href":"/wiki/spaces/DATAFARI/pages/321191937"}}]},{"text":" and the categories for autocomplete. In the case of the autocomplete for advanced search feature, the custom request handlers need to be declared in the ","type":"text"},{"text":"AUTOCOMPLETEFIELDS","type":"text","marks":[{"type":"code"}]},{"text":" parameter : ","type":"text","marks":[{"type":"textColor","attrs":{"color":"#3c3c3c"}}]},{"text":"Configuring Advanced search Autocomplete - Enterprise Edition","type":"text","marks":[{"type":"textColor","attrs":{"color":"#3c3c3c"}},{"type":"link","attrs":{"href":"/wiki/spaces/DATAFARI/pages/482148378"}}]},{"text":". In the case of the categories feature, the custom request handlers need to be declared in the ","type":"text","marks":[{"type":"textColor","attrs":{"color":"#3c3c3c"}}]},{"text":"AUTOCOMPLETESUGGESTERS ","type":"text","marks":[{"type":"code"}]},{"text":"parameter : ","type":"text","marks":[{"type":"textColor","attrs":{"color":"#3c3c3c"}}]},{"text":"Autocomplete with Categories/Entities Configuration","type":"text","marks":[{"type":"textColor","attrs":{"color":"#3c3c3c"}},{"type":"link","attrs":{"href":"/wiki/spaces/DATAFARI/pages/473759745"}}]},{"text":". ","type":"text","marks":[{"type":"textColor","attrs":{"color":"#3c3c3c"}}]},{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"All the query parameters are passed as GET parameters. You can set all the ","type":"text","marks":[{"type":"textColor","attrs":{"color":"#3c3c3c"}}]},{"text":"Solr query parameters","type":"text","marks":[{"type":"textColor","attrs":{"color":"#3c3c3c"}},{"type":"link","attrs":{"href":"https://lucene.apache.org/solr/guide/6_6/common-query-parameters.html"}}]},{"text":" you want and/or need. But the following parameters presence is mandatory :","type":"text","marks":[{"type":"textColor","attrs":{"color":"#3c3c3c"}}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"wt","type":"text","marks":[{"type":"strong"}]},{"text":" : must always be equals to 'json' ","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"json.wrf","type":"text","marks":[{"type":"strong"}]},{"text":" : used to define a name to the response, you can set whatever name you want. See response format for more details","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"id","type":"text","marks":[{"type":"strong"}]},{"text":" : used to register statistics, must be an UUID generated for each user session. This id will be used to track user behavior so it needs to be the same id till the user ends his session.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"q","type":"text","marks":[{"type":"strong"}]},{"text":" : the query the user has typed in the search bar","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"For example to execute the query 'testing' on the ","type":"text"},{"text":"/select","type":"text","marks":[{"type":"code"}]},{"text":" request handler, one will generate the following HTTP request : ","type":"text"},{"text":"http://DATAFARI_MAIN_SERVER_ADDRESS:8080/Datafari/SearchProxy/select?q=testing&id=5f034d5b-95af-4048-adbc-601acd24cc96&wt=json&json.wrf=test","type":"text","marks":[{"type":"code"}]},{"type":"hardBreak"},{"text":"To execute the query 'testing' on the ","type":"text"},{"text":"/suggest","type":"text","marks":[{"type":"code"}]},{"text":" request handler, one will generate the following HTTP request : ","type":"text"},{"text":"http://DATAFARI_MAIN_SERVER_ADDRESS:8080/Datafari/SearchProxy/suggest?q=testing&id=5f034d5b-95af-4048-adbc-601acd24cc96&wt=json&json.wrf=test","type":"text","marks":[{"type":"code"}]},{"type":"hardBreak"},{"text":"To avoid an overload of data in the query response, we also recommend to set the \"","type":"text"},{"text":"fl","type":"text","marks":[{"type":"code"}]},{"text":"\" parameter to limit the number of returned fields. As example, here is how is configured the ","type":"text"},{"text":"fl ","type":"text","marks":[{"type":"code"}]},{"text":"parameter in Datafari: ","type":"text"},{"text":"fl=title,url,id,extension","type":"text","marks":[{"type":"code"}]},{"text":" ","type":"text"},{"type":"hardBreak"},{"text":"To manage security and user ACLs in results, you will need to send the request to the ","type":"text"},{"text":"SearchProxy ","type":"text","marks":[{"type":"code"}]},{"text":"servlet with a session that has been authenticated by Datafari. ","type":"text"},{"type":"hardBreak"},{"text":"To authenticate yourself via the HTTP Client, you will need to send a POST request to ","type":"text"},{"text":"http://DATAFARI_MAIN_SERVER_ADDRESS:8080/Datafari/login.jsp","type":"text","marks":[{"type":"code"}]},{"text":" with the parameters ","type":"text"},{"text":"j_username","type":"text","marks":[{"type":"code"}]},{"text":" and ","type":"text"},{"text":"j_password ","type":"text","marks":[{"type":"code"}]},{"text":"containing respectively the username and its corresponding password. Then you will need to handle the session for your SearchProxy requests.","type":"text"},{"type":"hardBreak"},{"text":"Here is a java code example to do this using Apache HTTP Components HTTP Client 4.5.3 and Apache Components HTTP Core 4.4.7 :","type":"text"}]},{"type":"codeBlock","content":[{"text":"final CookieStore cookieStore = new BasicCookieStore();\nfinal HttpClient httpClient = HttpClientBuilder.create().setRedirectStrategy(new LaxRedirectStrategy()).setDefaultCookieStore(cookieStore).build();\n\nfinal HttpContext httpContext = new BasicHttpContext();\nhttpContext.setAttribute(HttpClientContext.COOKIE_STORE, cookieStore);\n\nfinal HttpPost post = new HttpPost(\"http://localhost:8080/Datafari/login.jsp\");\nfinal List params = new ArrayList<>();\nparams.add(new BasicNameValuePair(\"j_username\", \"admin\"));\nparams.add(new BasicNameValuePair(\"j_password\", \"admin\"));\npost.setEntity(new UrlEncodedFormEntity(params));\n\nfinal String id = UUID.randomUUID().toString();\nfinal HttpGet get = new HttpGet(\"http://localhost:8080/Datafari/SearchProxy/select?q=searching&wt=json&json.wrf=myQuery&id=\" + id + \"&fl=title,url,id,extension\");\nfinal HttpResponse response = httpClient.execute(get);\nSystem.out.println(IOUtils.toString(response.getEntity().getContent(), StandardCharsets.UTF_8));","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Handle the response format","type":"text","marks":[{"type":"strong"}]},{"type":"hardBreak"},{"text":"Here is an example of the response format for the request ","type":"text"}]},{"type":"codeBlock","content":[{"text":"http://datafari-server:8080/Datafari/SearchProxy/select?q=searching&wt=json&json.wrf=myQuery&id=61546-efses-6efs6&fl=title,url,id,extension : (see further down for a formatted version)","type":"text"}]},{"type":"codeBlock","content":[{"text":"myQuery({\"spellcheck\":{\"collations\":[],\"suggestions\":[],\"correctlySpelled\":true},\"response\":{\"docs\":[{\"extension\":\"html\",\"id\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/search-2\\/\",\"title\":[\"index.html\"],\"url\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/search-2\\/\"},{\"extension\":\"html\",\"id\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/open-source\\/\",\"title\":[\"index.html\"],\"url\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/open-source\\/\"},{\"extension\":\"html\",\"id\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/conference\\/\",\"title\":[\"index.html\"],\"url\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/conference\\/\"},{\"extension\":\"html\",\"id\":\"http:\\/\\/www.francelabs.com\\/blog\\/category\\/elasticsearch-2\\/\",\"title\":[\"index.html\"],\"url\":\"http:\\/\\/www.francelabs.com\\/blog\\/category\\/elasticsearch-2\\/\"},{\"extension\":\"html\",\"id\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/file-search\\/\",\"title\":[\"index.html\"],\"url\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/file-search\\/\"},{\"extension\":\"html\",\"id\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/elasticsearch\\/\",\"title\":[\"index.html\"],\"url\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/elasticsearch\\/\"},{\"extension\":\"html\",\"id\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/enterprise-search\\/\",\"title\":[\"index.html\"],\"url\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/enterprise-search\\/\"},{\"extension\":\"html\",\"id\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/early-binding\\/\",\"title\":[\"index.html\"],\"url\":\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/early-binding\\/\"},{\"extension\":\"html\",\"id\":\"https:\\/\\/www.francelabs.com\\/en\\/solutions.html\",\"title\":[\"solutions.html\"],\"url\":\"https:\\/\\/www.francelabs.com\\/en\\/solutions.html\"},{\"extension\":\"html\",\"id\":\"http:\\/\\/www.francelabs.com\\/blog\\/enterprise-search-europe-open-source\\/\",\"title\":[\"index.html\"],\"url\":\"http:\\/\\/www.francelabs.com\\/blog\\/enterprise-search-europe-open-source\\/\"}],\"numFound\":125,\"start\":0},\"responseHeader\":{\"zkConnected\":true,\"QTime\":39,\"params\":{\"q\":\"searching\",\"json.wrf\":\"myQuery\",\"qt\":\"\\/select\",\"_stateVer_\":\"FileShare:13\",\"hl.maxAnalyzedChars\":\"51200\",\"fl\":\"title,url,id,extension\",\"id\":\"04b6197c-a020-4931-b217-f96e0d9c7f46\",\"wt\":\"javabin\",\"version\":\"2\"},\"status\":0},\"highlighting\":{\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/conference\\/\":{\"content_fr\":[],\"exactContent\":[],\"content_en\":[\"Search<\\/span> technologies Big data Search<\\/span>, Solr, Elasticsearch, Hadoop Search<\\/span> Main menu Skip to primary content Skip to secondary content Home About Tag Archives: conference Enterprise Search<\\/span> Europe in Lond\"]},\"http:\\/\\/www.francelabs.com\\/blog\\/category\\/elasticsearch-2\\/\":{\"content_fr\":[],\"exactContent\":[],\"content_en\":[\"Search<\\/span> technologies Big data Search<\\/span>, Solr, Elasticsearch, Hadoop Search<\\/span> Main menu Skip to primary content Skip to secondary content Home About Category Archives: Elasticsearch Enterprise Search<\\/span> Europe\"]},\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/file-search\\/\":{\"content_fr\":[],\"exactContent\":[],\"content_en\":[\"Search<\\/span> technologies Big data Search<\\/span>, Solr, Elasticsearch, Hadoop Search<\\/span> Main menu Skip to primary content Skip to secondary content Home About Tag Archives: file search<\\/span> Tutorial for combining Manifold\"]},\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/open-source\\/\":{\"content_fr\":[],\"exactContent\":[],\"content_en\":[\"Search<\\/span> technologies Big data Search<\\/span>, Solr, Elasticsearch, Hadoop Search<\\/span> Main menu Skip to primary content Skip to secondary content Home About Tag Archives: open source Enterprise Search<\\/span> Europe in Lon\"]},\"https:\\/\\/www.francelabs.com\\/en\\/solutions.html\":{\"content_fr\":[],\"exactContent\":[],\"content_en\":[\"search<\\/span> engine based on Apache Solr 5 Advanced search<\\/span> with geolocalised search<\\/span> Analytics tools Semantic search<\\/span> and thesaurii management Data display (including oil rigs) with previews and geomaps Secur\"]},\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/early-binding\\/\":{\"content_fr\":[],\"exactContent\":[],\"content_en\":[\"Search<\\/span> technologies Big data Search<\\/span>, Solr, Elasticsearch, Hadoop Search<\\/span> Main menu Skip to primary content Skip to secondary content Home About Tag Archives: Early binding Activating early binding in C\"]},\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/enterprise-search\\/\":{\"content_fr\":[],\"exactContent\":[],\"content_en\":[\"Search<\\/span> technologies Big data Search<\\/span>, Solr, Elasticsearch, Hadoop Search<\\/span> Main menu Skip to primary content Skip to secondary content Home About Tag Archives: enterprise search<\\/span> Enterprise Search<\\/span> Europe \"]},\"http:\\/\\/www.francelabs.com\\/blog\\/enterprise-search-europe-open-source\\/\":{\"content_fr\":[],\"exactContent\":[],\"content_en\":[\"Search<\\/span> technologies Big data Search<\\/span>, Solr, Elasticsearch, Hadoop Search<\\/span> Main menu Skip to primary content Home About Post navigation ← Previous Next → Enterprise Search<\\/span> Europe in London \\u2013 Open source \"]},\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/elasticsearch\\/\":{\"content_fr\":[],\"exactContent\":[],\"content_en\":[\"Search<\\/span> technologies Big data Search<\\/span>, Solr, Elasticsearch, Hadoop Search<\\/span> Main menu Skip to primary content Skip to secondary content Home About Tag Archives: elasticsearch Tutorial for combining Manifo\"]},\"http:\\/\\/www.francelabs.com\\/blog\\/tag\\/search-2\\/\":{\"content_fr\":[],\"exactContent\":[],\"content_en\":[\"Search<\\/span> technologies Big data Search<\\/span>, Solr, Elasticsearch, Hadoop Search<\\/span> Main menu Skip to primary content Skip to secondary content Home About Tag Archives: search<\\/span> Enterprise Search<\\/span> Europe in London \\u2013\"]}}})","type":"text"}]},{"type":"paragraph","content":[{"text":"The format is really simple : ","type":"text"},{"text":"[json.wrf parameter value]([json response])","type":"text","marks":[{"type":"code"}]},{"type":"hardBreak"},{"text":"As you can see the json response is wrapped by ","type":"text"},{"text":"myQuery ","type":"text","marks":[{"type":"code"}]},{"text":"which is the value entered for the ","type":"text"},{"text":"json.wrf","type":"text","marks":[{"type":"code"}]},{"text":" parameter.","type":"text"},{"type":"hardBreak"},{"text":"The json response object is the original json returned by Solr so you will need to know how Solr builds the json response according to the parameters you have set. ","type":"text"},{"type":"hardBreak"},{"text":"Here are the standard fields that you will retrieve in a query response :","type":"text"}]},{"type":"codeBlock","content":[{"text":"{\n \"spellcheck\": {\n \"collations\": [],\n \"suggestions\": [],\n \"correctlySpelled\": true\n },\n \"response\": {\n \"docs\": [\n {\n \"extension\": \"html\",\n \"id\": \"http://www.francelabs.com/blog/tag/search-2/\",\n \"title\": [\n \"index.html\"\n ],\n \"url\": \"http://www.francelabs.com/blog/tag/search-2/\"\n },\n ...\n ...\n ...\n ],\n \"numFound\": 125,\n \"start\": 0\n },\n \"responseHeader\": {\n \"zkConnected\": true,\n \"QTime\": 4,\n \"params\": {\n \"q\": \"searching\",\n \"json.wrf\": \"myQuery\",\n \"qt\": \"/select\",\n \"_stateVer_\": \"FileShare:7\",\n \"hl.maxAnalyzedChars\": \"51200\",\n \"fl\": \"title,url,id,extension\",\n \"id\": \"72b12a59-390d-48d4-8cd6-40726647fb65\",\n \"wt\": \"javabin\",\n \"version\": \"2\"\n },\n \"status\": 0\n },\n \"highlighting\": {\n \"http://www.francelabs.com/blog/tag/conference/\": {\n \"content_fr\": [],\n \"exactContent\": [],\n \"content_en\": [\n \"Search technologies Big data Search, Solr, Elasticsearch, Hadoop Search Main menu Skip to primary content Skip to secondary content Home About Tag Archives: conference Enterprise Search Europe in Lond\"\n ]\n },\n ...\n ...\n ...\n ]\n }\n }\n}","type":"text"}]},{"type":"paragraph","content":[{"text":"Here is the list of the useful fields of the json response:","type":"text","marks":[{"type":"textColor","attrs":{"color":"#3c3c3c"}}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"spellcheck ","type":"text","marks":[{"type":"code"}]},{"text":": contains query corrections if it exists close word(s) query(ies) that return more results ","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"response ","type":"text","marks":[{"type":"code"}]},{"text":": contains 3 subfields, ","type":"text"},{"text":"docs ","type":"text","marks":[{"type":"code"}]},{"text":"that contains the list of returned docs (in the limit of the number of rows), ","type":"text"},{"text":"numFound ","type":"text","marks":[{"type":"code"}]},{"text":"that indicates the total number of matching documents, ","type":"text"},{"text":"start","type":"text","marks":[{"type":"code"}]},{"text":" which indicates the sorted number of the first document returned in the docs list","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"responseHeader ","type":"text","marks":[{"type":"code"}]},{"text":": contains some infos about the query executed and its status","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"highlighting ","type":"text","marks":[{"type":"code"}]},{"text":": for each returned doc, contains the snippet that Solr was able to generates. See ","type":"text"},{"text":"https://lucene.apache.org/solr/guide/6_6/highlighting.html","type":"text","marks":[{"type":"link","attrs":{"href":"https://lucene.apache.org/solr/guide/6_6/highlighting.html"}}]},{"text":" for more infos","type":"text"}]}]}]}]}]}]}],"version":1}

Browser not supported