elasticsearch - Trouble w/ facet counts -


i'm attempting use elasticsearch analytics -- track "top content" hand-rolled rails cms. requirement quite bit more complicated keeping counter each piece of content. won't depth of problem right now, can't seem basics working.

my problem this: i'm using facets , counts aren't expect them be. example:

query:

{"facets":{"el_ids":{"terms":{"field":"el_id","size":1,"all_terms":false,"order":"count"}}}}

result:

{"el_ids":{"_type":"terms","missing":0,"total":16672,"other":16657,"terms":[{"term":"quis","count":15}]}}

ok, great, piece of content id "quis" had 15 hits , since order count, should top piece of content. lets top 5 pieces of content.

query:

{"facets":{"el_ids":{"terms":{"field":"el_id","size":5,"all_terms":false,"order":"count"}}}}

result (just facet):

[ {"term":"qgz9","count":26}, {"term":"quis","count":15}, {"term":"hnqn","count":15}, {"term":"higp","count":15}, {"term":"csns","count":15} ]

huh? piece of content w/ id "qgz9" had more hits 26? why wasn't top result in first query?

ok, lets top 100 now.

query:

{"facets":{"el_ids":{"terms":{"field":"el_id","size":100,"all_terms":false,"order":"count"}}}}

results (just facet):

[ {"term":"qgz9","count":43}, {"term":"difc","count":37}, {"term":"zryp","count":31}, {"term":"u65r","count":31}, {"term":"sxsi","count":31}, ... ]

so "qgz9" has 43 hits instead of 26? how can be? can assure there's nothing happening in background modifying index. if repeat these queries, same results.

as repeat process of increasing result size, counts continue change , new content ids emerge @ top. can explain me i'm doing wrong or understanding of how works flawed?

it turns out known issue:

...the way top n facets work getting top n each shard, , merging results. can give inaccurate results.

by default, index being created 5 shards. changing index has single shard, counts behave inline expectations. workaround set size value greater number of expected facets , peel off top n results.


Comments

Post a Comment

Popular posts from this blog

javascript - backbone.js Collection.add() doesn't `construct` (`initialize`) an object -

<!doctype html public "-//w3c//dtd xhtml 1.0 strict//en" "http://www.w3.org/tr/xhtml1/dtd/xhtml1-strict.dtd"> <html> <head> <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.7.2/jquery.min.js"></script> <script src="http://documentcloud.github.com/underscore/underscore-min.js"></script> <script src="http://documentcloud.github.com/backbone/backbone-min.js"></script> </head> <body> <button id="cmd_create_event" name="cmd_create_event" type="button">create new `event`</button> <script type="text/javascript"> var eventmodel = backbone.model.extend({ initialize : function() { console.log("`event` initialized. id: " + this.cid); this.bind("change:status", function() { console.log(this.get("status") + " value `status`"); }); this.bind("error", function(model, e...
Read more

php - Get uncommon values from two or more arrays -

is there function in php give array of uncommon values 2 or more arrays? for example: $array1 = array( "green", "red", "blue"); $array2 = array( "green", "yellow", "red"); .... $result = function_needed($array1, $array2,...); print_r($result); should give output: array("blue", "yellow", ...); use array_diff , array_merge : $result = array_merge(array_diff($array1, $array2), array_diff($array2, $array1)); here's demo. for multiple arrays, combine callback , array_reduce : function unique(&$a, $b) { return $a ? array_merge(array_diff($a, $b), array_diff($b, $a)) : $b; } $arrays = array( array('green', 'red', 'blue'), array('green', 'yellow', 'red') ); $result = array_reduce($arrays, 'unique'); and here's demo of that.
Read more

Adding duplicate array rows in Php -

i create function in php adds rows of array shared column value. so input. $test = array( array("c", 5, 6), array("c", 2, 3), array("test", 5, 6) ); and output. $testduplicatefree = array( array("c", 7, 9), array("test", 5, 6) ) ); i'm thinking function combine_duplicates($array,$col){ ... ... return $duplicatefreearray; } where $col duplicate free array. so, in case, combine_duplicates($test,0); would me desired output. this. <?php function combine_duplicates($array,$col) { $index = array(); foreach ($array $row) { $key = $row[$col]; if (!isset($index[$key])) { $index[$key] = $row; } else { ($i = 0; $i < count($row); ++$i) { if ($i != $col) { $index[$key][$i] += $row[$i]; } } } } return array_values($index); } $array = array( array("c", 5, 6), array("c", 2, 3), array("test", 5, 6) ); print_r(combine_duplicates($array, 0)); try here: http://codepad.org/mdhesqhi
Read more