{"comment":{"created_at":"2011-10-25T05:52:20Z","body":"Okay, I figured out the problem. Here was the unit test that passed:\r\n\r\nregister $JAR_PATH\r\n\r\ndefine Quantile datafu.pig.stats.StreamingQuantile('5');\r\n\r\ndata_in = LOAD 'input' as (val:int);\r\n\r\n/*describe data_in;*/\r\n\r\ndata_out = GROUP data_in ALL;\r\n\r\n/*describe data_out;*/\r\n\r\ndata_out = FOREACH data_out GENERATE Quantile(data_in.val) as quantiles;\r\ndata_out = FOREACH data_out GENERATE FLATTEN(quantiles) as quantiles;\r\n\r\n/*describe data_out;*/\r\n\r\nSTORE data_out into 'output';\r\n\r\n...I'm thinking that the useless FLATTEN call after the UDF was called caused Pig to not use the Accumulator interface. When I removed that line, the test failed.","updated_at":"2011-10-25T05:52:20Z","url":"https://api.github.com/repos/linkedin/datafu/issues/comments/2513335","id":2513335,"user":{"avatar_url":"https://secure.gravatar.com/avatar/fc30027286b6836c601e85025a528416?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","gravatar_id":"fc30027286b6836c601e85025a528416","url":"https://api.github.com/users/jwills","id":535396,"login":"jwills"}},"action":"created","issue":{"number":6,"created_at":"2011-10-25T01:31:14Z","pull_request":{"diff_url":"https://github.com/linkedin/datafu/pull/6.diff","patch_url":"https://github.com/linkedin/datafu/pull/6.patch","html_url":"https://github.com/linkedin/datafu/pull/6"},"body":"Matt-- you're absolutely right, thanks for pointing that out. Added here.","comments":3,"title":"Add the Accumulator interface to StreamingQuantile","updated_at":"2011-10-25T05:52:20Z","url":"https://api.github.com/repos/linkedin/datafu/issues/6","id":2040627,"assignee":null,"milestone":null,"closed_at":"2011-10-25T04:43:12Z","user":{"avatar_url":"https://secure.gravatar.com/avatar/fc30027286b6836c601e85025a528416?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","gravatar_id":"fc30027286b6836c601e85025a528416","url":"https://api.github.com/users/jwills","id":535396,"login":"jwills"},"html_url":"https://github.com/linkedin/datafu/issues/6","labels":[],"state":"closed"},"legacy":{"issue_id":2040627,"comment_id":2513335}}