{"issue":{"title":"Languages with only non-ascii characters broken","user":{"login":"merike","id":787928,"url":"https://api.github.com/users/merike","avatar_url":"https://secure.gravatar.com/avatar/89e3251d29203f212bb6d082383c1f70?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","gravatar_id":"89e3251d29203f212bb6d082383c1f70"},"created_at":"2011-12-01T10:58:06Z","milestone":null,"labels":[],"state":"open","updated_at":"2011-12-26T17:24:30Z","id":2413338,"closed_at":null,"html_url":"https://github.com/merike/event-extract/issues/5","pull_request":{"patch_url":null,"html_url":null,"diff_url":null},"body":"Splitting the words should probably be done with /\\s+/ instead of /\\W+/. Also for an unknown reason checking \"明日\" against en-US dictionary returns true...","number":5,"url":"https://api.github.com/repos/merike/event-extract/issues/5","comments":2,"assignee":{"login":"merike","id":787928,"url":"https://api.github.com/users/merike","avatar_url":"https://secure.gravatar.com/avatar/89e3251d29203f212bb6d082383c1f70?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","gravatar_id":"89e3251d29203f212bb6d082383c1f70"}},"comment":{"user":{"login":"merike","id":787928,"url":"https://api.github.com/users/merike","avatar_url":"https://secure.gravatar.com/avatar/89e3251d29203f212bb6d082383c1f70?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","gravatar_id":"89e3251d29203f212bb6d082383c1f70"},"created_at":"2011-12-26T17:24:30Z","updated_at":"2011-12-26T17:24:30Z","id":3275685,"body":"https://github.com/merike/event-extract/commit/a6d75eb94948f29f0d421feaafa5ab6f802ff87e hopefully improves the situation for Russian, Chinese and Japanese. Likely far from good though.\r\nAlternatively statistical information on ngrams could be used for language identification but this would require including all this information into extension.","url":"https://api.github.com/repos/merike/event-extract/issues/comments/3275685"},"action":"created"}