{"issue":{"title":"Name cleanup for display vs. name tokenization","created_at":"2011-12-22T14:41:40Z","user":{"login":"paultyng","id":422474,"url":"https://api.github.com/users/paultyng","avatar_url":"https://secure.gravatar.com/avatar/c3358ee7302e8d1450e82e8d14f3b872?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","gravatar_id":"c3358ee7302e8d1450e82e8d14f3b872"},"milestone":null,"labels":[],"updated_at":"2011-12-23T16:23:50Z","state":"closed","id":2637786,"pull_request":{"patch_url":null,"html_url":null,"diff_url":null},"closed_at":"2011-12-22T23:00:51Z","html_url":"https://github.com/sunlightlabs/name-cleaver/issues/1","body":"This library is great for name display, but would it be worth pursuing something for solely computer based name recognition.  Like tokenize, sort alphabetically, and use that as a token so that (too naive of an algorithm, but just an example):\r\n\r\n* John Smith\r\n* Smith John\r\n* Smith, John Sr.\r\n* etc.\r\n\r\nCould all be potentially recognized as similar entities by the computer, even if the display of that 2nd one may not actually come through properly since its missing a comma?\r\n\r\nI had a lot of similar problems parsing data for Wikipedia automation and this was one way I tackled the name cleanup, separating the computer recognition of the same person from the display cleanup.","number":1,"url":"https://api.github.com/repos/sunlightlabs/name-cleaver/issues/1","comments":2,"assignee":null},"comment":{"created_at":"2011-12-23T16:23:50Z","user":{"login":"paultyng","id":422474,"url":"https://api.github.com/users/paultyng","avatar_url":"https://secure.gravatar.com/avatar/c3358ee7302e8d1450e82e8d14f3b872?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","gravatar_id":"c3358ee7302e8d1450e82e8d14f3b872"},"updated_at":"2011-12-23T16:23:50Z","id":3262295,"body":"Yeah as I mentioned too naive of an algorithm on its own.  And wouldn't handle matching \"Mr. Smith\" and \"John Smith\" either or common misspellings.  Some sort of context driven approach would be best.  Or maybe this is more of a job for Mechanical Turk :)\r\n\r\nThanks for the pointers to the other library, will take a look.","url":"https://api.github.com/repos/sunlightlabs/name-cleaver/issues/comments/3262295"},"action":"created"}