{"issue":{"pull_request":{"diff_url":null,"html_url":null,"patch_url":null},"state":"open","user":{"avatar_url":"https://secure.gravatar.com/avatar/5fa54fdf60acfa1dd99d4d5f68ddbdce?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","gravatar_id":"5fa54fdf60acfa1dd99d4d5f68ddbdce","url":"https://api.github.com/users/onyxfish","login":"onyxfish","id":33046},"milestone":null,"assignee":null,"labels":[{"name":"design-decision","color":"e102d8","url":"https://api.github.com/repos/pandaproject/panda/labels/design-decision"},{"name":"feature","color":"02e10c","url":"https://api.github.com/repos/pandaproject/panda/labels/feature"}],"updated_at":"2011-11-04T16:36:47Z","comments":2,"closed_at":null,"url":"https://api.github.com/repos/pandaproject/panda/issues/102","body":"Have seen at least one file uploaded to the alpha site that gets imported very badly due to inconsistent quoting. csvclean makes this file work perfectly, but how would we know to run it? And what would the measure of success be?","html_url":"https://github.com/pandaproject/panda/issues/102","title":"Programmatically execute csvclean on messy files?","number":102,"id":2144924,"created_at":"2011-11-04T15:29:21Z"},"action":"created","comment":{"user":{"avatar_url":"https://secure.gravatar.com/avatar/edd0be6c7c035b58bb2712284da41f1f?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","gravatar_id":"edd0be6c7c035b58bb2712284da41f1f","url":"https://api.github.com/users/springmeyer","login":"springmeyer","id":20300},"updated_at":"2011-11-04T16:36:47Z","url":"https://api.github.com/repos/pandaproject/panda/issues/comments/2633136","body":"I just got panda running locally and a [simple tab separated csv](http://tilemill-data.s3.amazonaws.com/tutorials/places_by_lon_lat.csv) did not import correctly.\r\n\r\n<img src=\"http://f.cl.ly/items/0u211x1S2C0s2P1c3y1i/Screen%20Shot%202011-11-04%20at%2012.34.48%20PM.png\" width=\"550\" />\r\n\r\n I dug around and it appears this is because `CSVKitReader` assumes nothing but `,` separators. Noticing this ticket now (right before filing a new one) - perhaps it is csvclean that is supposed to handle detecting various delimiters? I ask here for two reasons:\r\n\r\n\r\n1) In TileMill/Mapnik I attempt to detect common delimiters by parsing the first line and counting the number of separator characters including any of these: `,|;\\t`. Would be curious how you do this detection in csvkit and if you've thought of a more robust way.\r\n\r\n2) I'd like to make sure that TileMill can render csv's directly from pandaproject, so I am looking to offer a patch to get my sample data working (so I can try to pull it back out and into TileMill), and I'm looking for help knowing where to start.","id":2633136,"created_at":"2011-11-04T16:36:47Z"}}