{"issue":{"created_at":"2011-09-07T01:53:39Z","state":"open","updated_at":"2011-12-01T04:42:38Z","comments":9,"user":{"gravatar_id":"16c9c41ea947be86dc69bf3d7b5c4200","id":855882,"url":"https://api.github.com/users/lukerosiak","avatar_url":"https://secure.gravatar.com/avatar/16c9c41ea947be86dc69bf3d7b5c4200?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","login":"lukerosiak"},"body":"Parse-disbursements.py now takes text file name as argument; regex fix to avoid mistaking all payee=do* records as 'ditto's and thus wrongly replacing them with the recipient above them; add the House's new transaction codes.","assignee":null,"id":1585905,"number":1,"labels":[],"pull_request":{"patch_url":"https://github.com/sunlightlabs/disbursements/pull/1.patch","html_url":"https://github.com/sunlightlabs/disbursements/pull/1","diff_url":"https://github.com/sunlightlabs/disbursements/pull/1.diff"},"title":"Statements of disbursements fix","closed_at":null,"html_url":"https://github.com/sunlightlabs/disbursements/issues/1","url":"https://api.github.com/repos/sunlightlabs/disbursements/issues/1","milestone":null},"action":"created","comment":{"created_at":"2011-12-01T04:42:38Z","updated_at":"2011-12-01T04:42:38Z","user":{"gravatar_id":"16c9c41ea947be86dc69bf3d7b5c4200","id":855882,"url":"https://api.github.com/users/lukerosiak","avatar_url":"https://secure.gravatar.com/avatar/16c9c41ea947be86dc69bf3d7b5c4200?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","login":"lukerosiak"},"body":"I had hoped to quickly make sense of it and write a story summarizing it\nfor Friday's paper but having spent a few minutes looking at it, my sense\nis that it's definitely harder than the House. I was just wondering whether\nyou'd be actively working on it at the same time tomorrow, in which case\nI'd be better off simply waiting!\n\nI'll take another look tomorrow though and maybe we can help each other\nmake sense of it or something. I've captured 36,545 lines like this\ntotalling $66M in payments:\n\nDVAF21100041,05/18/2011,B&B REPORTERS,04/26/2011,04/26/2011,TYPING &\nSTENOGRAPHIC SERVICES,549.00\n\nbut very often the descriptions will span multiple lines, so you have to\nconcatenate multiple lines like \"typing and ... stenographic ...\" together\nand recognize that the one line with a dollar amount and date applies to\nall of those lines together, and I haven't done that yet.\n\nThen there are the staff salaries and some other formats, and all kinds of\nother sections and random crap to the document. The problem isn't really\nwriting REs to match any one line, but figuring out the structure of the\ndocument and what flows into what to avoid false matches and figure out\nwhat lines need to be processed as a group, I think. The House thing, at\nleast one record = one line in the text file.\n\nOn Wed, Nov 30, 2011 at 11:25 PM, Eric Mill <\nreply@reply.github.com\n> wrote:\n\n> We haven't made a decision as to whether to parse it -- but I strongly\n> suspect we'll be giving it a try. It looks about as hard to parse as the\n> House's, though I'm concerned that the weird layout of the headers will\n> make things difficult. We'd greatly benefit from any work you want to do on\n> it and I'm happy to defer to you, especially since you have the best\n> understanding of how to parse the House's.\n>\n> ---\n> Reply to this email directly or view it on GitHub:\n> https://github.com/sunlightlabs/disbursements/pull/1#issuecomment-2970712\n>","id":2970839,"url":"https://api.github.com/repos/sunlightlabs/disbursements/issues/comments/2970839"}}