2 commits

Author	SHA1	Message	Date
epriestley	72889c09bf	Split the GitHub import cursor into separate repository and issues event importers ... Summary: Ref T10538. The primary GitHub event activity stream does not report minor events (labels, milestones, etc). GitHub has a second, similar activity stream which does report these events (the "Issues Events API"). Use two separate cursors: one consumes the primary stream; the second consumes the events stream. One possible issue with this is that we may write events in a different order than they occurred, so GitHub shows "comment, label, close" but we show "comment, close, label" or similar. This is probably OK because the secondary API doesn't seem to have any very important events (e.g., it's probably fine if label changes are out-of-order), but we can conceivably put some buffer stage in between the two if it's an issue. Test Plan: {F1164894} Reviewers: chad Reviewed By: chad Maniphest Tasks: T10538 Differential Revision: https://secure.phabricator.com/D15446	2016-03-09 09:27:19 -08:00
epriestley	fe01949a5c	Add a Nuance GitHub repository source and basic polling ... Summary: Ref T10537. Ref T10538. This calls GitHub, sorta? Test Plan: ``` $ ./bin/nuance import --source poem <cursor:events.repository> Polling GitHub Repository API endpoint "/repos/epriestley/poems/events". <cursor:events.repository> This key has 4,988 remaining API request(s), limit resets in 1,871 second(s). <cursor:events.repository> ETag for this request was ""4abdd3d66ad5ca38f5117b094e76f4ba"". array(4) { [0]=> array(7) { ["id"]=> string(10) "3733510485" ... ``` Reviewers: chad Reviewed By: chad Maniphest Tasks: T10537, T10538 Differential Revision: https://secure.phabricator.com/D15439	2016-03-08 10:33:05 -08:00