amazon web services - SQS/task-queue job retry count strategy? -
i'm implementing task queue amazon sqs ( guess question applies task-queue ) , workers expected take different action depending on how many times job has been re-tried ( move different queue, increase visibility timeout, send alert..etc )
what best way keep track of failed job count? i'd avoid having keep centralized db job:retry-count records. should @ time spent in queue instead in monitoring process? imo ugly or un-clean @ best, iterating on jobs until find ancient ones..
thanks! andras
amazon released simple workflow serice (swf) can think of more sophisticated/flexible version of gae task queues.
it let monitor tasks (with hearbeats), configure retry strategies , create complicated workflows. looks pretty promising abstracting out task dependencies, scheduling , fault tolerance tasks (esp. asynchronous ones)
checkout http://docs.amazonwebservices.com/amazonswf/latest/developerguide/swf-dg-intro-to-swf.html overview.
Comments
Post a Comment