Python Listener / Worker Infrastructure

Python workload manager/worker Interface April 2018 OVERVIEW Implement a generic architecture to divide a task to many subtasks between different designated workers. GOALS build a generic component which gets a Message by RabbitMQ, parse it to create a task and subtasks to various listeners Build demo for the listener and for the task manager. SPECIFICATIONS Task Manager Interface: Recieving notification Message of new Task by RabbitMQ. ProcessMessage() - this async method is responsible to understand the full workload that is encompassed in the Message. createTask() - this method generates a unique taskId for the workload needed. generateSubTasks() - this method is responsible to divide the original task to different subtasks. postTasks() - this method is responsible for posting subTasks in a designated unique, Redis Hash data-type to create a taskList. hasTaskEnded() - this method is responsible to check the taskList to see if some subTasks for the given taskId are not FINISHED. OnFinish() - sendMessage back through RabbitMQ Worker Interface: assignToTask() - takes a subTask off the taskList processTask() - this async method is responsible to get the workload described in the subTask and execute it postFinishTask() - responsbile to mark the subTask as FINISHED in the Redis taskList