-
Notifications
You must be signed in to change notification settings - Fork 6
Resource Manager
The SPQR framework relies on two different server node types:
- [Processing Node](Processing Node)
- Resource Manager
The first one handles all computation jobs executed from within previously instantiated micro pipelines. The latter keeps track of all SPQR cluster nodes (processing nodes) and pipelines distributed among those nodes.
This wiki page focuses on the resource manager and its internals.
Inside the SPQR context the resource manager is responsible for managing all available resources to ensure an appropriate task/pipeline assignment.
A SPQR cluster forms itself through active registration where each new [processing node](Processing Node) notifies the resource manager that it wishes to be added to the cluster it supervises.
For each registered processing node the resource manager sets up a tracking instance to supervise the node, its resources and health state.
To support active node registration the resource manager provides a corresponding REST API.
SPQR - stream processing and querying in realtime by Otto Group