A very simple multi-process processing framework by python
- Single machine(node) execution
- Help python make full use of multi cpu-cores (GIL= Global Interpreter Lock)
- Keep Simple
git clone https://github.com/jsonkey/multiprocess
cd mutiprocess
- Help
- Example & Test
woker.py
def func(lines):
'''input:
lines = ['111111\n', '222222\n']
output:
lines = ['aaaaaa\n', 'bbbbbb\n']
'''
rerurn lines