Skip to content

Latest commit

 

History

History
35 lines (23 loc) · 742 Bytes

README.md

File metadata and controls

35 lines (23 loc) · 742 Bytes

Multiprocess

A very simple multi-process processing framework by python

Design

  • Single machine(node) execution
  • Help python make full use of multi cpu-cores (GIL= Global Interpreter Lock)
  • Keep Simple

Setup / Install

git clone https://github.com/jsonkey/multiprocess
cd mutiprocess

Man

  • Help

image

  • Example & Test

image

Worker Description

woker.py

def func(lines):
        '''input:
                lines = ['111111\n', '222222\n']
            output:
                lines = ['aaaaaa\n', 'bbbbbb\n']
        '''
        rerurn lines