Run Processes in Parallel in Python

Posted on July 31, 2019 at 3:08 pm

Today I found a nice example to run processes in parallel in python:

import os                                                                       
from multiprocessing import Pool                                                
 
 
processes = ('process1.py', 'process2.py', 'process3.py')                                    
 
 
def run_process(process):                                                             
    os.system('python {}'.format(process))                                       
 
 
pool = Pool(processes=3)                                                        
pool.map(run_process, processes)

Change processes=3 to processes=25 to run 25 processes in parallel.

Reference:

How to run parallel processes?

Receive updates via email

Other Posts

Updated Posts