Multiprocessing

Namespaces don’t work:

## Both the functions would fail to pickle, 
## instead just have a blank function in a module.
class Namespace:

    @staticmethod
    def test_static():
        return "Finished"

    def test():
        return "Finished"

## This might work
exec(open("code/Trappy-Scopes/trackyscope/splitprocessor.py", "r").read())

Imports need to happen inside the function, also PATH list of each function is independent and needs to be redefined:

def process_func():
    import sys
    sys.path.appen("path-to-your-module")

    ## Calculations
    return

## Won't work
import time
def process_func():
    time.sleep(2)
    return "Finished"


## Works
def process_func():
    import time
    time.sleep(2)
    return "Finished"

cell1.client.get_versions(check=True)

import sys print(sys.version)

https://distributed.dask.org/en/latest/memory.html https://docs.python.org/3/library/pickle.html#what-can-be-pickled-and-unpickled https://medium.com/csmadeeasy/bug-bytes-ii-solving-python-multiprocessing-locks-8258c9002d6 https://docs.python.org/3/library/multiprocessing.html#programming-guidelines