Requiremnet

python3, recommmend version 3.7

dill, version 0.3.1.1

How to split file

python3 fileiter.py -f FILENAME -n NUMBER_OF_SPLITS

Create new example file. See example.py as a template.

How to run MapReduce

execute following commands

python3 example.py
python3 distmm.py -v -n 2

The system will spawn two clients and write logs to file mptest.log

For more command-line options

python3 distmm.py -h

How to test

python3 -m unittest discover -v

How to run benchmark_test

./benchmark_test

Reference

Our MapReduce system is built upon the groundwork provided by mincemeatpy