Non-blocking calls

[muammar]

Although Popen is being used to execute commands:

slurm-magic/slurm_magic.py

Line 164 in 4c708cc

process = Popen([name] + line.split(), stdin=PIPE, stdout=PIPE, stderr=PIPE)

.communicate() is a blocking process:

slurm-magic/slurm_magic.py

Line 165 in 4c708cc

stdout, stderr = process.communicate(input)

Is it possible to change this so that capturing subprocess.PIPE does not block?

[muammar]

muammar@afaa221 represents a small hack for this. A better way would be something like what's described here:

https://stackoverflow.com/questions/375427/non-blocking-read-on-a-subprocess-pipe-in-python

I will keep working on that.

[rcthomas]

Hi @muammar, thanks for your interest. I've been wondering if anyone uses this package, because it's barely more functionality than the IPython kernel provides by default. You can background processes with the built in %%script magic. As you can see in the code you've already looked at it's really not doing anything "magic" here, just passing Slurm commands through to the command line.