Changeset 1239

Timestamp:

03/27/09 19:07:08 (16 months ago)

Author:

mturk

Message:

Adding (from bitbucket experimental repo) the rpdb command. If you run a
simulation with --rpdb, uncaught exceptions will spawn a (localhost-bound) pdb
instance that responds via XML-RPC. This enables you to pdb individual MPI
tasks, if you are running on the node that the tasks are on.

For instance,

mpirun -np 4 python2.6 some_script_with_a_bug.py --parallel --rpdb

will spawn four XML-RPC servers with embedded pdb on an uncaught exception,
each of which can be communicated with via the command

yt rpdb [0123]

where the task you want to communicate with is the argument. When the command
'shutdown' has been issued to a rpdb server, it will shut down and barrier,
waiting for all the other tasks to barrier to complete the task. So you need
to 'shutdown' all of them before the tasks all die.

I've used this to debug some parallel bugs lately; very handy... Note that it
binds only to localhost, but this is STILL a security flaw if you have other
users on the system. SO -- BEWARE.

Location:

trunk/yt

Files:

• commands.py (modified) (1 diff)
• funcs.py (modified) (2 diffs)
• rpdb.py (added)

trunk/yt/commands.py

@@ -274 +274 @@
         pc.save(os.path.join(opts.output,"%s" % (pf)))
 
+    def do_rpdb(self, subcmd, opts, arg):
+        """
+        Connect to a currently running (on localhost) rpd session.
+
+        Commands run with --rpdb will trigger an rpdb session with any
+        uncaught exceptions.
+
+        ${cmd_usage} [TASK_NUMER]
+        ${cmd_option_list}
+        """
+        import rpdb
+        rpdb.run_rpdb(int(arg))
+
 def run_main():
     for co in ["--parallel", "--paste"]:

trunk/yt/funcs.py

@@ -24 +24 @@
 """
 
-import time, types, signal, inspect, traceback, sys, pdb
+import time, types, signal, inspect, traceback, sys, pdb, rpdb
 import progressbar as pb
 from math import floor, ceil
@@ -52 +52 @@
 if "--paste" in sys.argv:
     sys.excepthook = paste_traceback
+if "--rpdb" in sys.argv:
+    sys.excepthook = rpdb.rpdb_excepthook
 
 def blank_wrapper(f):