If I understand you correctly, a combination of http://ipython.readthedocs.io/en/stable/interactive/magics.h... and http://nbconvert.readthedocs.io/en/latest/execute_api.html might get you there. Post if you build something like this!