Quantcast

[IPython-User] ipython notebook not displaying output cells

classic Classic list List threaded Threaded
11 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[IPython-User] ipython notebook not displaying output cells

Phil Austin-2
We're trying to set up ipython 0.13 in an undergraduate lab with Windows
7 machines
using EPD 7.3, followed by:

easy_install -U ipython
easy_install -U tornado

and

ipython profile create

in a user directory.

opening ipython in either a regular console (Pylab desktop shortcut) or
the qtconsole  both work fine, but when we start a notebook
with

ipython notebook

in firefox 14

command cells appear to execute, but there is no output.
mathjax formatting and markdown cells render fine, however.

A screen shot showing the state after a ctrl-enter:
http://dl.dropbox.com/u/3195815/iPy_notebook.PNG

Quick googling didn't turn up anything exactly like this, but
it seems like firewall settings might be implicated?  Any
suggestions on how to debug are welcome.

thanks, Phil


_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: [IPython-User] ipython notebook not displaying output cells

Phil Austin
Following up -- the problem seems to be related to
Active Directory running on our Windows 7 64bit enterprise server.
Turning off the firewall on a lab client machine doesn't help
(that is, ipython is still unable to make connections to
tcp ephemeral ports)  but if the client machine is rebooted in
networking safe mode then ipython works fine.

googling "Active Directory blocks tcp ports" doesn't produce any
leads, so if anybody has run into similar problems with
a windows server I'd be eager to here about it.

thanks, Phil Austin
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: ipython notebook not displaying output cells

Darren Govoni
I'm having this problem as well -  with a liberal (but still enabled) firewall. It think its AD.
I don't have any control over the firewall or windows machine. But need to find a way for this to work.

What ports are required to receive the output cells? I have my notebook server running on port 80 (firewall friendly)
and thought that means all comms to the server piggyback on that port. Is that true?

Are there other ports used by notebook we need to be aware of, because right now it doesn't work
through a firewall.

Darren

On Wed, 2012-08-15 at 16:34 -0700, Phil Austin wrote:
Following up -- the problem seems to be related to
Active Directory running on our Windows 7 64bit enterprise server.
Turning off the firewall on a lab client machine doesn't help
(that is, ipython is still unable to make connections to
tcp ephemeral ports)  but if the client machine is rebooted in
networking safe mode then ipython works fine.

googling "Active Directory blocks tcp ports" doesn't produce any
leads, so if anybody has run into similar problems with
a windows server I'd be eager to here about it.

thanks, Phil Austin




--
View this message in context: http://python.6.n6.nabble.com/IPython-User-ipython-notebook-not-displaying-output-cells-tp4985176p4985230.html
Sent from the IPython - User mailing list archive at Nabble.com.
_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user


_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: ipython notebook not displaying output cells

Phil Austin
On 12-08-15 04:47 PM, Darren Govoni [via Python] wrote:

> I'm having this problem as well -  with a liberal (but still enabled)
> firewall. It think its AD.
> I don't have any control over the firewall or windows machine. But need
> to find a way for this to work.
>
> What ports are required to receive the output cells? I have my notebook
> server running on port 80 (firewall friendly)
> and thought that means all comms to the server piggyback on that port.
> Is that true?
>
> Are there other ports used by notebook we need to be aware of, because
> right now it doesn't work
> through a firewall.
>

Here's what I see on a windows laptop without AD -- the output is
coming back through tcp://127.0.0.1:49926 etc. -- Phil

C:\Users\phil>ipython notebook --port 9999
[NotebookApp] Using existing profile dir:
u'C:\\Users\\phil\\.ipython\\profil
efault'
[NotebookApp] Serving notebooks from C:\Users\phil
[NotebookApp] The IPython Notebook is running at: http://127.0.0.1:9999/
[NotebookApp] Use Control-C to stop this server and shut down all kernels.
[NotebookApp] Using MathJax from CDN:
http://cdn.mathjax.org/mathjax/latest/M
Jax.js
[NotebookApp] Kernel started: 99113b7c-ca88-4bef-9294-912080dd91ea
[NotebookApp] Connecting to: tcp://127.0.0.1:49926
[NotebookApp] Connecting to: tcp://127.0.0.1:49928
[NotebookApp] Connecting to: tcp://127.0.0.1:49925
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-99113b7c-ca88-4bef-9294-912080dd91ea.json
[NotebookApp] Kernel started: a7b775b6-3daf-41e0-b92a-d8d054d8ee10
[NotebookApp] Connecting to: tcp://127.0.0.1:50338
[NotebookApp] Connecting to: tcp://127.0.0.1:50339
[NotebookApp] Connecting to: tcp://127.0.0.1:50341
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-a7b775b6-3daf-41e0-b92a-d8d054d8ee10.json



Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: ipython notebook not displaying output cells

Darren Govoni
Hopefully one of the ipython gurus can help us get this to work through a firewall.
Arbitrary port opening isn't going to work in an enterprise firewall environment I think.

On Wed, 2012-08-15 at 17:01 -0700, Phil Austin wrote:
On 12-08-15 04:47 PM, Darren Govoni [via Python] wrote:

> I'm having this problem as well -  with a liberal (but still enabled)
> firewall. It think its AD.
> I don't have any control over the firewall or windows machine. But need
> to find a way for this to work.
>
> What ports are required to receive the output cells? I have my notebook
> server running on port 80 (firewall friendly)
> and thought that means all comms to the server piggyback on that port.
> Is that true?
>
> Are there other ports used by notebook we need to be aware of, because
> right now it doesn't work
> through a firewall.
>

Here's what I see on a windows laptop without AD -- the output is
coming back through tcp://127.0.0.1:49926 etc. -- Phil

C:\Users\phil>ipython notebook --port 9999
[NotebookApp] Using existing profile dir:
u'C:\\Users\\phil\\.ipython\\profil
efault'
[NotebookApp] Serving notebooks from C:\Users\phil
[NotebookApp] The IPython Notebook is running at: http://127.0.0.1:9999/
[NotebookApp] Use Control-C to stop this server and shut down all kernels.
[NotebookApp] Using MathJax from CDN:
http://cdn.mathjax.org/mathjax/latest/M
Jax.js
[NotebookApp] Kernel started: 99113b7c-ca88-4bef-9294-912080dd91ea
[NotebookApp] Connecting to: tcp://127.0.0.1:49926
[NotebookApp] Connecting to: tcp://127.0.0.1:49928
[NotebookApp] Connecting to: tcp://127.0.0.1:49925
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-99113b7c-ca88-4bef-9294-912080dd91ea.json
[NotebookApp] Kernel started: a7b775b6-3daf-41e0-b92a-d8d054d8ee10
[NotebookApp] Connecting to: tcp://127.0.0.1:50338
[NotebookApp] Connecting to: tcp://127.0.0.1:50339
[NotebookApp] Connecting to: tcp://127.0.0.1:50341
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-a7b775b6-3daf-41e0-b92a-d8d054d8ee10.json






View this message in context: Re: ipython notebook not displaying output cells
Sent from the IPython - User mailing list archive at Nabble.com.
_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user


_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: ipython notebook not displaying output cells

MinRK
*each* Kernel requires four ports which are randomly selected - so that's four ports per notebook that you need to have available.
You can certainly subclass the KernelManager such that it will change the random port selection to selecting from a predetermined list, but you will need to make *a lot* of loopback ports available.  Now, you can avoid this issue by using IPC transports instead of TCP, but of course ØMQ does not support IPC transports on Windows.

So I think the answer is probably going to end up being:  The IPython Notebook is not compatible with this kind of environment, unless there are Windows wizards who can figure it out.

On Wed, Aug 15, 2012 at 5:04 PM, Darren Govoni <[hidden email]> wrote:
Hopefully one of the ipython gurus can help us get this to work through a firewall.
Arbitrary port opening isn't going to work in an enterprise firewall environment I think.


On Wed, 2012-08-15 at 17:01 -0700, Phil Austin wrote:
On 12-08-15 04:47 PM, Darren Govoni [via Python] wrote:

> I'm having this problem as well -  with a liberal (but still enabled)
> firewall. It think its AD.
> I don't have any control over the firewall or windows machine. But need
> to find a way for this to work.
>
> What ports are required to receive the output cells? I have my notebook
> server running on port 80 (firewall friendly)
> and thought that means all comms to the server piggyback on that port.
> Is that true?
>
> Are there other ports used by notebook we need to be aware of, because
> right now it doesn't work
> through a firewall.
>

Here's what I see on a windows laptop without AD -- the output is
coming back through tcp://127.0.0.1:49926 etc. -- Phil

C:\Users\phil>ipython notebook --port 9999
[NotebookApp] Using existing profile dir:
u'C:\\Users\\phil\\.ipython\\profil
efault'
[NotebookApp] Serving notebooks from C:\Users\phil
[NotebookApp] The IPython Notebook is running at: http://127.0.0.1:9999/
[NotebookApp] Use Control-C to stop this server and shut down all kernels.
[NotebookApp] Using MathJax from CDN:
http://cdn.mathjax.org/mathjax/latest/M
Jax.js
[NotebookApp] Kernel started: 99113b7c-ca88-4bef-9294-912080dd91ea
[NotebookApp] Connecting to: tcp://127.0.0.1:49926
[NotebookApp] Connecting to: tcp://127.0.0.1:49928
[NotebookApp] Connecting to: tcp://127.0.0.1:49925
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-99113b7c-ca88-4bef-9294-912080dd91ea.json
[NotebookApp] Kernel started: a7b775b6-3daf-41e0-b92a-d8d054d8ee10
[NotebookApp] Connecting to: tcp://127.0.0.1:50338
[NotebookApp] Connecting to: tcp://127.0.0.1:50339
[NotebookApp] Connecting to: tcp://127.0.0.1:50341
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-a7b775b6-3daf-41e0-b92a-d8d054d8ee10.json






View this message in context: Re: ipython notebook not displaying output cells
Sent from the IPython - User mailing list archive at Nabble.com.
_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user


_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user



_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: ipython notebook not displaying output cells

Phil Austin
On 12-08-15 05:17 PM, MinRK [via Python] wrote:

> *each* Kernel requires four ports which are randomly selected - so
> that's four ports per notebook that you need to have available.
> You can certainly subclass the KernelManager such that it will change
> the random port selection to selecting from a predetermined list, but
> you will need to make *a lot* of loopback ports available.  Now, you can
> avoid this issue by using IPC transports instead of TCP, but of course
> ØMQ does not support IPC transports on Windows.
>
> So I think the answer is probably going to end up being:  The IPython
> Notebook is not compatible with this kind of environment, unless there
> are Windows wizards who can figure it out.
>

In our case, the lab is behind an external firewall, so we have no
problem permitting as large a port range as necessary on the
lab server. It's just a question (for me) of
how to tell Active Directory to do that.  -- Phil


Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: ipython notebook not displaying output cells

Darren Govoni
In reply to this post by MinRK
That's unfortunate, but also not unique to windows either.

Is it because the websockets that use the random ports? I presume there is no kind of "proxy" or tunneling for websockets
to deal with secure environments?

On Wed, 2012-08-15 at 17:17 -0700, MinRK wrote:
*each* Kernel requires four ports which are randomly selected - so that's four ports per notebook that you need to have available.
You can certainly subclass the KernelManager such that it will change the random port selection to selecting from a predetermined list, but you will need to make *a lot* of loopback ports available.  Now, you can avoid this issue by using IPC transports instead of TCP, but of course ØMQ does not support IPC transports on Windows.


So I think the answer is probably going to end up being:  The IPython Notebook is not compatible with this kind of environment, unless there are Windows wizards who can figure it out.

On Wed, Aug 15, 2012 at 5:04 PM, Darren Govoni <[hidden email]> wrote:
Hopefully one of the ipython gurus can help us get this to work through a firewall.
Arbitrary port opening isn't going to work in an enterprise firewall environment I think.


On Wed, 2012-08-15 at 17:01 -0700, Phil Austin wrote:
On 12-08-15 04:47 PM, Darren Govoni [via Python] wrote:

> I'm having this problem as well -  with a liberal (but still enabled)
> firewall. It think its AD.
> I don't have any control over the firewall or windows machine. But need
> to find a way for this to work.
>
> What ports are required to receive the output cells? I have my notebook
> server running on port 80 (firewall friendly)
> and thought that means all comms to the server piggyback on that port.
> Is that true?
>
> Are there other ports used by notebook we need to be aware of, because
> right now it doesn't work
> through a firewall.
>

Here's what I see on a windows laptop without AD -- the output is
coming back through tcp://127.0.0.1:49926 etc. -- Phil

C:\Users\phil>ipython notebook --port 9999
[NotebookApp] Using existing profile dir:
u'C:\\Users\\phil\\.ipython\\profil
efault'
[NotebookApp] Serving notebooks from C:\Users\phil
[NotebookApp] The IPython Notebook is running at: http://127.0.0.1:9999/
[NotebookApp] Use Control-C to stop this server and shut down all kernels.
[NotebookApp] Using MathJax from CDN:
http://cdn.mathjax.org/mathjax/latest/M
Jax.js
[NotebookApp] Kernel started: 99113b7c-ca88-4bef-9294-912080dd91ea
[NotebookApp] Connecting to: tcp://127.0.0.1:49926
[NotebookApp] Connecting to: tcp://127.0.0.1:49928
[NotebookApp] Connecting to: tcp://127.0.0.1:49925
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-99113b7c-ca88-4bef-9294-912080dd91ea.json
[NotebookApp] Kernel started: a7b775b6-3daf-41e0-b92a-d8d054d8ee10
[NotebookApp] Connecting to: tcp://127.0.0.1:50338
[NotebookApp] Connecting to: tcp://127.0.0.1:50339
[NotebookApp] Connecting to: tcp://127.0.0.1:50341
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-a7b775b6-3daf-41e0-b92a-d8d054d8ee10.json







View this message in context: Re: ipython notebook not displaying output cells
Sent from the IPython - User mailing list archive at Nabble.com.
_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user



_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user



_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user


_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: ipython notebook not displaying output cells

Thomas Kluyver-2
On 16 August 2012 01:32, Darren Govoni <[hidden email]> wrote:
> Is it because the websockets that use the random ports? I presume there is
> no kind of "proxy" or tunneling for websockets
> to deal with secure environments?

As I understand it, websockets themselves go over port 80. But then
the notebook server forwards the data to the kernel over a ZMQ socket,
which is using the arbitrary ports.

Thomas
_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: ipython notebook not displaying output cells

MinRK


On Wed, Aug 15, 2012 at 5:36 PM, Thomas Kluyver <[hidden email]> wrote:
On 16 August 2012 01:32, Darren Govoni <[hidden email]> wrote:
> Is it because the websockets that use the random ports? I presume there is
> no kind of "proxy" or tunneling for websockets
> to deal with secure environments?

As I understand it, websockets themselves go over port 80. But then
the notebook server forwards the data to the kernel over a ZMQ socket,
which is using the arbitrary ports.

Yes, it's not the websockets - it's the notebook server talking to the kernels over ØMQ, where the code is actually running.
On Windows, you simply need to be able to open numerous loopback ports for this to work.  There is no alternative.  There *is* an alternative on platforms other than Windows (IPC).

-MinRK
 

Thomas
_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user


_______________________________________________
IPython-User mailing list
[hidden email]
http://mail.scipy.org/mailman/listinfo/ipython-user
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: ipython notebook not displaying output cells

Phil Austin
In reply to this post by Phil Austin
Following up on our problem blocked ports interfering with ipython notebook output
in a Windows 7 computer lab

Our lab sysadmin killed all the bootinit processes on the server and then started them
one by one, and the application that interferes with ipython in our case was
"Sophos Web Intelligence Service swi-service".  Disabling that process allows
us to use the notebook on all lab workstations.

Loading...