High Performance solutions are needed to do things like urlretrieve

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

High Performance solutions are needed to do things like urlretrieve

David Shi
urlretrieve works fine.  However, when file size get very large.  It goes on forever, and even fails.
 
For instance, one of download .zip file is of 363,096KB.
 
Particularly, when trying to get, with urlretrieve, a zipped folder of a very large size, it could take up to 20 to 30 minutes.  Often it fails, never any problem with smaller folders.  Any solution for this?
 
Regards.
 
David


_______________________________________________
Web-SIG mailing list
[hidden email]
Web SIG: http://www.python.org/sigs/web-sig
Unsubscribe: http://mail.python.org/mailman/options/web-sig/lists%40nabble.com
Reply | Threaded
Open this post in threaded view
|

Re: High Performance solutions are needed to do things like urlretrieve

Randy Syring-3
Do you have problems downloading said zip file with something like wget?  This sounds, without more info, like a network connection issue more than anything else.  Not saying thats the problem, just wondering if you have checked that possibility on your end.
--------------------------------------
Randy Syring
Intelicom
502-644-4776

"Whether, then, you eat or drink or 
whatever you do, do all to the glory
of God." 1 Cor 10:31


David Shi wrote:
urlretrieve works fine.  However, when file size get very large.  It goes on forever, and even fails.
 
For instance, one of download .zip file is of 363,096KB.
 
Particularly, when trying to get, with urlretrieve, a zipped folder of a very large size, it could take up to 20 to 30 minutes.  Often it fails, never any problem with smaller folders.  Any solution for this?
 
Regards.
 
David


_______________________________________________ Web-SIG mailing list [hidden email] Web SIG: http://www.python.org/sigs/web-sig Unsubscribe: http://mail.python.org/mailman/options/web-sig/randy%40rcs-comp.com

_______________________________________________
Web-SIG mailing list
[hidden email]
Web SIG: http://www.python.org/sigs/web-sig
Unsubscribe: http://mail.python.org/mailman/options/web-sig/lists%40nabble.com