Notice: On April 23, 2014, Statalist moved from an email list to a forum, based at statalist.org.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

From |
Alex Eapen <alex.eapen@sydney.edu.au> |

To |
"statalist@hsphsun2.harvard.edu" <statalist@hsphsun2.harvard.edu> |

Subject |
RE: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode? |

Date |
Thu, 20 Jan 2011 22:44:53 +1100 |

Thanks for the further explanation and links, Neil. I intended to say in my earlier reply that the commands in each of my do-files are -summarize- and -regress-. These commands, according to the Stata/MP performance report, run faster on multiple cores. So my individual do-files will indeed run faster in Stata/MP and, as you say, the entire exercise should be faster compared to Stata/SE. I understand your point that what might make batch jobs run faster in general is better hardware (i.e., more memory or a faster CPU which makes available more resources to the concurrent do-files) than an upgrade to Stata/MP. Alex ________________________________________ From: owner-statalist@hsphsun2.harvard.edu [owner-statalist@hsphsun2.harvard.edu] On Behalf Of Neil Shephard [nshephard@gmail.com] Sent: Thursday, 20 January 2011 9:51 PM To: statalist@hsphsun2.harvard.edu Subject: Re: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode? On Thu, Jan 20, 2011 at 10:25 AM, Alex Eapen <alex.eapen@sydney.edu.au> wrote: > Thanks Neil. That clarifies it for me. The commands I intend to run in each dofile are -summ- and -regress-. So by your reasoning I will see improvements when I upgrade to Stata/MP. Hmm, thats not really what I was trying to convey. I don't have a version of Stata/MP to test this with, but in my opinion because you will be starting multiple instances of Stata/MP (one to run each batch file) you are unlikely to see any great improvement in the speed at which they all complete because how can one instance know that another instance is already running and take advantage of the hyperthreading that is used to spread jobs across the multiple cores of your CPU? Its one instance of Stata/MP that takes advantage of the multiple cores in your CPU because its be re-written to use hyper-threading. You'll see an improvement if, and only if, running bigjob1.do runs faster under Stata/MP than it does under Stata/SE because _each_ batch job will complete faster (see the official Stata report I linked for details and quantification of this). Perhaps some background on multi-core processors and hyper-threading would be informative http://en.wikipedia.org/wiki/Multi-core_%28computing%29 and http://en.wikipedia.org/wiki/Hyper-threading would make good. Neil -- “Truth in science can be defined as the working hypothesis best suited to open the way to the next better one.” - Konrad Lorenz Email - nshephard@gmail.com Website - http://kimura.no-ip.org/ Photos - http://www.flickr.com/photos/slackline/ * * For searches and help try: * http://www.stata.com/help.cgi?search * http://www.stata.com/support/statalist/faq * http://www.ats.ucla.edu/stat/stata/ * * For searches and help try: * http://www.stata.com/help.cgi?search * http://www.stata.com/support/statalist/faq * http://www.ats.ucla.edu/stat/stata/

**Follow-Ups**:**Re: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode?***From:*Neil Shephard <nshephard@gmail.com>

**References**:**st: RE: Will Stata/MP speed up running multiple dofiles in batch mode?***From:*Alex Eapen <alex.eapen@sydney.edu.au>

**Re: st: RE: Will Stata/MP speed up running multiple dofiles in batch mode?***From:*Neil Shephard <nshephard@gmail.com>

**Re: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode?***From:*Alex Eapen <alex.eapen@sydney.edu.au>

**Re: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode?***From:*Neil Shephard <nshephard@gmail.com>

- Prev by Date:
**Re: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode?** - Next by Date:
**Re: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode?** - Previous by thread:
**Re: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode?** - Next by thread:
**Re: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode?** - Index(es):