[mlpack] Parallel Stochastic Potimazation Methods

Ryan Curtin ryan at ratml.org
Fri Mar 11 23:47:45 EST 2016


On Fri, Mar 11, 2016 at 07:59:08PM +0200, pvachill at ece.auth.gr wrote:
> 
> Hi
> 
> I am a 5th year undergraduate Electrical Engineer and Computer Engineer
> student at Aristotle University. My name is Axilleas Pasias and i am from
> Greece. I have background in Pthreads, OpenMP, MPI and Cuda.I also have some
> knowledge  in convex optimization. I would like you to recommend me some
> papers about Parallel stochastic optimization methods to get in touch with
> the idea.

Hi Axilleas,

Here are some interesting papers.

http://papers.nips.cc/paper/4390-hogwild-a-lock-free-approach-to-parallelizing-stochastic-gradient-descent.pdf
http://papers.nips.cc/paper/4006-parallelized-stochastic-gradient-descent.pdf
http://leon.bottou.org/publications/pdf/compstat-2010.pdf

Note that for mlpack, the desired scenario is a multi-core single
machine, not a distributed system.

I hope that this is helpful.  Let me know if I can clarify anything.

Thanks,

Ryan

-- 
Ryan Curtin    | "And they say there is no fate, but there is: it's
ryan at ratml.org | what you create." - Minister


More information about the mlpack mailing list