Distributed and Cloud computing with Python PDF Print
Hits : 6717
Written by Aaron Staley   
Saturday, 12 February 2011 04:38
March 9th 9 a.m. – 12:20 p.m.
This tutorial will teach various ways to distribute python-based computation across a cloud or cluster. Tools covered include Pyro, Sun GridEngine. Google AppEngine, PiCloud, and Hadoop.

Abstract

Detailed description:

Do you have computational problems that take hours, if not days, to solve? You can often distribute your work over a cluster or cloud of computers to solve the problem in only minutes.

This tutorial will teach various ways to distribute python-based computation. Tools covered include Hadoop, Google AppEngine, Sun GridEngine, PiCloud, Hadoop, and Elastic MapReduce.

Attendees should bring a laptop with Python 2.x (x>=6) installed as the tutorial is example based.

Format: Class

Audience:

Intermediate level Python programmers. While no familiarity with distributed computing is assumed, programmers should be very comfortable reading Python code. Familiarity with scientific programming (e.g. numpy, scipy) helps but is not a must.

Class Size: Ideal, 20. Up to 30

Outline:

    * Introduction to distributed computing
          o Types of parallelizable problems
    * Low-level primitives
          o Pyro
    * Job processing on own cluster
          o Oracle (Sun) Grid Engine
    * Cloud Computing Solutions
          o Google AppEngine
          o PiCloud
    * MapReduce for large data
          o Hadoop (using dumbo for python)
          o Elastic MapReduce (overview only)
    * Benchmarks showing how different problems perform on each system
    * Conclusion

Examples used in presentation include:

    * Parallelizing Support Vector Machine training (Python's libsvm wrapper) across a hundred nodes
    * Determining features in brain waves using NumPy and distributed computing
    * Using NumPy, SciPy, and lots of computers for analyzing data from human cells.
    * The classic MapReduce distributed grep.

Share this post

Submit to Delicious Submit to Digg Submit to Facebook Submit to Google Bookmarks Submit to Stumbleupon Submit to Technorati Submit to Twitter Submit to LinkedIn
Related News:
  • Brooklyn's Aputumpu Festival taps Spincloud Music, local startup for festival app
  • AccelOps and Fine Tec Enter a Strategic Distribution Relationship Focused on Enterprise Businesses
  • Turn Any Database into an Online Resource with VT Enterprise Assetcloud Powered By /db
  • Qumu Study: IT Professionals Bet on Cloud Computing
  • Qumu Releases Hybrid Cloud Video Communications Solution
  • Online Backup Reviews Selects Top 5 Backup Services for 2012
  • Answers Most Frequently Asked Questions About Cloud Backup in New Guide for SMBs and Enterprises
  • Jelastic Beta Deploys Java Applications in the Cloud
  • XCD HR launches at Cloudforce 2011
  • NovaStor Managing Director, Mike Andrews to Participate in ExecEvent