GridGain + Multi-Core processors

GridGain is an open source product written in Java providing a grid computing platform. It is known to be one of the more widely used grid product, certainly, as far as I see, one of the easiest to "gridify" or grid-enable an existing product.

One of the applications of the product is to couple with Amazon EC2 to make a "cloud" computing platform. See Gridgain + Amazon EC2

The widespread use of "multi-core" PCs also means that the product can be used to "parallelise" to take advantage of this increased power.

My setup involves one "broker" node and three "worker" nodes. The grid job is sent from one of the worker nodes.

I use ActiveMQ for communication between nodes, GridSharedFsCheckpointSpi for saving down intermediate data (to be picked up during the "Reduce" phase) and JobStealing SPI for automatic load-balancing and failover.

AttachmentSize
gridgain-broker.xml3.91 KB
gridgain-worker.xml3.43 KB

What did I say then?

Annual Tech Predictions from SearchWin2000

  1. A spending rebound of surprising strength: Quite likely...
  2. Linux disappoints: Agreed. Over-hype does no good...
  3. A breakout year for Wi-Fi: Don't know...
  4. WorldCom sells off MCI, emerges from bankruptcy: Wow!
  5. XML everywhere: Absolutely
  6. Time Warner sells money-losing America Online: :-o
  7. IBM buys Sun: Impossible
  8. PCs crack $300 price barrier: Absolutely
  9. The year of instant messaging: Already happening...
  10. Victory over viruses: Don't know...

Read their predictions in a more detail