grid computing - ReadWriteWeb http://www.readwriteweb.com/feeds/tag/grid computing en Copyright 2009 Richard MacManus readwriteweb@gmail.com Sun, 22 Nov 2009 19:36:29 -0800 http://www.sixapart.com/movabletype/?v=4.23-en http://blogs.law.harvard.edu/tech/rss CERN Officially Unveils Its Grid: 100,000 Processors, 15 Petabytes a Year lhc_grid_logo.pngCERN today officially unveiled the massive computer network that will crunch the enormous amount of data coming from CERN's Large Hadron Collider (LHC). CERN expects that the LHC will produce around 15 petabytes of data every year. While the LHC was in its planning stages, CERN's IT department decided that the only realistic way to handle this amount of data would be by relying on the then still novel idea of grid computing. CERN's grid consists of 100,000 processors at 140 scientific institutions in 33 countries.

]]>Sponsor

]]> How to Crunch 15 Petabytes of Data?

As Science reported last month (subscription required), CERN's IT department quickly realized that no known data center could handle the amount of information the LHC would create. It was not even clear that Geneva's power grid could supply the energy necessary to run this massive data center. In addition, most of the money for the LHC project was going toward the collider itself, so that very little funding was left for the actual computing resources.

cern_data_storage.jpgIn order to distribute this data, CERN relies on dedicated 10Gbit/s fiber-optic lines that connect CERN with the 11 Tier-1 data centers on the grid. The Tier-1 data centers (pdf) will do some processing, but will also function as the main archives for the LHC data. These Tier-1 centers then farm out a large part of the actual data crunching to the Tier-2 data centers spread around the world. The Tier-2 centers are connected to the grid via regular, public Internet connections.

Large Hadron Collider @ Home

While grid computing has been around for quite a while now and has been implemented successfully on the public Internet by projects like SETI@home or Folding@home, CERN's grid is most likely the largest and most powerful grid established for scientific research so far.

CERN has also set up a project similar to Folding@home called (somewhat unimaginatively) LHC@home, which, thanks to the current shut-down of the LHC does not have much to do right now, but will allow individuals to contribute to CERN's efforts by donating computing time on their own computers.

Image of CERN Computer Center used courtesy of CERN.

]]>Discuss]]>
http://www.readwriteweb.com/archives/cern_officially_unveils_its_gr.php http://www.readwriteweb.com/archives/cern_officially_unveils_its_gr.php News Fri, 03 Oct 2008 11:28:56 -0800 Frederic Lardinois
Donate Spare Cycles, Cure Cancer The World Community Grid is an organization whose mission is to create the "largest public computing grid benefiting humanity." Similar to the well-known SETI@Home project, individuals donate their computers idle time to the project, becoming members of a worldwide computing grid. This grid effectively becomes a large system with power that surpasses that of any supercomputer. These donated spare cycles are then used to contribute to projects that benefit humanity. By splitting the work that needs to be done into small pieces, research time is reduced from years to only months.

]]>Sponsor

]]> Also, because the computing is done by the grid, the funds of the various projects can be put to better use than by paying for computational resources.

In existence since November 2004, the World Community Grid has contributed to projects like the "Genome Comparison Project" and the "Cure Muscular Dystrophy" project. Currently, the "Help Cure Cancer" project aids scientists who are studying proteins that have a functional relationship with cancer. By improving X-ray crystallography, researchers may be able to determine the structure and nature of many cancer-related proteins faster.

With today's focus on global warming, another project - the "African Climate Change" study - is a timely effort that will serve as a basis for understanding how the climate will change in the future. With the data provided by this project, measures designed to alleviate the adverse effects of climate change can be implemented.

Other projects involve discovering Dengue drugs, Human Proteome Folding (to better understand protein function), and fighting AIDS.

To participate, you begin by filling out this online form, then you just download and install the free, secure software the organization provides. No additional steps are necessary unless you want to tweak the settings to only run as a screensaver. Computers running the agent in screensaver mode get to watch as proteins are analyzed. Each work unit displayed is a photo of a protein crystallization experiment. The grid agent performs a computer vision analysis of the image in order to interpret its contents.

protein screensaver

There are agents for Mac, PC, and Linux available, so everyone can participate.

As of today, the organization boasts 351,227 members contributing a total of 864,291. SETI@Home, one the other hand, has 3 million plus members. Although perhaps not quite as exciting as finding a real live E.T., the World Community Grid offers the possibility of having an measurable impact in the world of science. And besides, the next time someone asks you what you're doing while you're idly channel surfing from your La-Z-Boy, you can answer with confidence, "I'm helping cure cancer."

]]>Discuss]]>
http://www.readwriteweb.com/archives/donate_spare_cycles_cure_cancer.php http://www.readwriteweb.com/archives/donate_spare_cycles_cure_cancer.php Real World Thu, 10 Jan 2008 22:41:56 -0800 Sarah Perez