Campus IT staff to supercomputers: Be cool


Purdue's supercomputer is among the most powerful commercial machines in the world.
Purdue's supercomputer is among the most powerful commercial machines in the world.

In Mike Shuey’s line of work, turning off a computer means losing up to 3 million processing hours—a few weeks of work, gone in an instant.

Until Shuey and his team of supercomputing experts at Purdue University found a way to cool down the massive machines when they overheated during the blazing summer months, there were only two options: “You turn on a few fans and hope for the best, or you turn off [the supercomputers] and wait until the temperature stabilizes,” he said.

Shutting down the machines would save the university’s expensive computers—but it could cost researchers weeks or months of work.

Some research conducted with Purdue’s supercomputers requires several months of continuous operation, and pulling the plug would force researchers and scientists to start from square one.

“They have to start all over again where they began weeks or months ago,” said Shuey, Purdue University’s high-performance computer systems manager for 10 years.

But computer code written by Patrick Finnegan, a Unix systems administrator at the university, has allowed Purdue IT officials to slow down the supercomputers when they reach about 85 degrees Fahrenheit by about 30 percent—meaning researchers wouldn’t have to start from scratch after a complete shutdown.

Shuey said Finnegan wrote the code and created the cool-down program in the spring when a nearby utilities plant announced it would undergo maintenance in the summer, and meteorologists predicted higher-than-normal temperatures for the coming months.

Researchers working on the supercomputing systems will never notice a slowdown as Shuey and his team reduce power and bring the computers’ temperatures back to reasonable figures, usually in the low-70s.

“We can coast through the emergency for an hour or two and [then] ramp it up, and nobody’s the wiser,” he said.

The university has had to gear down its supercomputing capacity twice this summer, Shuey said, which—considering the alternative—was a no-brainer.

“It’s very much a risk-free option here,” Shuey said, adding that it takes about five minutes to slow down the computers when they overheat and five minutes to ramp them up when temperatures return to normal. “And sure enough, it has worked like a champ.”

The biggest hurdle was finding a way to slow down 8,000 processors at the same time. With so many processors involved, Shuey said, the chances of something going awry were high. That’s where Finnegan’s code came in.

“It can be a fairly simple thing in practice,” Shuey said. “We’ve just never seen it done at this scale.”

Purdue’s Hewlett-Packard supercomputing cluster is ranked No. 102 in the world by Top500.org, a web site that publishes a twice-yearly list of the most powerful “commercially available” computing systems, according to the site.

Other American educational institutions that cracked the top 500 include the University of Tennessee’s National Institute for Computational Sciences at No. 4, the University of Colorado, which ranked No. 31, the University of Minnesota’s Supercomputing Institute at No. 77, and 236th-ranked Northwestern University.

Shuey said Purdue’s IT officials would make the supercomputing code available to other colleges, universities, and corporations locked in a constant battle to keep computer temperatures from skyrocketing during the warmest months of the year. The code will be available on FolioDirect.net, according to a Purdue University announcement.

“I can’t speculate if it’ll catch on [in higher education], but we’ve found it very useful,” he said.

Sign up for our newsletter

Newsletter: Innovations in K12 Education
By submitting your information, you agree to our Terms & Conditions and Privacy Policy.