Facebook releases design for its souped-up AI server, ‘Big Sur’

11 Dec 2015 | Author: | No comments yet »

Facebook Open Sources ‘Big Sur’ AI Hardware Design.

Over the last few years, a technology called deep learning has proven so adept at identifying images, recognizing spoken words, and translating from one language to another, the titans of Silicon Valley are eager to push the state of the art even further—and push it quickly.Facebook Inc.’s use of artificial intelligence, which ranges from tools for image recognition to the filtering of the news feeds for its social network, demands special computing infrastructure.

Facebook said today it has developed a new computing system aimed at artificial intelligence research that is twice as fast and twice as efficient as anything available before.Facebook wants to speed up research into artificial intelligence for everyone by making the plans for a massively powered box available to any company that wants to hasten up its efforts to build better facial or voice recognition. The company recently began building custom servers for its artificial intelligence workload and Thursday announced it would release the designs for that powerful hardware to the world — for free. These days, machine learning and artificial intelligence are, hand in hand, becoming the lifeblood of broad new applications throughout the business and research communities.

The social network on Thursday unveiled new AI hardware its researchers have developed to train neural networks, and open-sourced the design, offering other organizations a blueprint for how to set up their own AI-specific infrastructure. At Google, this tech not only helps the company recognize the commands you bark into your Android phone and instantly translate foreign street signs when you turn your phone their way. The company said the plan to open-source the blueprints of the servers — called “Big Sur” — would help other companies and researchers benefit from the incessant tweaking of Facebook’s developers. But even as that dynamic has been significantly driven by computers that are more powerful and more efficient, industry is reaching the limits of what those computers can do.

Increasingly, Facebook is developing elements of its business centered on artificial intelligence, and the social networking giant’s ability to build and train advanced AI models has been tied to the power of the hardware it uses. At Facebook, it helps identify faces in photos, choose content for your News Feed, and even deliver flowers ordered through M, the company’s experimental personal assistant. Among its recent AI projects have been efforts to make Facebook easier to use for the blind, and to incorporate artificial intelligence into everyday users’ tasks.

And because it’s contributing these designs to the Open Compute Foundation, much like it has done for its server designs and networking gear, other companies can take these designs and build their own AI hardware or even tweak the Big Sur designs to make them better. All the while, these two titans hope to refine deep learning so that it can carry on real conversations—and perhaps even exhibit something close to common sense. GPUs are widely used in artificial intelligence because the chips have far more individual processing cores on them than traditional processors produced by Intel Corp., making them adept at the dumb-but-numerous calculations required by AI software.

That’s why Facebook designed the “next-generation” computing hardware it has code-named “Big Sur.” The new Open-Rack-compatible system, designed over 18 months in conjunction with partners like Quanta and processing manufacturers like Nvidia, features eight graphics processing units (GPUs) of up to 300 watts apiece. Many high-performance computing systems require special cooling to operate, but Facebook has designed its new servers for “thermal power and efficiency,” allowing the company to operate them in its own free-air cooled, Open Compute standard data centers.

Serkan Piantino, director of engineering at Facebook’s AI Research, said on a conference call explaining the news, that because of the enormous amount of heat and power drawn by the graphics processing chips used in building the machines, that the team that melted its first enclosure would have gotten a steak dinner. That’s because Piantino told reporters, “our capabilities keep growing, and with each new capability, whether it’s computer vision, or speech, our models get more expensive to run, incrementally, each time.” Also, he said, as the FAIR group has moved from research to capability, it has seen product groups from across Facebook reach out about collaborations. Yann LeCun, the head of AI research at Facebook, said that negotiating with the data center administrators to take in the necessary power to ensure the machines got the juice they needed was a significant issue. For Facebook, releasing its designs has potent benefits: the openness can be a major incentive for top talent to join the company; firms that use the equipment may contribute their improvements back to the community, letting Facebook outsource some of its research and development costs; and if enough people buy the equipment, then economies of scale will ultimately lower the price Facebook pays for its computer hardware, Serkan Piantino, the engineering director of Facebook’s AI group, said in an briefing with reporters. “Often the things we open-source become standards in the community and it makes it easier and cheaper for us to acquire the things later because we put them out there,” Piantino said.

As for newer types of machine learning such as deep recommendation learning or attention learning, LeCun said there aren’t a lot of specific changes that are needed on the software side, so boxes like Big Sur could be used with some software modifications. The Internet’s largest services typically run on open source software. “Open source is the currency of developers now,” says Sean Stephens, the CEO of a software company called Perfect. “It’s how they share their thoughts and ideas. As it grew into the Internet’s most dominant force, Google typically saw its most important software and hardware designs as a competitive advantage it must keep to itself.

Although GPUs were originally designed to render images for computer games and other highly graphical applications, they’ve proven remarkably adept at deep learning. Traditional processors help drive these machines, but big companies like Facebook and Google and Baidu have found that their neural networks are far more efficient if they shift much of the computation onto GPUs.

In short, Facebook can achieve a greater level of AI at a quicker pace. “The bigger you make the neural nets, the better they will work,” LeCun says. “The more data you get them, the better they will work.” And since deep neural nets serve such a wide variety of applications—from face recognition to natural language understanding—this single system design can significantly advance the progress of Facebook as a whole. And in a larger sense, if more companies use the designs to do more AI work, it helps accelerate the evolution of deep learning as a whole—including software as well as hardware.

Here you can write a commentary on the recording "Facebook releases design for its souped-up AI server, ‘Big Sur’".

* Required fields
Our partners
Follow us
Contact us
Our contacts


ICQ: 423360519

About this site