SystemImager and BitTorrent: a peer-to-peer approach to substantial scale OS deployment
von Erich Focht (NEC HPC Europe), Andrea Righi (CINECA), Brian Finley (Argonne Nationwide Laboratory), Bernard Li (Pharma startup in Bay Location)
Donnerstag, 31.05.2007, Saal 4: Kaiserslautern , eleven:00-12:00 Uhr
This paper describes the integration of BitTorrent as a transportation method to deploy OS pictures to a substantial range of customers utilizing SystemImager (www.systemimager.org). Typically, the classical client-server product does not scale nicely, so substantial deployments, these types of as large clusters or elaborate grid-computing environments, have to have to be staged. An different scalable and dependable method for graphic distribution demands to be implemented and BitTorrent seems to be a natural in good shape. Measurements with large clusters of hundreds of nodes show that the SystemImager BitTorrent deployment scales as expected and significantly exceeds the effectiveness of the present multicast and rsync deployment solutions. Experimental success of deployment time and bandwidth analysis on a substantial set up are documented in the paper to ensure the positive aspects of the peer-to-peer approach with regard to the other transports. The speed of the deployment and the guidance for heterogenous harware offers the suggests to deploy virtual clusters which are crafted on the exact same resource pool, exactly where it is feasible to dynamically re-initialize workspaces on person demand from customers.
Über den Autor Erich Focht:
– researched physics at the RWTH Aachen
– PhD get the job done in theoretical Physics (computational solutions) at RWTH Aachen and von Neumann Institute for Computing (NIC) Juelich
– started to get the job done for NEC as Application Analyst in 1996, tuning of numerical algorithms and CAE simulation codes for parallel vector supercomputers
– labored as Linux kernel developer for IA64 and NUMA methods, associated in ATLAS64 and LSE tasks aiming at scalability of Linux on substantial methods
– at this time operating as alternative architect, carrying out exploration and advancement for cluster and grid software
– open resource tasks involvement: OSCAR (at this time chair), SystemImager, SystemInstaller, SystemConfigurator, Ganglia, Kerrighed SSI
Über den Autor Andrea Righi:
Andrea Righi was born in Colle di Val d’Elsa a excellent city in the hearth of Tuscany (Italy) on nineteenth March 1978. He received the Laurea degree in Computer system Engineering at University of Siena on 2004. At the moment he is a method administrator in CINECA (www.cineca.it/en/index.htm), the most vital supercomputing centre in Italy. He is also associated in the deployment and routine maintenance of the DEISA Supercomputing Grid Infrastructure (www.deisa.org), the European grid. Andrea is 1 of the energetic main developers of SystemImager (wiki.systemimager.org), a well known tool for setting up and updating Linux clusters. He is an activist of OSS and a Linux person considering that 1999.
Über den Autor Brian Finley:
Brian Elliott Finley has specialized in operating methods, method architecture, and method integration considering that 1990. He retains a range of technological certifications, writes content for industry publications, and is the creator of SystemImager, the well known Linux set up and update software. In 1993 he fell in appreciate with Linux and has been energetic in the open resource community ever considering that. Mr. Finley is the Linux Strategist for Argonne Nationwide Laboratory, exactly where he is targeted on helpful use of open resource systems for normal IT infrastructure, as nicely as particular scientific applications. Mr. Finley lives in Naperville, IL, US with his wife, 4 youngsters, and two substantial canine.
Über den Autor Bernard Li:
Bernard has been actively associated with HPC open resource software considering that 2003. He was the chair of the OSCAR venture from 2005-2006 and is nevertheless an energetic developer. He is also associated with the SystemImager and Ganglia tasks.
He has authored several papers similar to OSCAR and HPC in normal. His short article titled “OSCAR Cluster and Bioinformatics” was posted in the November 2004 challenge of Linux Journal.
He is fascinated in all matters HPC, from cluster deployment, to cluster file distribution, scheduling methods and ad-hoc grid applications these types of as Apple’s Xgrid.