http://www.stratuslab.org/ Sun, 05 Sep 2010 08:07:00 +0200 FeedCreator 1.7.2-ppt DokuWiki http://www.stratuslab.org/lib/images/favicon.ico http://www.stratuslab.org/ http://www.stratuslab.org/doku.php?id=administrative_tasks Review of Documentation and Policies Association of Site to ROC GOC Database Entry Request for Certificates Tue, 02 Jun 2009 13:21:57 +0200 http://www.stratuslab.org/doku.php?id=appliances Here's the list of appliances (images) known to work with the StratusLab contextualisation recipe. Note that all images should contain in the same folder as the image a manifest file. The image should also be compressed in a format supported by StratusLab. Fri, 27 Aug 2010 11:22:32 +0200 http://www.stratuslab.org/doku.php?id=apprepository The StratusLab project maintains a prototype appliance repository via which machine images can be shared. The images are available via the http(s) protocol. The service is connected to the project's LDAP server with write access controlled via username/password. Tue, 31 Aug 2010 12:21:46 +0200 http://www.stratuslab.org/doku.php?id=benchmarks To accurately compare the computing power provided by the cloud site to other grid sites, various benchmarks should be provided. The most straight-forward are the computing cycles that can be measured via the standard SPEC tests. Many applications are IO-intensive so it is important to also know the expected write and read performance for the local disk and for an Elastic Block Store. Similarly, the expected network bandwidth between different nodes in the cloud and between the cloud and oth… Tue, 02 Jun 2009 13:19:53 +0200 http://www.stratuslab.org/doku.php?id=benchmarkspackaging Benchmark packages contains binaries of OpenMP, MPI, I/O, Workflow and CPU stress benchmarks. Binaries will be installed in /usr/libexec directory. Scripts to run benchmarks will be installed in /usr/bin directory. For the moment we generate only RPM packages. Fri, 03 Sep 2010 17:15:17 +0200 http://www.stratuslab.org/doku.php?id=cfp Calls for papers relevant to StratusLab. * 2nd IEEE International Conference on Cloud Computing Technology and Science - Submission deadline: September 5th, 2010 * 2011 Workshop on Grid and Cloud Security (WGC-Sec) - Submission deadline: November 1st, 2010 Thu, 02 Sep 2010 11:47:28 +0200 http://www.stratuslab.org/doku.php?id=commandlinetools Here are the command-line tools StratusLab provides to manage the cloud: The basic process of installing StratusLab is as follows: * Package installation and dependencies * Configure * Setup In order to simplify the configuration and installation of StratusLab, we are making assumptions, which you should be aware of. As we go forward, these assumptions will have to reflect the most obvious (and non-ambiguous) usage scenarios that StratusLab users face. Mon, 16 Aug 2010 12:56:56 +0200 http://www.stratuslab.org/doku.php?id=deliverables Deliverables No. Title Pub. Date D2.1 [Review of the Use of Cloud and Virtualization Technologies in Grid Infrastructures] 11 August 2010 Milestones Fri, 13 Aug 2010 14:56:18 +0200 http://www.stratuslab.org/doku.php?id=ec2_as_a_pool_of_worker_nodes The most basic and rather trivial way to exploit EC2 for grid resources is to use it as pool of WNs that don't share a common disk space. The fastest way to do this is to create a SL4 or CentOS4 AMI image with all required WN packages pre-installed. Once the image starts you need only to copy the yaim site configuration files to the machine and run yaim. The only TCP ports that need to be open are: Tue, 02 Jun 2009 13:20:30 +0200 http://www.stratuslab.org/doku.php?id=ec2_xen_and_paravirtualization Paravirtualization is a technique introduced by Xen for improving the performance of Virtual Machines. In this approach the host and the VM share a common kernel and the VM has direct access to critical OS and hardware resources like device drivers, IRQ interrupts etc. This significantly improves the responsiveness of VMs limiting the impact from the virtualization layer. Moreover, you also loose various other important features like real-time VM migration, load balancing, dynamic fail-over etc.… Tue, 02 Jun 2009 13:18:55 +0200 http://www.stratuslab.org/doku.php?id=egidemoscenario StratusLab Demonstration for the EGI Technical Conference Benchmarks Tests * Goal : Run application-oriented benchmarks to measure the performance of StratusLab cloud implementation. Benchmarks tests will be deployed on StratusLab cloud, results will be stored in xml format. * Run cpu_benchmarks.sh for High-CPU requirements but little or no input and output data. * Run mpi-io_benchmarks.sh for Simulation, Analysis and Filtering tests * Run openmpi_benchmarks.sh for shared Memory Pro… Thu, 26 Aug 2010 10:28:48 +0200 http://www.stratuslab.org/doku.php?id=execution_of_a_virtualized_grid_site_on_private_and_hybrid_clouds StratusLab is exploring the integration of cloud technologies and services, especially virtualisation, into existing Grid Infrastructures. Using private cloud technologies for resource provisioning would enhance failover and redundancy solutions, and permit machine migration for flexible load balancing and energy efficiency. Virtualization of the site infrastructure would also allow the dynamic provisioning of worker nodes to address the demands of different user communities. Using hybrid cloud … Fri, 05 Jun 2009 17:00:04 +0200 http://www.stratuslab.org/doku.php?id=git The project uses git to manage its code base. Currently the repository requires authenticated access for both reading from and writing to the repository. In addition, the repository can only be accessed via the https protocol. The repositories are only served over an HTTPS connection. Access requires that you configure your git client to accept the server's self-signed certificate. To do this you can set an environmental variable: Fri, 13 Aug 2010 09:57:40 +0200 http://www.stratuslab.org/doku.php?id=image_creation_recipe The StratusLab distribution is able to customize machine image from a base image for a later use. This base image has to follow some rules in order to be use to build custom image. As this base image will be booted on the cloud, contextualization needs to take place such that we can SSH into the machine with a public/private key pair. Fri, 20 Aug 2010 11:10:55 +0200 http://www.stratuslab.org/doku.php?id=installation There are two supported installation methods: a manual method with scripts and an automated method with Quattor. * Manual Installation: This method supports both Ubuntu 10.04 and CentOS 5.5 and similar systems. It consists of a set of commands that perform the necessary installation steps based on information in a configuration file. * Quattor Installation: This method supports an automated installation of SL 5.5 machines (should work for CentOS 5.5 and RHEL 5.5 as well). Tue, 17 Aug 2010 11:12:16 +0200 http://www.stratuslab.org/doku.php?id=internal The following pages contain information for participants of the StratusLab project. People outside of the project are free to browse these pages, but should only rely on information contained on the public pages. Servers/Services * Requesting Access to Servers * LDAP Server Information * Development Process Tools * Software Repositories * Appliance Repository Fri, 03 Sep 2010 16:35:59 +0200 http://www.stratuslab.org/doku.php?id=ldapserver The LDAP server contains username and password information for all StratusLab participants and daemons. All users can connect to the server to find contact information for other members of the project. In addition, members can modify their own information except for the cn, sn, givenName, uid fields. Sun, 27 Jun 2010 20:51:13 +0200 http://www.stratuslab.org/doku.php?id=menu1 Home Contact Flyer Internal Sun, 27 Jun 2010 19:33:46 +0200 http://www.stratuslab.org/doku.php?id=operation_of_a_grid_site_in_a_commercial_public_cloud Grid and cloud technologies are potentially interesting complementary technologies. As a prelude to seeing how those technologies can be used together, this experiment will deploy an entire EGEE grid site within the Amazon cloud. The first purpose of this is to determine if there are any technical or procedural barriers to using cloud resources as part of the EGEE infrastructure. Once running, the managability of the cloud resources with standard system administrator tools will be evaluated. … Fri, 05 Jun 2009 17:00:51 +0200 http://www.stratuslab.org/doku.php?id=packages The packages for Scientific Linux 5 (CentOS 5, RHEL 5) are available from the project's yum repositories. The repository also contains required dependencies for the StratusLab cloud distribution. Released Packages Package Version Comments ruby* 1.8.6.287 OpenNebula dep. (REXML) sqlite* 3.7.0 OpenNebula dep. xmlrpc-c* 1.06.18 OpenNebula dep. scons 0.97 OpenNebula build dep. Development Snapshots Package Comments stratuslab StratusLab installation and user software oned Op… Mon, 16 Aug 2010 13:02:51 +0200 http://www.stratuslab.org/doku.php?id=partners The Linear Accelerator Laboratory (LAL) is located in Orsay, France just south of Paris and is supported by CNRS, IN2P3, and the Université Paris-Sud IX. Since 2001, the Service Informatique at LAL has participated in major grid projects and operates a large site within the EGEE production grid infrastructure. (The LAL grid resources are part of GRIF--a collaboration between six institutes in the Ile de France.) Tue, 15 Sep 2009 18:43:11 +0200 http://www.stratuslab.org/doku.php?id=presentations * CSIC graduate course on Grid & e-Science presentation at IFIC, Valencia, Spain, July 6-9, 2010 * Building Clouds with OpenNebula: A Grid Computing Perspective, XtreemOS summer school, Reisensburg Castle, Science Center of Ulm University Günzburg, Germany, July 5-9, 2010 * Operating a Grid Site in the Cloud, 4 March 2009, 4th EGEE User Forum/OGF25/2nd OGF Europe Event * Running a Grid Site in the Cloud, 28 May 2009, 4th HEPiX Spring 2009 * StratusLab Booth, 22-26 Sept 2009, EGEE 2009 … Thu, 12 Aug 2010 16:33:48 +0200 http://www.stratuslab.org/doku.php?id=press * StratusLab members participate in ISGTW Live Chat! 14 July 2010 * StratusLab Survey announcement in International Science Grid This Week (ISGTW), 7 July 2010 * The European Initiative to Integrate Cloud and Grid 22 Jun 2010, HPC in the Cloud * Press Release 14 June 2010 European Researchers Collaborate on International Project to Integrate ‘Cloud Computing’ with ‘Grid’ Technologies * Reported in: DSA Research Blog, Ajax World, Cloud Computing Journal, International Science Grid This… Thu, 22 Jul 2010 15:30:49 +0200 http://www.stratuslab.org/doku.php?id=press_release_20100614 News Release Paris, June 14th 2010: Researchers from a collaboration of six European organisations have attracted funding worth €2.3million to develop a new Internet-based software project called StratusLab. The two year project, headed up by Project Coordinator Dr Charles Loomis from CNRS, was launched in Paris today (14th June 2010). It aims to enhance distributed computing infrastructures, such as the European Grid Infrastructure (EGI), that allow research and higher education institutes fr… Tue, 27 Jul 2010 08:34:37 +0200 http://www.stratuslab.org/doku.php?id=press_release_fr_20100625 News Release Les scientifiques de six organismes européens ont obtenu un financement d’une valeur de 2,3 millions d’€ pour un nouveau projet de logiciel Internet appelé StratusLab. Ce projet de deux ans, dirigé par Charles Loomis du CNRS, a officiellement démarré à Paris le 14 juin 2010. Il vise à renforcer les infrastructures de calcul distribué, telle que l'infrastructure de grille européenne (EGI), qui permet aux instituts de recherche et d'enseignement supérieur du monde entier de mettre e… Tue, 13 Jul 2010 17:44:08 +0200 http://www.stratuslab.org/doku.php?id=provision_of_infrastructure_cloud-like_interfaces_to_grid_sites StratusLab is investigating how existing Grid infrastructures can provide cloud-like delivery paradigms as well as existing Grid services. The initiative is also exploring novel cloud-like paradigms to access Grid site resources, so also offering Science cloud services. This new resource provisioning model will address the emerging cloud-like usage patterns from several user communities. Public cloud interfaces would allow an alternative access to the virtual infrastructure to support the execut… Fri, 05 Jun 2009 10:24:11 +0200 http://www.stratuslab.org/doku.php?id=quattorinstall Layout of Installation This installation uses Quattor for an automated installation of one OpenNebula front-end and one or more OpenNebula nodes. The OpenNebula daemon runs on the front-end and controls the virtual machines running on all of the OpenNebula nodes/hosts. Fri, 20 Aug 2010 09:07:37 +0200 http://www.stratuslab.org/doku.php?id=serveraccess Most of the StratusLab services are integrated with a central LDAP server containing the usernames and passwords (along with more general information) for all of the project's participants. Personal Accounts To add your information to the LDAP server and thus create accounts on the various StratusLab servers, please do the following: Mon, 28 Jun 2010 16:27:01 +0200 http://www.stratuslab.org/doku.php?id=setting_up_quattor_server Quattor Toolkit The quattor toolkit and the Quattor Working Group templates allow a grid site to be easily setup and managed. We will capitalize on this to minimize the effort of deploying the grid services in the cloud. The quattor server installation instructions can be found on the SourceForge site. Amazon does not support using PXE to initialize a machine running in the AWS cloud. Consequently, there is little sense in installing the Automated Installation Infrastructure (AII) of quat… Tue, 02 Jun 2009 13:21:31 +0200 http://www.stratuslab.org/doku.php?id=sl4_tls_and_mutex_problems Problem Services that depend on the Berkeley Data Base (BDB) fail when running on SL4 in the Amazon cloud. A critical service that depends on BDB is the BDII. When using the standard installed packages, the BDII fails with an error like the following: Tue, 02 Jun 2009 13:18:06 +0200 http://www.stratuslab.org/doku.php?id=start The StratusLab initiative was started in November 2008 to explore the integration of cloud technologies and services, especially virtualisation, into existing Grid Infrastructures. We believe that hybrid platforms combining aspects of grid and cloud technologies offer advantages to both resource providers and to end-users. Using cloud technologies for resource provisioning would enhance failover and redundancy solutions, provide “elastic” sites able to expand available resources, and permit ma… Fri, 03 Sep 2010 20:25:06 +0200 http://www.stratuslab.org/doku.php?id=stratsulabbenchmarks To measure performance of StratusLab cloud implementation, we developed application-oriented benchmarks. These benchmarks covers : * CPU-intensive * Simulation * Analysis * Filtering * Shared Memory * Parallel * Workflow Actually we support RPM/YUM packages. Benchmarks binary can be downloaded from : Thu, 02 Sep 2010 15:39:02 +0200 http://www.stratuslab.org/doku.php?id=stratuslab_network_setup The StratusLab distribution uses OpenNebula to manage the virtual machines. This cloud system allows users to define their own network for their machines. This powerful feature can be hard to understand and to configure for normal users, that's why StratusLab has made the choice to create by default two networks available to all users. Tue, 24 Aug 2010 12:05:05 +0200 http://www.stratuslab.org/doku.php?id=stratuslabdependencies StratusLab require the following dependencies depending of the operation system. Ubuntu Tested version: Ubuntu server 10.04 Front-end Package installed from the standard repositories: * ruby * libsqlite3-dev * libxmlrpc-c3-dev * libssl-dev * scons * g++ * git-core * ssh * genisoimage * curl * libxml2-dev (one 2.0 only) * xen-hypervisor-3.3 (optional) * qemu-kvm (optional) * nfs-kernel-server (optional) Fri, 27 Aug 2010 11:50:25 +0200 http://www.stratuslab.org/doku.php?id=stratuslabpackaging StratusLab ships as RPM and DEB (TODO). The packages have dependencies on the ONE package (also packaged by StratusLab, including its dependencies). However, depending on the hypervisor (i.e. KVM, XEN) we want to use and the share strategy (e.g. SSH, NFS), more packages are required to complete the installation. Therefore, depending on the installation strategy (e.g. manual, Quattor), further installation is required. Mon, 16 Aug 2010 12:52:18 +0200 http://www.stratuslab.org/doku.php?id=stratuslabvo StratusLab VO A VO has been created by StratusLab and registered in the EGI infrastructure. The purpose of this VO is to be used for site deployment tests, performance tests and running of sample applications in the context of the project. All grid sites deployed by the project should support this VO. Below are the information needed for enrolling in the VO and configuring the sites to support it. Wed, 25 Aug 2010 13:48:24 +0200 http://www.stratuslab.org/doku.php?id=tools Bug and Progress Tracking The project uses Jira for tracking tasks and issues. The Greenhopper plugin helps the project take advantage of agile development techniques. The servers are open only to project participants; others should use the appropriate mailing lists to reports problems. See the page on requesting an account to access the server. Fri, 13 Aug 2010 09:59:21 +0200