Difference: FJPPLComputing (1 vs. 11)
Revision 112020-09-18 - Main.IsabelleRippBaudot
| Line: 1 to 1 | ||||||||
|---|---|---|---|---|---|---|---|---|
| ||||||||
| Line: 13 to 13 | ||||||||
| Japanese members : T. Nakamura, W. Takase, S. Kaneko, T. Sasaki, S. Suzuki, G. Iwai, K. Murakami | ||||||||
| Deleted: | ||||||||
| < < | References website | |||||||
|
| ||||||||
| Line: 37 to 33 | ||||||||
| Japanese members : I. Ueda, H. Miyake, T. Hara, Y. Kato | ||||||||
| Deleted: | ||||||||
| < < | References website | |||||||
|
| ||||||||
Revision 102020-09-18 - Main.IsabelleRippBaudot
| Line: 1 to 1 | ||||||||
|---|---|---|---|---|---|---|---|---|
| ||||||||
| Line: 24 to 24 | ||||||||
|
Summary: | ||||||||
| Added: | ||||||||
| > > | The Belle II experiment, the next generation of the B-Factory, is expected to reveal new physics by accumulating, by 2029, about 2 orders of magnitude larger data sample than the Belle experiment, a similar quantity of data than LHC experiments acquired at similar rates. This requires considerable computing, storage and network resources to handle not only data created by the experiment but also considerable amounts of simulated data. The Belle II computing system has to handle an amount of beam data eventually corresponding to several tens of PetaByte per year under an operation of the SuperKEKB accelerator with a designed instantaneous luminosity. Under this situation, it cannot be expected that a single site, KEK, will be able to provide all computing resources for the whole Belle II collaboration including the resources not only for the raw data processing but also for the MC production and physics analysis done by users. In order to solve this problem, Belle II employed the distributed computing system based on DIRAC, which provides the interoperability of heterogeneous computing systems such as grids with different middleware, clouds and the local computing clusters. Since the last few years, MC mass production campaigns have been performed to confirm the feasibility and find out the possible bottleneck of our computing system. In parallel, the data transfer challenge through the transpacific and transatlantic networks has started. In terms of the computing, the first priority at KEK is the raw data acquisition and processing. Therefore, other data centers (at BNL, Germany, Italy, Canada and France) with reprocessing capabilities will be crucial component of the Belle II computing system. In addition, at the early stage of the experiment, that is until the detector performances are well understood, the software and the detector constants will be often updated and consequently the raw data will have to be re-processed frequently. A raw data center in France will store, from 2021, 15% of the total Belle II data sample and should be able to reprocess several times those data. The project aim is to study solutions for the Belle II computing in France, and to find a system capable of handling raw data and produce the simulated data requested (including cloud resources). The collaboration proposed in this application, with an experienced KEK team fully involved in the Belle II computing since last few years, will allow us to prepare efficiently for a raw data center in France (with regular meetings in France and at KEK). | |||||||
Revision 92020-04-03 - Main.IsabelleRippBaudot
| Line: 1 to 1 | ||||||||
|---|---|---|---|---|---|---|---|---|
| ||||||||
| Changed: | ||||||||
| < < | ||||||||
| > > | ||||||||
|
Summary : | ||||||||
| Changed: | ||||||||
| < < | COMP_01 is a cooperation between French and Japanese teams in R&D on ATLAS distributed computing for the LHC Run 2 (2015~2018) and Run 3 preparation. This cooperation between French and Japanese teams on ATLAS distributed computing has been lasting for ten years, and is a continuation of previous projects like “LHC_02” (2006-2012) and “LHC_07” (2013-2014). Its main goal is to tackle important challenges of the next years: new computing model, hardware, software, and networking issues. The partners are The International Center for Elementary Particle Physics (ICEPP), the University of Tokyo (WLCG (Worldwide LHC Computing Grid) Japanese Tier-2 center for ATLAS) and French Tier-2 centers/Tier-1 center (Lyon). ICEPP Tier-2 provides resources for ATLAS only (one of the largest Tier-2 centers for ATLAS) and is “associated with” the Tier-1 center in Lyon. A major interest in the past has been the efficient use of wide area network, especially for the transfer between the ICEPP Tier-2 and the various remote sites in Europe. The emphasis has moved now to the LHC Run 2 optimization, as well as the preparation of the Run 3 and its challenges in terms of networking, CPU and storage. | |||||||
| > > | This project is a continued collaborative work for joint research and development between Japan’s KEK and France’s IN2P3 computing centers. It aims at conducting exploratory work on emerging computing technologies of potential interest for building and operating data processing infrastructures for future physics research experiments. This year we focus in particular on two aspects. First, we will work towards the deployment of tools for continuous and on-demand monitoring of the international network circuit linking both computing centers, in particular for bulk data transfer needs. Second, we will start an exploratory work to understand how to exploit and operate a multi-host GPU-based platform for the simulation of physical processes in the framework of the Geant4-DNA project. It is expected that the experience gained by experts of both institutions working together will allow their sites to serve current and future physics experiments of KEK’s and IN2P3’s independent research programs. | |||||||
|
French members : | ||||||||
| Changed: | ||||||||
| < < | L. Poggioli, C. Biscarat, S. Jezequel, M. Jouvin, J-P. Meyer, E. Vamvakopoulos, R. Vernet | |||||||
| > > | R. Vernet, G. Rahal, F. Hernandez, F. Suter, B. Rigaud, V. Hamar | |||||||
|
Japanese members : | ||||||||
| Changed: | ||||||||
| < < | T. Mashimo, T. Kawamoto, . Kishimoto, N. Matsui, T. Nakamura, H. Sakamoto, I. Ueda | |||||||
| > > | T. Nakamura, W. Takase, S. Kaneko, T. Sasaki, S. Suzuki, G. Iwai, K. Murakami | |||||||
| References | ||||||||
| Line: 21 to 19 | ||||||||
|
| ||||||||
| Changed: | ||||||||
| < < | ||||||||
| > > |
| |||||||
|
Summary : | ||||||||
| Changed: | ||||||||
| < < | This project is a continued collaborative work for joint research and development between Japan’s KEK and France’s IN2P3 computing centers. It aims at conducting exploratory work on emerging computing technologies of potential interest for building and operating data processing infrastructures for future physics research experiments. This year we focus in particular on two aspects. First, we will work towards the deployment of tools for continuous and on-demand monitoring of the international network circuit linking both computing centers, in particular for bulk data transfer needs. Second, we will start an exploratory work to understand how to exploit and operate a multi-host GPU-based platform for the simulation of physical processes in the framework of the Geant4-DNA project. It is expected that the experience gained by experts of both institutions working together will allow their sites to serve current and future physics experiments of KEK’s and IN2P3’s independent research programs. | |||||||
| > > | ||||||||
|
French members : | ||||||||
| Changed: | ||||||||
| < < | F. Hernandez, L. Caillat-Vallet, V. Hamar, P-E. Macchi, M. Puel, G. Rahal, R. Rumler, S. Incerti | |||||||
| > > | K. Trabelsi, S. Watanuki, M. Jouvin, G. Philippon, A. Vedaee, Y. Patois | |||||||
|
Japanese members : | ||||||||
| Changed: | ||||||||
| < < | T. Nakamura, G. Iwai, H. Matsunaga, K. Murakami, T. Sasaki, S. Suzuki, W. Takase, Y. Watase | |||||||
| > > | I. Ueda, H. Miyake, T. Hara, Y. Kato | |||||||
| References | ||||||||
Revision 82017-09-20 - Main.GenevieveGilbert
| Line: 1 to 1 | ||||||||
|---|---|---|---|---|---|---|---|---|
| ||||||||
| Added: | ||||||||
| > > | COMP_01 is a cooperation between French and Japanese teams in R&D on ATLAS distributed computing for the LHC Run 2 (2015~2018) and Run 3 preparation. This cooperation between French and Japanese teams on ATLAS distributed computing has been lasting for ten years, and is a continuation of previous projects like “LHC_02” (2006-2012) and “LHC_07” (2013-2014). Its main goal is to tackle important challenges of the next years: new computing model, hardware, software, and networking issues. The partners are The International Center for Elementary Particle Physics (ICEPP), the University of Tokyo (WLCG (Worldwide LHC Computing Grid) Japanese Tier-2 center for ATLAS) and French Tier-2 centers/Tier-1 center (Lyon). ICEPP Tier-2 provides resources for ATLAS only (one of the largest Tier-2 centers for ATLAS) and is “associated with” the Tier-1 center in Lyon. A major interest in the past has been the efficient use of wide area network, especially for the transfer between the ICEPP Tier-2 and the various remote sites in Europe. The emphasis has moved now to the LHC Run 2 optimization, as well as the preparation of the Run 3 and its challenges in terms of networking, CPU and storage. | |||||||
|
French members : | ||||||||
| Line: 20 to 24 | ||||||||
| Changed: | ||||||||
| < < | This project is a continued collaborative work for joint research and development between Japan’s KEK and France’s IN2P3 computing centers. It aims at conducting exploratory work on emerging computing technologies of potential interest for building and operating data processing infrastructures for future physics research experiments. This year we focus in particular on two aspects. First, we will work towards the deployment of tools for continuous and on-demand monitoring of the international network circuit linking both computing centers, in particular for bulk data transfer needs. Second, we will start an exploratory work to understand how to exploit and operate a multi-host GPU-based platform for the simulation of physical processes in the framework of the Geant4-DNA project. It is expected that the experience gained by experts of both institutions working together will allow their sites to serve current and future physics experiments of KEK’s and IN2P3’s independent research programs. | |||||||
| > > | This project is a continued collaborative work for joint research and development between Japan’s KEK and France’s IN2P3 computing centers. It aims at conducting exploratory work on emerging computing technologies of potential interest for building and operating data processing infrastructures for future physics research experiments. This year we focus in particular on two aspects. First, we will work towards the deployment of tools for continuous and on-demand monitoring of the international network circuit linking both computing centers, in particular for bulk data transfer needs. Second, we will start an exploratory work to understand how to exploit and operate a multi-host GPU-based platform for the simulation of physical processes in the framework of the Geant4-DNA project. It is expected that the experience gained by experts of both institutions working together will allow their sites to serve current and future physics experiments of KEK’s and IN2P3’s independent research programs. | |||||||
|
French members : | ||||||||
Revision 72017-06-29 - Main.GenevieveGilbert
| Line: 1 to 1 | ||||||||
|---|---|---|---|---|---|---|---|---|
| ||||||||
| Added: | ||||||||
| > > | French members : L. Poggioli, C. Biscarat, S. Jezequel, M. Jouvin, J-P. Meyer, E. Vamvakopoulos, R. Vernet Japanese members : T. Mashimo, T. Kawamoto, . Kishimoto, N. Matsui, T. Nakamura, H. Sakamoto, I. Ueda References website | |||||||
Revision 62016-08-31 - Main.GenevieveGilbert
| Line: 1 to 1 | ||||||||
|---|---|---|---|---|---|---|---|---|
| ||||||||
| Deleted: | ||||||||
| < < | ||||||||
| Line: 5 to 3 | ||||||||
| Changed: | ||||||||
| < < | This project is a collaborative work for joint research and development between Japan’s KEK and France’s IN2P3 computing centers. It aims at conducting exploratory work on emerging computing technologies of potential interest for building and operating data processing infrastructures for future physics research experiments. This year we focus in particular in 3 aspects: building customizable computing environments exploiting virtualization of computing and storage platforms using the OpenStack software suite, monitoring and tuning international network links for high performance data transfer and sharing experience on machine room design leveraging the experience gained by IN2P3 operating its second machine room. It is expected that the experience gained by experts of both institutions working together will allow their sites to better serve current and future physics experiments of KEK’s and IN2P3 ’s independent research programs. | |||||||
| > > | This project is a continued collaborative work for joint research and development between Japan’s KEK and France’s IN2P3 computing centers. It aims at conducting exploratory work on emerging computing technologies of potential interest for building and operating data processing infrastructures for future physics research experiments. This year we focus in particular on two aspects. First, we will work towards the deployment of tools for continuous and on-demand monitoring of the international network circuit linking both computing centers, in particular for bulk data transfer needs. Second, we will start an exploratory work to understand how to exploit and operate a multi-host GPU-based platform for the simulation of physical processes in the framework of the Geant4-DNA project. It is expected that the experience gained by experts of both institutions working together will allow their sites to serve current and future physics experiments of KEK’s and IN2P3’s independent research programs. | |||||||
|
French members : | ||||||||
| Changed: | ||||||||
| < < | F. Hernandez, L. Caillat-Vallet, V. Hamar, P-E. Macchi, M. Puel, G. Rahal, R. Rumler | |||||||
| > > | F. Hernandez, L. Caillat-Vallet, V. Hamar, P-E. Macchi, M. Puel, G. Rahal, R. Rumler, S. Incerti | |||||||
|
Japanese members : T. Nakamura, G. Iwai, H. Matsunaga, K. Murakami, T. Sasaki, S. Suzuki, W. Takase, Y. Watase | ||||||||
Revision 52016-08-02 - Main.GenevieveGilbert
| Line: 1 to 1 | ||||||||
|---|---|---|---|---|---|---|---|---|
| ||||||||
| Deleted: | ||||||||
| < < | ||||||||
| Deleted: | ||||||||
| < < | Summary: The project COMP_01, "R&D for ATLAS GRID computing", is the successor of the project LHC_02, "ATLAS computing" which was carried out in years 2006 through 2012. The goal of the project is to meet the challenges in the ATLAS distributed computing in the coming years and run the Tier-2 centers efficiently, sharing ideas and experiences of the partners. The main topics addressed by the collaboration are the efficient use of the wide area network, especially for the data transfer between the Tier-2 center at the ICEPP, the University of Tokyo, and the remote sites in Europe, etc., and adaptation to a new ATLAS computing model and new protocols of data transfer to cope with ever increasing amount of data and for efficient use of Gird sites. Exploitation of many core CPUs with multi-thread ATLAS applications and use of virtual machines are also the topics covered in the project. French members : E. Lançon, C. Biscarat, S. Jézéquel, M. Jouvin, J-P. Meyer, L. Poggioli, E. Vamvakopoulos, R. Vernet Japanese members : T. Mashimo, T. Kawamoto, N. Matsui, T. Nakamura, H. Sakamoto, I. Ueda | |||||||
|
| ||||||||
Revision 42015-09-24 - Main.GenevieveGilbert
| Line: 1 to 1 | ||||||||
|---|---|---|---|---|---|---|---|---|
| ||||||||
| Line: 22 to 22 | ||||||||
| Added: | ||||||||
| > > | This project is a collaborative work for joint research and development between Japan’s KEK and France’s IN2P3 computing centers. It aims at conducting exploratory work on emerging computing technologies of potential interest for building and operating data processing infrastructures for future physics research experiments. This year we focus in particular in 3 aspects: building customizable computing environments exploiting virtualization of computing and storage platforms using the OpenStack software suite, monitoring and tuning international network links for high performance data transfer and sharing experience on machine room design leveraging the experience gained by IN2P3 operating its second machine room. It is expected that the experience gained by experts of both institutions working together will allow their sites to better serve current and future physics experiments of KEK’s and IN2P3 ’s independent research programs. | |||||||
|
French members : | ||||||||
Revision 32015-07-14 - Main.PhilipBambade
| Line: 1 to 1 | ||||||||
|---|---|---|---|---|---|---|---|---|
| ||||||||
| Changed: | ||||||||
| < < | Summary | |||||||
| > > | Summary: The project COMP_01, "R&D for ATLAS GRID computing", is the successor of the project LHC_02, "ATLAS computing" which was carried out in years 2006 through 2012. The goal of the project is to meet the challenges in the ATLAS distributed computing in the coming years and run the Tier-2 centers efficiently, sharing ideas and experiences of the partners. The main topics addressed by the collaboration are the efficient use of the wide area network, especially for the data transfer between the Tier-2 center at the ICEPP, the University of Tokyo, and the remote sites in Europe, etc., and adaptation to a new ATLAS computing model and new protocols of data transfer to cope with ever increasing amount of data and for efficient use of Gird sites. Exploitation of many core CPUs with multi-thread ATLAS applications and use of virtual machines are also the topics covered in the project. | |||||||
|
French members : | ||||||||
| Changed: | ||||||||
| < < | E. Lançon, C. Biscarat, S. Jézéquel, M. Jouvin, J-P. Meyer, L. Poggioli, E. Vamvakopoulos, E. Vernet | |||||||
| > > | E. Lançon, C. Biscarat, S. Jézéquel, M. Jouvin, J-P. Meyer, L. Poggioli, E. Vamvakopoulos, R. Vernet | |||||||
|
Japanese members : T. Mashimo, T. Kawamoto, N. Matsui, T. Nakamura, H. Sakamoto, I. Ueda | ||||||||
| Deleted: | ||||||||
| < < | References website | |||||||
|
| ||||||||
Revision 22015-07-13 - Main.PhilipBambade
| Line: 1 to 1 | ||||||||
|---|---|---|---|---|---|---|---|---|
| ||||||||
| Changed: | ||||||||
| < < | E. Lançon , C. Biscarat, S. Jézéquel, M. Jouvin, J-P. Meyer, L. Poggioli, E. Vamvakopoulos, E. Vernet | |||||||
| > > | E. Lançon, C. Biscarat, S. Jézéquel, M. Jouvin, J-P. Meyer, L. Poggioli, E. Vamvakopoulos, E. Vernet | |||||||
|
Japanese members : T. Mashimo, T. Kawamoto, N. Matsui, T. Nakamura, H. Sakamoto, I. Ueda | ||||||||
| Line: 19 to 19 | ||||||||
| Changed: | ||||||||
| < < | R&D of distributed computing for future large projects like ILC • Evaluate and gain experience of emerging technologies such as cloud • More studies on data storage and data transfer • Both topics will be seen from the long distance point of view To exchange ideas and knowledge between the two centers • Re-establish the collaboration beyond the previous Comp_3 project • Long-term collaboration has a benefit | |||||||
| > > | ||||||||
|
French members : | ||||||||
| Changed: | ||||||||
| < < | P-E. Macchi, L. Caillat-Vallet, V. Hamar, M. Puel, G. Rahal, R. Rumler | |||||||
| > > | F. Hernandez, L. Caillat-Vallet, V. Hamar, P-E. Macchi, M. Puel, G. Rahal, R. Rumler | |||||||
|
Japanese members : | ||||||||
| Changed: | ||||||||
| < < | H. Matsunaga, G. Iwai, K. Murakami, T. Sasaki, S. Suzuki, W. Takase, Y. Watase | |||||||
| > > | T. Nakamura, G. Iwai, H. Matsunaga, K. Murakami, T. Sasaki, S. Suzuki, W. Takase, Y. Watase References website | |||||||
|
| ||||||||
Revision 12015-06-23 - Main.GenevieveGilbert
| Line: 1 to 1 | ||||||||
|---|---|---|---|---|---|---|---|---|
| Added: | ||||||||
| > > |
E. Lançon , C. Biscarat, S. Jézéquel, M. Jouvin, J-P. Meyer, L. Poggioli, E. Vamvakopoulos, E. Vernet Japanese members : T. Mashimo, T. Kawamoto, N. Matsui, T. Nakamura, H. Sakamoto, I. Ueda References website R&D of distributed computing for future large projects like ILC • Evaluate and gain experience of emerging technologies such as cloud • More studies on data storage and data transfer • Both topics will be seen from the long distance point of view To exchange ideas and knowledge between the two centers • Re-establish the collaboration beyond the previous Comp_3 project • Long-term collaboration has a benefit French members : P-E. Macchi, L. Caillat-Vallet, V. Hamar, M. Puel, G. Rahal, R. Rumler Japanese members : H. Matsunaga, G. Iwai, K. Murakami, T. Sasaki, S. Suzuki, W. Takase, Y. Watase | |||||||
View topic | History: r11 < r10 < r9 < r8 | More topic actions...
Copyright &© by the contributing authors. All material on this collaboration platform is the property of the contributing authors. Ideas, requests, problems regarding TWiki? Send feedback