Difference: ComputingandSoftwarePublicResults (10 vs. 11)

Revision 112018-11-15 - DavideCostanzo1

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
<!--  
Line: 40 to 40
 
Added:
>
>

Estimated total disk resources (in PBytes) needed for the years 2018 to 2032 for both data and simulation processing. The plot updates the projection made in 2017 which was based on the Run-2 computing model and with updated LHC expected running conditions. The blue points show the improvements possible in two different scenarios, which require significant development work (1) top curve, reduction of AOD and DAOD size of 30% compared to the Run-2 trend, bottom curve further reduction with the inclusion of a common DAOD format to be used by most analysis, removal of previous year AODs from disk and the storage of only one DAOD version. The solid line shows the amount of resources expected to be available if a flat funding scenario is assumed, which implies an increase of 15% per year, based on the current technology trends. diskHLLHC_noold.png
pdf-file, png-file
Estimated total disk resources (in PBytes) needed for the years 2018 to 2032 for both data and simulation processing. The plot updates the projection made in 2017 which was based on the Run-2 computing model and with updated LHC expected running conditions. The brown points are estimates made in 2017 and based on the current event sizes and using the ATLAS computing model parameters from 2017. The blue points show the improvements possible in two different scenarios, which require significant development work: (1) top curve, reduction of AOD and DAOD size of 30% compared to the Run-2 trend, bottom curve further reduction with the inclusion of a common DAOD format to be used by most analysis, removal of previous year AODs from disk and the storage of only one DAOD version. The solid line shows the amount of resources expected to be available if a flat funding scenario is assumed, which implies an increase of 15% per year, based on the current technology trends. diskHLLHC_18.png
pdf-file, png-file
Fraction of disk resources needed in 2028 at the end of Run-4 for different data types. This plot: assuming a reduction in size of 30% of AOD and DAOD. disk2028_baseline.png
pdf-file, png-file
Fraction of disk resources needed in 2028 at the end of Run-4 for different data types. This plot: a further reduction with the inclusion of a common DAOD format to be used by most analysis, removal of previous year AODs from disk and the storage of only one DAOD version. . disk2028_reduced.png
pdf-file, png-file
Estimated CPU resources (in MHS06) needed for the years 2018 to 2032 for both data and simulation processing. The plot updates the projection made in 2017 (which was based on the Run-2 computing model) with updated LHC running conditions and revised scenarios for future computing models. The blue points show the improvements possible in three different scenarios, which require significant development work: (1) top curve with fast calo sim used for 75% of the Monte Carlo simulation; (2) middle curve using in addition a faster version of reconstruction, which is seeded by the event generator information; (3) bottom curve, where the time spent in event generation is halved, either by software improvements or re-using some of the events. The solid line shows the amount of resources expected to be available if a flat funding scenario is assumed, which implies an increase of 20% per year, based on the current technology trends. cpuHLLHC_noold.png
pdf-file, png-file
Estimated CPU resources (in MHS06) needed for the years 2018 to 2032 for both data and simulation processing. The plot updates the projection made in 2017 (which was based on the Run-2 computing model) with updated LHC running conditions and revised scenarios for future computing models. The brown points are estimates made in 2017, based on the current software performance estimates and using the ATLAS computing model parameters from 2017. The blue points show the improvements possible in three different scenarios, which require significant development work: (1) top curve with fast calo sim used for 75% of the Monte Carlo simulation; (2) middle curve using in addition a faster version of reconstruction, which is seeded by the event generator information; (3) bottom curve, where the time spent in event generation is halved, either by software improvements or by re-using some of the events. The solid line shows the amount of resources expected to be available if a flat funding scenario is assumed, which implies an increase of 20% per year, based on the current technology trends. cpuHLLHC_18.png
pdf-file, png-file
Fraction of CPU resources needed in 2028 at the end of Run-4 for different processing workflows.The “MC-Full” section in green is related to the fraction of time spent on the full AtlasG4 simulation and divided in a simulation part “(Sim)” for the Geant4 simulation and a reconstruction part “(Rec)” accounting the time spent reconstructing the events. Similarly, the “MC-Fast” section in red shows this distribution for the time spent running the Fast Calo simulation. This plot: using fast calo sim for 75% of the Monte Carlo simulation and standard reconstruction. cpu2028.png
pdf-file, png-file
Fraction of CPU resources needed in 2028 at the end of Run-4 for different processing workflows.The “MC-Full” section in green is related to the fraction of time spent on the full AtlasG4 simulation and divided in a simulation part “(Sim)” for the Geant4 simulation and a reconstruction part “(Rec)” accounting the time spent reconstructing the events. Similarly, the “MC-Fast” section in red shows this distribution for the time spent running the Fast Calo simulation. This plot: using in addition a faster version of reconstruction, which is seeded by the event generator information, and assuming event generation is sped up by a factor of two. cpu2028_fast.png
pdf-file, png-file
 
Changed:
<
<
Estimated total disk resources (in PBytes) needed for the years 2018 to 2028 for both data and simulation processing. The blue points are estimates based on the current event sizes estimates and using the ATLAS computing model parameters from 2017. The solid line shows the amount of resources expected to be available if a flat funding scenario is assumed, which implies an increase of 15% per year, based on the current technology trends.
>
>
OBSOLETE: Estimated total disk resources (in PBytes) needed for the years 2018 to 2028 for both data and simulation processing. The blue points are estimates based on the current event sizes estimates and using the ATLAS computing model parameters from 2017. The solid line shows the amount of resources expected to be available if a flat funding scenario is assumed, which implies an increase of 15% per year, based on the current technology trends.
 
diskHLLHC.png
Line: 52 to 127
 
Changed:
<
<
Estimated CPU resources (in kHS06) needed for the years 2018 to 2028 for both data and simulation processing. The blue points are estimates based on the current software performance estimates and using the ATLAS computing model parameters from 2017. The solid line shows the amount of resources expected to be available if a flat funding scenario is assumed, which implies an increase of 20% per year, based on the current technology trends.
>
>
OBSOLETE: Estimated CPU resources (in kHS06) needed for the years 2018 to 2028 for both data and simulation processing. The blue points are estimates based on the current software performance estimates and using the ATLAS computing model parameters from 2017. The solid line shows the amount of resources expected to be available if a flat funding scenario is assumed, which implies an increase of 20% per year, based on the current technology trends.
 
cpuHLLHC.png
Line: 336 to 411
 
META FILEATTACHMENT attachment="reco_WtPerEvent_NOfit_revised.pdf" attr="" comment="" date="1537187710" name="reco_WtPerEvent_NOfit_revised.pdf" path="reco_WtPerEvent_NOfit_revised.pdf" size="62563" user="guenther" version="1"
META FILEATTACHMENT attachment="reco_WtPerEvent_NOfit_revised.png" attr="" comment="" date="1537186820" name="reco_WtPerEvent_NOfit_revised.png" path="reco_WtPerEvent_NOfit_revised.png" size="66438" user="guenther" version="1"
META FILEATTACHMENT attachment="reco_WtPerEvent_NOfit_revised_copy.pdf" attr="" comment="" date="1537187881" name="reco_WtPerEvent_NOfit_revised_copy.pdf" path="reco_WtPerEvent_NOfit_revised_copy.pdf" size="62563" user="guenther" version="1"
Added:
>
>
META FILEATTACHMENT attachment="diskHLLHC_18.pdf" attr="" comment="" date="1542264412" name="diskHLLHC_18.pdf" path="diskHLLHC_18.pdf" size="15877" user="costanzo" version="1"
META FILEATTACHMENT attachment="diskHLLHC_18.png" attr="h" comment="" date="1542266176" name="diskHLLHC_18.png" path="diskHLLHC_18.png" size="128321" user="costanzo" version="2"
META FILEATTACHMENT attachment="cpuHLLHC_18.png" attr="h" comment="" date="1542264846" name="cpuHLLHC_18.png" path="cpuHLLHC_18.png" size="145666" user="costanzo" version="1"
META FILEATTACHMENT attachment="cpuHLLHC_18.pdf" attr="h" comment="" date="1542264846" name="cpuHLLHC_18.pdf" path="cpuHLLHC_18.pdf" size="16263" user="costanzo" version="1"
META FILEATTACHMENT attachment="cpuHLLHC_noold.png" attr="h" comment="" date="1542265024" name="cpuHLLHC_noold.png" path="cpuHLLHC_noold.png" size="138141" user="costanzo" version="1"
META FILEATTACHMENT attachment="cpuHLLHC_noold.pdf" attr="h" comment="" date="1542265024" name="cpuHLLHC_noold.pdf" path="cpuHLLHC_noold.pdf" size="16221" user="costanzo" version="1"
META FILEATTACHMENT attachment="diskHLLHC_noold.png" attr="h" comment="" date="1542266391" name="diskHLLHC_noold.png" path="diskHLLHC_noold.png" size="120874" user="costanzo" version="1"
META FILEATTACHMENT attachment="diskHLLHC_noold.pdf" attr="h" comment="" date="1542266391" name="diskHLLHC_noold.pdf" path="diskHLLHC_noold.pdf" size="15825" user="costanzo" version="1"
META FILEATTACHMENT attachment="cpu2028.png" attr="h" comment="" date="1542266657" name="cpu2028.png" path="cpu2028.png" size="95569" user="costanzo" version="1"
META FILEATTACHMENT attachment="cpu2028.pdf" attr="h" comment="" date="1542266657" name="cpu2028.pdf" path="cpu2028.pdf" size="17331" user="costanzo" version="1"
META FILEATTACHMENT attachment="cpu2028_fast.png" attr="h" comment="" date="1542266784" name="cpu2028_fast.png" path="cpu2028_fast.png" size="98429" user="costanzo" version="1"
META FILEATTACHMENT attachment="cpu2028_fast.pdf" attr="h" comment="" date="1542266784" name="cpu2028_fast.pdf" path="cpu2028_fast.pdf" size="18435" user="costanzo" version="1"
META FILEATTACHMENT attachment="disk2028_baseline.png" attr="" comment="" date="1542266976" name="disk2028_baseline.png" path="disk2028_baseline.png" size="73552" user="costanzo" version="1"
META FILEATTACHMENT attachment="disk2028_baseline.pdf" attr="" comment="" date="1542266976" name="disk2028_baseline.pdf" path="disk2028_baseline.pdf" size="14689" user="costanzo" version="1"
META FILEATTACHMENT attachment="disk2028_reduced.png" attr="h" comment="" date="1542267144" name="disk2028_reduced.png" path="disk2028_reduced.png" size="76704" user="costanzo" version="1"
META FILEATTACHMENT attachment="disk2028_reduced.pdf" attr="h" comment="" date="1542267144" name="disk2028_reduced.pdf" path="disk2028_reduced.pdf" size="15120" user="costanzo" version="1"
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback