{"id":6411,"date":"2024-11-09T00:34:39","date_gmt":"2024-11-09T00:34:39","guid":{"rendered":"https:\/\/annualreports.es.net\/?page_id=6411"},"modified":"2025-10-01T03:20:03","modified_gmt":"2025-10-01T03:20:03","slug":"2023-esnet-turns-on-400-gbps-circuits-to-five-doe-national-labs","status":"publish","type":"page","link":"https:\/\/annualreports.es.net\/index.php\/2023-esnet-turns-on-400-gbps-circuits-to-five-doe-national-labs\/","title":{"rendered":"ESnet Turns on 400 Gbps Circuits to Five DOE National Labs"},"content":{"rendered":"\n<div class=\"wp-block-obb-width-block organic-block obb-width clearfix\" style=\"max-width:2400px\"><div class=\"obb-width-content\">\n<div class=\"wp-block-group is-layout-constrained wp-block-group-is-layout-constrained\">\n<p class=\"has-source-sans-3-font-family\">Today\u2019s critical scientific research is being conducted by collaborators at far-flung national laboratories who require high-speed, low-latency access to high performance computing facilities and specialized instruments. In 2023, ESnet supercharged the bandwidth for five DOE national laboratories and user facilities, unleashing 400 Gigabit per second capability for Argonne National Laboratory (ANL), Brookhaven National Laboratory (BNL), Oak Ridge National Laboratory (ORNL), and Pacific Northwest National Laboratory (PNNL) as well as the National Energy Research Scientific Computing Center (NERSC).&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-pullquote alignright\" style=\"border-style:none;border-width:0px;border-radius:0px\"><blockquote><p>&#8220;<em>Enabling 400 Gbps is transformational \u2013 it opens up new ways of performing science integrated across multiple DOE fac<\/em>ilities.&#8221;<\/p><cite>\u2014Debbie Bard, NERSC Science Engagement and Workflows Group Lead<\/cite><\/blockquote><\/figure>\n\n\n\n<p class=\"has-source-sans-3-font-family\">With this boost in capacity, scientists can process, analyze, visualize, share, and store the enormous quantities of research data at speeds much faster than previously possible. For example, ORNL leads the Earth Systems Grid Federation project (ESGF2) to improve the discovery, access, and storage of data used for Earth System models and simulations and climate change research. The collaborative project, which includes ANL and Lawrence Livermore National Laboratory, is already taking advantage of ESnet to move the planet\u2019s largest collection of Earth System model output data between DOE high-performance computing and data facilities. The integration of ESnet is dramatically enhancing data-intensive science, facilitating data sharing, and improving access to simulation and AI platforms.<\/p>\n\n\n\n<p class=\"has-source-sans-3-font-family\">And at the Environmental Molecular Sciences Laboratory, an Office of Science user facility located at PNNL, researchers have embarked on a project known as the Molecular Observation Network, a nationwide effort to understand the processes that govern what happens to carbon in soil. More carbon resides in Earth\u2019s soil than in the atmosphere and vegetation combined, and its fate plays a huge role in our climate. It\u2019s an incredibly active environment, with scientists collecting reams of data about soil processes. The upgraded network makes it possible to transfer hundreds of gigabytes of project data in just a few minutes, not the hours previously required. The near real-time, constant data feed makes the autonomous experimentation planned at EMSL easier to implement.<\/p>\n\n\n\n<div class=\"wp-block-media-text is-stacked-on-mobile\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"683\" src=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/10\/ESNet_400G_press_PNNL_Web-Size-MoNET_Field-53-1200px-1024x683.jpg\" alt=\"\" class=\"wp-image-6109 size-full\" srcset=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/10\/ESNet_400G_press_PNNL_Web-Size-MoNET_Field-53-1200px-1024x683.jpg 1024w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/10\/ESNet_400G_press_PNNL_Web-Size-MoNET_Field-53-1200px-300x200.jpg 300w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/10\/ESNet_400G_press_PNNL_Web-Size-MoNET_Field-53-1200px-768x512.jpg 768w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/10\/ESNet_400G_press_PNNL_Web-Size-MoNET_Field-53-1200px.jpg 1200w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p><em>Scientists at Pacific Northwest National Laboratory extract a foot-long soil core for study through the Molecular Observation Network. (Photo Credit: Andrea Starr, PNNL)<\/em><br><\/p>\n<\/div><\/div>\n\n\n\n<p class=\"has-source-sans-3-font-family\">As one of ASCR\u2019s three high performance computing facilities, NERSC will see an immediate benefit from the 400 Gbps upgrade. Increasingly, NERSC\u2019s more than 9,000 users move data in and out of the data center in two main ways. The first is by transferring large datasets (simulated or from an experiment) between ASCR facilities as scientists take advantage of the specialized computing available at each site. The other is by moving data from DOE experimental and observational facilities for analysis. This analysis can be very time-sensitive, with scientists requiring quick turnarounds to inform running experiments.<\/p>\n\n\n\n<p class=\"has-source-sans-3-font-family\">\u201cThe ESnet6 upgrade is essential to maintaining scientific productivity as data is increasingly transferred between experiment and computing sites,\u201d said Debbie Bard, group lead for Science Engagement and Workflows at NERSC. \u201cEnabling 400 Gbps is transformational \u2013 it opens up new ways of performing science integrated across multiple DOE facilities.\u201d<\/p>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"257\" data-id=\"6117\" src=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/10\/bnl_logo_horizontal_cmyk-1200px-1024x257.jpg\" alt=\"\" class=\"wp-image-6117\" srcset=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/10\/bnl_logo_horizontal_cmyk-1200px-1024x257.jpg 1024w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/10\/bnl_logo_horizontal_cmyk-1200px-300x75.jpg 300w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/10\/bnl_logo_horizontal_cmyk-1200px-768x193.jpg 768w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/10\/bnl_logo_horizontal_cmyk-1200px.jpg 1200w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large has-custom-border\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"246\" data-id=\"6192\" src=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/ORNL-logo-1024x246.png\" alt=\"\" class=\"wp-image-6192\" style=\"border-style:none;border-width:0px;border-radius:0px\" srcset=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/ORNL-logo-1024x246.png 1024w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/ORNL-logo-300x72.png 300w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/ORNL-logo-768x185.png 768w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/ORNL-logo-1536x370.png 1536w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/ORNL-logo.png 2032w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"573\" height=\"225\" data-id=\"6191\" src=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/Argonne_cmyk_black-copy.jpg\" alt=\"\" class=\"wp-image-6191\" srcset=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/Argonne_cmyk_black-copy.jpg 573w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/Argonne_cmyk_black-copy-300x118.jpg 300w\" sizes=\"auto, (max-width: 573px) 100vw, 573px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"483\" height=\"207\" data-id=\"6193\" src=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/Pacific_Northwest_National_Laboratory_logo.svg_.png\" alt=\"\" class=\"wp-image-6193\" srcset=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/Pacific_Northwest_National_Laboratory_logo.svg_.png 483w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/Pacific_Northwest_National_Laboratory_logo.svg_-300x129.png 300w\" sizes=\"auto, (max-width: 483px) 100vw, 483px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"688\" data-id=\"6190\" src=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/NERSClogocolor-1-1024x688.png\" alt=\"\" class=\"wp-image-6190\" srcset=\"https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/NERSClogocolor-1-1024x688.png 1024w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/NERSClogocolor-1-300x202.png 300w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/NERSClogocolor-1-768x516.png 768w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/NERSClogocolor-1-1536x1032.png 1536w, https:\/\/annualreports.es.net\/wp-content\/uploads\/2024\/11\/NERSClogocolor-1.png 1576w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/figure>\n<\/div>\n<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":6,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-6411","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/annualreports.es.net\/index.php\/wp-json\/wp\/v2\/pages\/6411","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/annualreports.es.net\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/annualreports.es.net\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/annualreports.es.net\/index.php\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/annualreports.es.net\/index.php\/wp-json\/wp\/v2\/comments?post=6411"}],"version-history":[{"count":6,"href":"https:\/\/annualreports.es.net\/index.php\/wp-json\/wp\/v2\/pages\/6411\/revisions"}],"predecessor-version":[{"id":6639,"href":"https:\/\/annualreports.es.net\/index.php\/wp-json\/wp\/v2\/pages\/6411\/revisions\/6639"}],"wp:attachment":[{"href":"https:\/\/annualreports.es.net\/index.php\/wp-json\/wp\/v2\/media?parent=6411"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}