SEARCH · Engineering Papers

Results for “Advanced Scientific Computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Object Proxy Patterns for Accelerating Distributed Applications

Workflow and serverless frameworks have empowered new approaches to distributed application design by abstracting compute resources. However, their typically limited or one-size-fits-all support for advanced data flow patterns leaves optimization to the application programmer—optimization that becomes more difficult as data become larger. The transparent object proxy, which provides wide-area references that can resolve to data regardless of location, has been demonstrated as an effective low-level building block in such situations. Here we propose three high-level proxy-based programming patterns—distributed futures, streaming, and ownership—that make the power of the proxy pattern usable for more complex and dynamic distributed program structures. We motivate these patterns via careful review of application requirements and describe implementations of each pattern. As a result, we evaluate our implementations through a suite of benchmarks and by applying them in three meaningful scientific applications, in which we demonstrate substantial improvements in runtime, throughput, and memory usage.

Distributed Computing↗

DOE OSTI2023

Activity‐Based Protein Profiling – Enabling Phenotyping of Host‐Associated and Environmental Microbiomes

Abstract Host‐associated and environmental microbiomes play central roles in human health, biogeochemical cycling, response to ecosystem change, and agriculture. Scientific approaches that can reveal the functional activities that contribute to observed phenotypes are needed in microbiome research. Broad characterization of the functional activity of microbes within microbiomes is currently hampered by approaches that rely on inference of function from metagenomes or indirect measurements. Activity‐based protein profiling is uniquely positioned to overcome these challenges and reveal the protein‐level mechanisms associated with microbiome phenotypes. In this review we describe the progress made to date using ABPP in gut microbiome, plant‐microbe interaction, and soil microbiome research, and suggest how ABPP data can be coupled with advanced computational methods to enable phenotype prediction and bioengineering of microbiomes for applied purposes.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

First-principles calculations of defects and electron–phonon interactions: Seminal contributions of Audrius Alkauskas to the understanding of recombination processes

First-principles calculations of defects and electron–phonon interactions play a critical role in the design and optimization of materials for electronic and optoelectronic devices. The late Audrius Alkauskas made seminal contributions to developing rigorous first-principles methodologies for the computation of defects and electron–phonon interactions, especially in the context of understanding the fundamental mechanisms of carrier recombination in semiconductors. Alkauskas was also a pioneer in the field of quantum defects, helping to build a first-principles understanding of the prototype nitrogen-vacancy center in diamond, as well as identifying novel defects. Here, we describe the important contributions made by Alkauskas and his collaborators and outline fruitful research directions that Alkauskas would have been keen to pursue. Audrius Alkauskas’ scientific achievements and insights highlighted in this article will inspire and guide future developments and advances in the field.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Modeling performance of data collection systems for high-energy physics

Exponential increases in scientific experimental data are outpacing silicon technology progress, necessitating heterogeneous computing systems—particularly those utilizing machine learning (ML)—to meet future scientific computing demands. The growing importance and complexity of heterogeneous computing systems require systematic modeling to understand and predict the effective roles for ML. We present a model that addresses this need by framing the key aspects of data collection pipelines and constraints and combining them with the important vectors of technology that shape alternatives, computing metrics that allow complex alternatives to be compared. For instance, a data collection pipeline may be characterized by parameters such as sensor sampling rates and the overall relevancy of retrieved samples. Alternatives to this pipeline are enabled by development vectors including ML, parallelization, advancing CMOS, and neuromorphic computing. By calculating metrics for each alternative such as overall F1 score, power, hardware cost, and energy expended per relevant sample, our model allows alternative data collection systems to be rigorously compared. We apply this model to the Compact Muon Solenoid experiment and its planned high luminosity-large hadron collider upgrade, evaluating novel technologies for the data acquisition system (DAQ), including ML-based filtering and parallelized software. The results demonstrate that improvements to early DAQ stages significantly reduce resources required later, with a power reduction of 60% and increased relevant data retrieval per unit power (from 0.065 to 0.31 samples/kJ). However, we predict that further advances will be required in order to meet overall power and cost constraints for the DAQ.

Olin-Ammentorp, Wilkie (ORCID:0000000224729862)↗

DOE OSTI2021

Accelerating Scientific Applications With SambaNova Reconfigurable Dataflow Architecture

Here, our exploratory work finds that the SambaNova Reconfigurable Dataflow Architecture (RDA) along with the SambaFlow software stack provides for an attractive system and solution to accelerate AI for science workloads. We have observed the efficacy of using the system with a diverse set of science applications and reasoned their suitability for performance gains over traditional hardware. As the Data-Scale system provides for a very large memory capacity, the system can be used to train models that typically do not fit in a GPU. The architecture also provides for deeper integration with upcoming supercomputers at the Argonne Leadership Computing Facility (ALCF), a US Department of Energy Office of Science user facility, to help advance science insights.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

AI@DOE Interim Executive Report

Interim executive report for DOE’s Office of Science, NNSA, and Applied Energy Offices, in collaboration with the Artificial Intelligence and Technology Office, DOE AI roundtable workshops (December 2021 through February 2022) (“AI@DOE”). These workshops were used to help identify AI research requirements and priorities for the next decade for Department of Energy in developing machine-learning-based prediction and decision-support capabilities that address and anticipate DOE mission challenges. These missions’ challenges for AI include: AI to advance scientific discovery and technological innovation AI to support high consequence decisions while managing risk AI to improve DOE’s responsiveness to national & global issues AI to assist stewardship of the environment and national critical infrastructure These will be addressed in large part through the development and application of new and powerful artificial intelligence and/or machine learning algorithms and strategies. https://web.cvent.com/event/fc3922f8-fc75-4041-a317-f13a1da44f7c/summary?locale=en-US&i=2Wx2tjbStkydRFq_N2whPw

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

PPPL Laboratory Directed Research and Development (Project Final Reports, FY2018 - FY2020)

The U.S. Department of Energy’s (DOE) Princeton Plasma Physics Laboratory (PPPL) is a collaborative national center for fusion energy science, basic sciences, and advanced technology. The Laboratory has three major missions: (1) to develop the scientific knowledge and advanced engineering to enable fusion to power the U.S. and the world; (2) to advance the science of nanoscale fabrication for technologies of tomorrow; and (3) to further the development of the scientific understanding of the plasma universe from laboratory to astrophysical scales. PPPL’s Laboratory Directed Research and Development (LDRD) program supports and encourages creativity and innovation and contributes to its long-term viability. New scientific and technical research areas emerge and are nurtured through the program. Furthermore, new capabilities are developed to enable the Laboratory to meet its and DOE’s missions. The program is used to systematically diversify the Laboratory’s programs and mission. In the last few years, the program has started projects in nanomaterial synthesis, microelectronics, advanced x-ray spectroscopy, high-energy-density physics, superconducting magnet technology, machine learning and artificial intelligence, 3D magnetic fields to optimize fusion plasmas, integration of permanent magnets with simple high-field magnets to reduce the cost of producing complex 3D magnetic fields, advanced computational methods for predictive understanding and control of fusion plasma, development of quantum computing algorithms for plasma physics, liquid metal plasma-facing components for fusion reactors, virtual engineering, and plasma-based space propulsion. The program is also the vehicle to recruit and train talented scientists and engineers with the new skills needed to perform the Laboratory’s mission. Many of the new hires through the program go on to become world-class scientists and engineers in their fields. This report provides descriptions and accomplishments of those LDRD projects that were completed during fiscal years 2018 through 2020.

36 MATERIALS SCIENCE↗

DOE OSTI2022

NREL Stratus - Enabling Workflows to Fuse Data Streams, Modeling, Simulation, and Machine Learning

Integrating cloud services into advanced computing facilities provides significant new capabilities over focusing solely on traditional high performance computing (HPC) workloads. This brings complementary capabilities as well as enabling new focused roles for HPC. They are especially potent for workflows that fuse data streams, modeling and simulation ('modsim') and machine learning. A key challenge to adopting a hybrid edge-cloud-HPC model is to align optimal capability, data, and user intent on the right resources for each step in a workflow.?The NREL Stratus service provides a basis for this: Stratus layers capabilities needed to make?cloud services accessible to a lab-based scientific community on commercial offerings, and; currently supports upwards of 200 projects ranging from IOT integration to traditional modeling and simulation. This provides a real-world inventory of scientific workflow elements. A growing knowledge base enables placing these elements appropriately between the edge, cloud, and traditional HPC. This paper outlines a vision via reference architecture and the application of that architecture in a typical workflow highlighting multiple components: sensor data intake, cleaning and transforming (edge/cloud suitable); generation of synthetic data through modsim, computationally heavy ML training and hyperparameter optimization (HPC suitable), and; inference and deployment (cloud ideal). Every step in such a workflow involves a cost-benefit analysis regarding the data movement, computational efficiency, availability, latency, and resource capabilities. The reference architecture and examples outlined allow for understanding new opportunities in the context of emerging workflows that combine IOT, cloud, and HPC to bolster scientific productivity.

AI↗

DOE OSTI2022

28 NREL Stratus - Enabling Workflows to Fuse Data Streams, Modeling, Simulation, and Machine Learning: Preprint

AI↗

DOE OSTI2026

AutoLabs: cognitive multi-agent systems with self-correction for autonomous chemical experimentation

The automation of chemical research through self-driving laboratories (SDLs) promises to accelerate scientific discovery, yet the reliability and granular performance of the underlying AI agents remain critical, under-examined challenges. In this work, we introduce AutoLabs, a self-correcting, multi-agent architecture designed to autonomously translate natural-language instructions into executable protocols for a high-throughput liquid handler. The system engages users in dialogue, decomposes experimental goals into discrete tasks for specialized agents, performs tool-assisted stoichiometric calculations, and iteratively self-corrects its output before generating a hardware-ready file. We present a comprehensive evaluation framework featuring five benchmark experiments of increasing complexity, from simple sample preparation to multi-plate timed syntheses. Through a systematic ablation study of 20 agent configurations, we assess the impact of reasoning capacity, architectural design (single- vs. multi-agent), tool use, and self-correction mechanisms. Our results demonstrate that agent reasoning capacity is the most critical factor for success, reducing quantitative errors in chemical amounts (nRMSE) by over 85% in complex tasks. When combined with a multi-agent architecture and iterative self-correction, AutoLabs approaches expert-authored reference procedures on the benchmark (F1-score > 0.89) on challenging multi-plate syntheses. These findings establish a clear blueprint for developing robust and trustworthy AI partners for autonomous laboratories, highlighting the synergistic effects of modular design, advanced reasoning, and self-correction to ensure both performance and reliability in high-stakes scientific applications. Code: https://github.com/pnnl/autolabs

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

PvaPy streaming framework for real-time data processing

User facility upgrades, new measurement techniques, advances in data analysis algorithms as well as advances in detector capabilities result in an increasing amount of data collected at X-ray beamlines. Some of these data must be analyzed and reconstructed on demand to help execute experiments dynamically and modify them in real time. In turn, this requires a computing framework for real-time processing capable of moving data quickly from the detector to local or remote computing resources, processing data, and returning results to users. In this paper, we discuss the streaming framework built on top of PvaPy, a Python API for the EPICS pvAccess protocol. We describe the framework architecture and capabilities, and discuss scientific use cases and applications that benefit from streaming workflows implemented on top of this framework. We also illustrate the framework's performance in terms of achievable data-processing rates for various detector image sizes.

EPICS pvAccess↗

DOE OSTI2021

National Virtual Biotechnology Laboratory: Report on Rapid R&D Solutions to the COVID-19 Crisis

With funding from the CARES Act, the U.S Department of Energy (DOE) established the National Virtual Biotechnology Laboratory (NVBL) in March 2020 to address key challenges associated with the COVID-19 crisis. NVBL brought together the broad scientific and technical expertise and resources of DOE’s 17 national laboratories to help tackle medical supply short ages, discover potential drugs to fight the virus, develop and validate COVID-19 testing methods, model disease spread and impact across the nation, and understand virus transport in buildings and the environment. National laboratory resources leveraged for this effort include a suite of world-leading user facilities broadly available to the research community, such as light and neutron sources, nanoscale science research centers, sequencing and biocharacterization facilities, and high-performance computing facilities. Within months, NVBL teams produced innovations in materials and advanced manufacturing that mitigated shortages in test kits and personal protective equipment (PPE), creating nearly 1,000 new jobs. They used DOE’s high-performance computers and light and neutron sources to identify promising candidates for antibodies and antivirals that universities and drug companies are now evaluating. NVBL researchers also developed new diagnostic targets and sample collection approaches, and supported U.S. Food and Drug Administration (FDA), Centers for Disease Control and Prevention (CDC), and U.S. Department of Defense (DoD) efforts to establish national guidelines used in administering millions of tests. Researchers used artificial intelligence and high-performance computing to produce near-real-time data analysis to forecast disease transmission, stress on public health infrastructure, and economic impact, which supported decision-makers at the local, state, and national levels. NVBL teams also studied how to control indoor virus movement to minimize uptake and protect human health. NVBL’s accomplishments demonstrate not only the powerful resource represented by DOE’s national laboratories working together to meet national needs, but also the effectiveness of the integrated NVBL framework for rapidly responding to emergencies with research and development (R&D) solutions. As the fight against COVID continues, sustained efforts are needed to confront this pandemic as well as future threats. Examples include: 1) Establishing “supply chains on demand” to meet emergency production needs by leveraging the materials and manufacturing expertise of DOE national laboratories and developing advances in electronics, sensing, robotics, and automation capabilities; 2) Improving the speed and robustness of drug discovery by integrating experimental platforms with DOE’s computational and experimental user facilities, which provide unique resources to support the discovery of high-potential therapeutic agents; 3) Protecting public, environmental, and animal health by developing new testing protocols and instrumentation adaptable to diverse sample types (both physiological and environmental) to quickly detect a wide range of pathogens and monitor other biorisks; 4) Supporting near-real-time data needs of decision-makers at the local, regional, state, and national levels by advancing data curation, analysis, and modeling using artificial intelligence and new data science tools for managing and evaluating large diverse datasets; 5) Harnessing DOE’s expertise in environmental modeling to design rooms and air handling for offices, classrooms, restaurants, and other structures to minimize biorisk transmissions. Going forward, NVBL is poised to apply the unique capabilities and expertise of the national laboratory complex to future national and international emergencies, both natural and engineered. Through this framework, the Office of Science will continue to be an integral component of agency wide efforts to prepare for and respond to biorisks and other crises.

42 ENGINEERING↗

DOE OSTI2024

Project DarkStar: Vision for LLNL in 2030

DarkStar was a Strategic Initiative (FY2021-FY2024) to investigate applications of Artificial Intelligence (AI) and Machine Learning (ML) to scientific problems of complex hydrodynamics, shockwave physics and energetic materials. The research focused on physics and engineering design as a process that can be tremendously accelerated through merging AI with advanced physics simulation on exascale-class platforms, and to experimentally validate this revolutionary new approach through dynamic materials campaigns. A central thread of scientific inquiry was in the application of AI to enable human understanding of how to control hydrodynamic instability (which has impacts to areas such as inertial confinement fusion) via engineering features and time-dependent sources. Motivated by an unfinished line of research started by Dr. Johnny von Neumann, AI-enabled simulation approaches were developed that allowed DarkStar researchers to uncover several ground-breaking discoveries regarding hydrodynamic instability, including how to completely suppress Richtmyer-Meshkov instability (RMI). These S&T discoveries, along with other advances, have shown the way for an entirely new approach to time-dependent problems known as inverse design – the idea that complex systems can be developed directly from a final state that is to be achieved and resolve the initial design via satisfying several constraints simultaneously via AI/ML. Through experimental campaigns conducted across a wide range of facilities in the NNSA complex (the High Explosive Application Facility at LLNL, the Dynamic Compression Sector/Advanced Photon Source at Argonne National Lab, and Special Technologies Laboratory at MSTS) the radical new AI/ML approach to engineering complex material dynamics was verified, establishing a new field of study within the realm of shock physics. As advanced manufacturing capabilities continue to develop, the great importance of inverse design as a means to apply that technology effectively for NNSA missions will feature prominently over this decade. DarkStar has positioned NNSA as a world-leader in this newly emerging cross-disciplinary area of AI methods for advanced physics simulation and pioneered multiple novel approaches that have enabled the broader scientific community. By allowing us to see past the horizon, to 2030 and beyond, DarkStar has illuminated the vast potential of AI/ML to impact a wide range of new national security missions and, consequently, multiple areas of further research have already emerged across the NNSA and DOD complex.

42 ENGINEERING↗

DOE OSTI2026

Carbon-Based Quantum Information Science with Symmetry Protected Topological States (Final Report, DOE-BES award DE-SC0023105)

This research program established the scientific foundation for the rational, bottom-up design, synthesis, isolation, and investigation of symmetry-protected topological (SPT) electron spin qubits embedded in graphene nanoribbons (GNRs). The work focused on integrating atomically precise low-dimensional carbon nanostructures with emerging quantum logic architectures, providing a pathway toward scalable quantum materials for next-generation computing and sensing technologies. A central component of the program was the elucidation of fundamental relationships between real-space molecular architecture, local spin density distributions, electronic band dispersion, and energy level alignment in atomically precise GNR systems. These correlations define key operational parameters of SPT qubits and were systematically investigated to establish quantitative benchmarks against established molecular and solid-state spin qubit platforms. Attention was given to properties critical for quantum device performance, e.g. decoherence times, spectral sharpness of energy transitions, and tunable exchange interactions between spin states. The research demonstrated that these parameters can be engineered with atomic precision through scalable bottom-up synthetic strategies. Theory-guided design played a central role in identifying candidate structures hosting topologically protected spin states. Experimental validation was performed using both ensemble measurements and single-molecule characterization. In addition to advances in quantum materials synthesis, the program developed and applied spin-sensitive scanning probe microscopy techniques capable of directly probing quantum states and dynamic processes with atomic-scale spatial resolution. These capabilities enabled direct observation and characterization of quantum structures at the single-atom level. While the research activities were primarily hypothesis-driven fundamental investigations, the program adopted a comprehensive materials-by-design framework aimed at translating scientific discoveries into technological concepts compatible with scalable and intelligent manufacturing approaches.

36 MATERIALS SCIENCE↗

DOE OSTI2021

AI to Automate ModEx for Optimal Predictive Improvement and Scientific Discovery

Focal Areas: Data acquisition and assimilation enabled by machine learning, AI, advanced experimental optimization, unsupervised learning, and hardware-related AI efforts; Predictive modeling through AI techniques and AI-derived model components; Using AI to design a hierarchical model prediction system consisting and model selection; and, Interrogating complex data (observed and simulated) using AI, big data analytics, and other advanced methods such as explainable AI and physics- or knowledge-guided AI.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Heterogeneous Visualization: A Call for Empirically Driven Technology Advancement and Adoption; Preprint

Our ability to generate data from simulations and experimental platforms is generally outpacing our ability to analyze those data efficiently and effectively. There are a growing number and variety of possible visualization display modalities, from commodity head-mounted displays to large-scale immersive environments, from desktop and touch displays to high-resolution display walls. Many of these visualization technologies and visual environments are rapidly evolving and could revolutionize analysis for certain classes of complex scientific and engineering data. However, the choice of what technology or combination of technologies to use has historically been largely ad hoc and lacks a carefully validated understanding of how to best utilize different visualization technologies to advance the science. To maximize the impact of our data and analyses, it is imperative that we use the most effective visualization environments for the analysis task at hand.

heterogeneous visualization↗

DOE OSTI2025

Optimizing the optimizer for physics-informed neural networks and Kolmogorov-Arnold networks

Physics-Informed Neural Networks (PINNs) have revolutionized the computation of PDE solutions by integrating partial differential equations (PDEs) into the neural network’s training process as soft constraints, becoming an important component of the scientific machine learning (SciML) ecosystem. More recently, physics-informed Kolmogorv-Arnold networks (PIKANs) have also shown to be effective and comparable in accuracy with PINNs. In their current implementation, both PINNs and PIKANs are mainly optimized using first-order methods like Adam, as well as quasi-Newton methods such as BFGS and its low-memory variant, L-BFGS. However, these optimizers often struggle with highly nonlinear and non-convex loss landscapes, leading to challenges such as slow convergence, local minima entrapment, and (non)degenerate saddle points. In this study, we investigate the performance of Self- Scaled BFGS (SSBFGS), Self-Scaled Broyden (SSBroyden) methods and other advanced quasi-Newton schemes, including BFGS and L-BFGS with different line search strategies. These methods dynamically rescale updates based on historical gradient information, thus enhancing training efficiency and accuracy. We systematically compare these optimizers – using both PINNs and PIKANs – on key challenging PDEs, including the Burgers, Allen-Cahn, Kuramoto-Sivashinsky, Ginzburg-Landau, and Stokes equations. Additionally, we evaluate the performance of SSBFGS and SSBroyden for Deep Operator Network (DeepONet) architectures, demonstrating their effectiveness for data-driven operator learning. Our findings provide state-of-the-art results with orders-of-magnitude accuracy improvements without the use of adaptive weights or any other enhancements typically employed in PINNs. More broadly, our work reveal insights into the effectiveness of quasi-Newton optimization strategies in significantly improving the convergence and accurate generalization of PINNs and PIKANs.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Advances in geophysical forensic event monitoring

Forensic analysis of man-made, non-nuclear events (such as industrial accidents, explosion experiments and mine collapses) has become more frequent and detailed owing to advancements in geophysical monitoring. Here, in this Technical Review, we demonstrate how geophysical forensic monitoring using seismic, infrasound and hydroacoustic recordings provides insights on events in the solid earth, atmosphere and underwater. Advanced techniques, including machine-learning-based models, have been developed to detect, identify and investigate these events, providing information on location, subevents, sources and explosive yield. The increase in data availability, application of advanced methods and computation and the growth of multitechnology approaches have increased the accuracy of forensic event analysis and enabled more realistic characterization of uncertainties. For example, the 2020 Beirut explosion in Lebanon demonstrated that various seismic, acoustic and other methods could be used to estimate explosive yield (and yield uncertainties) of about 1 ktonne, providing confidence in the application of these methods to smaller events where data are available. However, forensic investigations remain largely limited to known events with identified sources. Increased access to data, sophisticated analysis methods and high-resolution earth models will improve forensic event analysis further, enabling civil and scientific applications, such as localization in the search for the lost ARA San Juan submarine.

geophysics↗