SEARCH · Engineering Papers

Results for “hardware and software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

DOE OSTI2025

TrioSim: A Lightweight Simulator for Large-Scale DNN Workloads on Multi-GPU Systems

Deep Neural Networks (DNNs) have become increasingly capable of performing tasks ranging from image recognition to content generation. The training and inference of DNNs heavily rely on GPUs, as GPUs' massively parallel architecture delivers extremely high computing capability. With the growing complexity of DNNs and the size of training datasets, training DNNs with a large number of GPUs is becoming a prevalent strategy. Researchers have been exploring how to design software and hardware systems for GPU farms to achieve the best utilization, efficiency, and DNN accuracy during training or inference. However, when designing and deploying such systems, designers usually rely on testing on physical hardware platforms equipped with many GPUs, incurring high costs that are almost prohibitive for system designers to test different configurations and designs, even for highly resourceful companies. While an alternative solution is to test on GPU simulators, they are often too slow for these l

Li, Ying [William & Mary, Williamsburg, VA, USA] (↗

DOE OSTI2020

High-Energy X-Ray Diffraction Microscopy in Materials Science

High-energy diffraction microscopy (HEDM) is an implementation of three-dimensional X-ray diffraction microscopy. HEDM yields maps of internal crystal orientation fields, strain states, grain shapes and locations as well as intragranular orientation distributions, and grain boundary character. Because it is nondestructive in hard materials, notably metals and ceramics, HEDM has been used to study responses of these materials to external fields including high temperature and mechanical loading. Currently available sources and detectors lead to a spatial resolution of ~1 μm and an orientation resolution of <0.1°. With the penetration characteristic of high energies ( E ≥ 50 keV), sample cross-section dimensions of ~1 mm can be studied in materials containing elements across much of the Periodic Table. This review describes hardware and software associated with HEDM as well as examples of applications. Overall, these applications include studies of grain growth, recrystallization, texture development, orientation gradients, deformation twinning, annealing twinning, plastic deformation, and additive manufacturing. We also describe relationships to other X-ray-based methods as well as prospects for further development.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Translytics: A Novel Approach for Runtime Selection of Database Layout Based on User’s Context

Currently, organizations have to maintain separate systems for transactions and analytics inside the company. Notably, different vendors provide the capabilities for either of these tasks that require specialized hardware or software. Data engineers are required to retrieve data from one source and transform it into another format to obtain the maximum benefit in a minimum time. Organizations strive for a competitive advantage that is achieved by fetching data from their customers and getting insights earliest for timely decision making. Present practices do not permit the view of the latest data for analytics since the first data have to be fetched from the source, transformed, and loaded to other systems to be utilized for analysis by relevant teams. This paper introduces a single system for both transactions and analytics. Our proposed solution would permit companies to seamlessly adapt our solution without the need to shift all of their data to newer systems and allow all the teams. It would grant all the teams to have a view of the latest available data without extra expertise and budget.

Tanvir, Muhammad Makhshif↗

DOE OSTI2021

Icypaw

The Intermode Communication Protocol Wrapper, or Icypaw, structures and facilitates communication between endpoints in a network. It is used to connect various independent software and hardware components into one loosely organized system controllable from one or more locations. The code uses the MQTT protocol to communicate and enhances it with a useful framework. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-8293 O

Van Der Wall, JayW.↗

DOE OSTI2021

Infrastructure Expression: Discovery Tools

The Infrastructure Expression: Discovery Tools is a toolset that allows for the automated collection of various network, hardware, and software vulnerabilities and details to be collected from systems on a given network. These details are then converted into a STIX 2.1 format, allowing for easy viewing in existing applications as well as sharing and interfacing with tools that already use the STIX 2.1 format.

Cutshaw, Michael↗

DOE OSTI2024

Sentinel

Network intrusion detection systems (NIDS) are commonplace in network security but they frequently employ algorithms that are computational demanding requiring hardware and software with significant power requirements. Two examples of such resource-intensive algorithms used for network security are regular expression matching and broader signature pattern matching which are commonly used in deep packet inspection (DPI). Network security algorithms that have large power requirements may be a challenge for low-power internet-of-things (IoT) environments, which generally lack the power resources to implement complex security measures like computationally expensive DPI at the edge. Furthermore, IoT environments incorporating 5G standalone networks have network latency constraints beyond just power that make DPI at the edge even more difficult. Programmable logic is ideally suited for machine learning inference for DPI because of its deep instruction level parallelism and single-cycle memory access. Machine learning approaches for DPI have been explored before using the programmable logic of field programmable gate arrays (FPGA) as a potential solution for NIDS approaches that would be power-suitable for IoT. However, those previous programmable logic NIDS approaches utilize either a supervised or unsupervised learning model. Sentinel utilizes the ensemble of these two machine learning approaches known as a semi-supervised approach which has shown promise in NIDS implementations. Sentinel provides a programmable logic implementation of a semi-supervised approach for DPI which operates at much lower power and latency than a GPU implementation with negligible loss of accuracy due to quantization through a logistic regressor.

Anderson, MatthewW [Idaho National Laboratory (INL↗

DOE OSTI2025

SpacelyProject/spacely-docs

Spacely is an open-source framework for the post-silicon validation of analog, digital, and mixed-signal ASICs (Application-Specific Integrated Circuits) which maximizes the reuse of hardware and software, reducing the time taken to achieve meaningful test results. Spacely specifically addresses the needs of small, flexible ASIC design teams commonly found in academia or research institutions. Spacely was originally developed at Fermi National Accelerator Laboratory.

Quinn, Adam [Fermi National Accelerator Laboratory↗

DOE OSTI2026

arco (Assembled Resource-Constrained Optimization) [SWR-26-030]

Arco (Assembled Resource-Constrained Optimization) is a memory-smart optimization DSL and solver for LP and MIP problems on constrained hardware. The software is an optimization framework built around a KDL-based domain-specific language and a CLI compiler/solver. You write optimization models in .kdl files, and the arco CLI compiles, validates, inspects, and solves them. Language bindings (Python today, more planned) provide programmatic access to the same engine. Built for harder optimization problems on constrained resources, Arco is intentional about every allocation, careful with stack and heap behavior, and relentless about minimizing memory usage so more systems can run real workloads. Arco is built primarily for internal use within our organization. You are welcome to try it, but we make no guarantees about API stability or robustness at this stage

Sanchez Perez, Pedro Andres [National Laboratory o↗

DOE OSTI2024

Electronic Visualization Laboratory's 50th Anniversary Retrospective: Look to the Future, Build on the Past

September 2023 marks the 50th anniversary of the Electronic Visualization Laboratory (EVL) at University of Illinois Chicago (UIC). EVL's introduction of the CAVE Automatic Virtual Environment in 1992, the first widely replicated, projection-based, walk-in, virtual-reality (VR) system in the world, put EVL at the forefront of collaborative, immersive data exploration and analytics. However, the journey did not begin then. Since its founding in 1973, EVL has been developing tools and techniques for real-time, interactive visualizations—pillars of VR. But EVL's culture is also relevant to its successes, as it has always been an interdisciplinary lab that fosters teamwork, where each person's expertise contributes to the development of the necessary tools, hardware, system software, applications, and human interface models to solve problems. Over the years, as multidisciplinary collaborations evolved and advanced scientific instruments and data resources were distributed globally, the need to access and share data and visualizations while working with colleagues, local and remote, synchronous and asynchronous, also became important fields of study. This paper is a retrospective of EVL's past 50 years that surveys the many networked, immersive, collaborative visualization and VR systems and applications it developed and deployed, as well as lessons learned and future plans.

Johnson, Andrew E.↗

DOE OSTI2024

A 15-Year Retrospective on Immersive Visualization Lessons from the Applied Visualization Laboratory

This article shares the experiences of operating an immersive visualization laboratory over a 15-year period. The paper discusses valuable insights into the lessons learned from various projects, including the challenges they faced, such as technical difficulties, user adoption, and opportunities, and practical solutions for overcoming them. One crucial element for successful immersive visualization projects is interdisciplinary collaboration. The paper presents the advantages of immersive visualization technology, such as improved data comprehension, enhanced communication, and increased engagement in complex scenarios. We present the dynamic realm of virtual and augmented truth (VR/AR) technology in the context of a immersive laboratory system. We spotlight rising trends inside the integration of VR/AR tools for visualization. We also present our experience in dealing with the hardware and software additives in an immersive VR/AR labs, dropping light on the demanding situations and successes encountered throughout everyday operations. Furthermore, it offers practical knowledge and guidance based on years of experience in the field, which can help you overcome challenges and achieve success in your project.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

Metal additive manufacturing simulation across length, time, and computing scales

Metal additive manufacturing (AM) offers a unique opportunity for production of advanced materials and complex geometries. However, variability in microstructure and properties challenges conventional approaches to design, process optimization, qualification, and materials selection. Modeling and simulation can improve understanding of AM processing and materials, but also poses major challenges for existing computational methods. Simultaneously, modern scientific computing hardware has become increasingly complex, most notably with the adoption of hybrid architectures such as Graphical Processing Units (GPUs). If appropriately utilized, emerging computational capabilities provide an opportunity to reveal new insight into AM processing and the resulting material structure and properties. In this review we describe the computational AM landscape, identify critical gaps, and highlight opportunities to impact the development and application of AM. First, the requirements and challenges of representative AM problem statements will be defined. Here, these problems range from scientific studies to industrial applications and are designed to capture the breadth of challenges facing the AM community. Next, the current state of AM modeling and simulation is evaluated, broken down by enabling hardware and software, process simulation, microstructure simulation, and property simulation. Each section describes the diversity of simulation approaches and associated trade-offs in physical fidelity and computational expense. Each area is then assessed based on their suitability and readiness for current and developing computational architectures. Lastly, the greatest opportunities for future research and application are highlighted, including gaps in modeling capabilities, opportunities for near-term application, and key scientific challenges.

additive manufacturing↗

DOE OSTI2023

Design and implementation of I/O performance prediction scheme on HPC systems through large-scale log analysis

Abstract Large-scale high performance computing (HPC) systems typically consist of many thousands of CPUs and storage units used by hundreds to thousands of users simultaneously. Applications from large numbers of users have diverse characteristics, such as varying computation, communication, memory, and I/O intensity. A good understanding of the performance characteristics of each user application is important for job scheduling and resource provisioning. Among these performance characteristics, I/O performance is becoming increasingly important as data sizes rapidly increase and large-scale applications, such as simulation and model training, are widely adopted. However, predicting I/O performance is difficult because I/O systems are shared among all users and involve many layers of software and hardware stack, including the application, network interconnect, operating system, file system, and storage devices. Furthermore, updates to these layers and changes in system management policy can significantly alter the I/O behavior of applications and the entire system. To improve the prediction of the I/O performance on HPC systems, we propose integrating information from several different system logs and developing a regression-based approach to predict the I/O performance. Our proposed scheme can dynamically select the most relevant features from the log entries using various feature selection algorithms and scoring functions, and can automatically select the regression algorithm with the best accuracy for the prediction task. The evaluation results show that our proposed scheme can predict the write performance with up to 90% prediction accuracy and the read performance with up to 99% prediction accuracy using the real logs from the Cori supercomputer system at NERSC.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Traversing large graphs on GPUs with unified memory

Due to the limited capacity of GPU memory, the majority of prior work on graph applications on GPUs has been restricted to graphs of modest sizes that fit in memory. Recent hardware and software advances make it possible to address much larger host memory transparently as a part of a feature known as unified virtual memory. While accessing host memory over an interconnect is understandably slower, the problem space has not been sufficiently explored in the context of a challenging workload with low computational intensity and an irregular data access pattern such as graph traversal. We analyse the performance of breadth first search (BFS) for several large graphs in the context of unified memory and identify the key factors that contribute to slowdowns. Next, we propose a lightweight offline graph reordering algorithm, HALO (Harmonic Locality Ordering), that can be used as a pre-processing step for static graphs. HALO yields speedups of 1.5x-1.9x over baseline in subsequent traversals. Our method specifically aims to cover large directed real world graphs in addition to undirected graphs whereas prior methods only account for the latter. Additionally, we demonstrate ties between the locality ordering problem and graph compression and show that prior methods from graph compression such as recursive graph bisection can be suitably adapted to this problem.

Gera, Prasun↗

DOE OSTI2024

TEAMER: Drifting Hydrophone System - Block Diagram and Pre-Amplifier Calibrations

This data release is part of TEAMER RFTS 2, where the Cooperative Institute for Marine Resources Studies (CIMRS) at Oregon State University is performing hardware and software development and integration of four newly designed drifting hydrophone systems for underwater noise measurements at marine renewable energy projects. These new acoustic systems will provide advanced technology support available for use at both tidal and wave energy deployments adding additional resources to the limited amount of drifting hydrophone technologies that are available to the marine energy community The submission data contains 2 files plus a Post-Access Report: One file containing the calibration parameters for four (4) pre-amplifier boards used on the drifting hydrophones. Pre-amplifier boards are model "WB PREAMP REV6," with serial numbers; 28, 29, 30, and 31. One image file illustrating the system functional block diagram of the drifting hydrophone system configuration.

16 TIDAL AND WAVE POWER↗

DOE OSTI2021

A New Magnetic Measurement System for the Future Low Emittance NSLS-II Storage Ring

A new magnetic measurement system is under construc-tion at BNL for accurate field harmonic measurements and fiducialization of magnets for a future upgrade of the NSLS- II storage ring. The entire storage ring is envi-sioned to be replaced with a new lattice concept, known as Complex Bend, which superimposes dipole and high-gradient quadrupole fields. The magnetic measurement system will use rotating wire and a PCB rotating coil specifically designed for small-aperture (< 15 mm) high gradient magnets. In this paper we describe in detail the mechanical design and the data acquisition hardware and software.

43 PARTICLE ACCELERATORS↗

DOE OSTI2020

Report on local data recovery approaches suitable for weather and climate prediction (Deliverable 1.3) (V.1.0)

Numerical weather and climate prediction rates as one of the scientific applications whose accuracy improvements greatly depend on the growth of the available computing power. As the number of cores in top computing facilities pushes into the millions, increasing average frequency of hardware and software failures forces users to review their algorithms and systems in order to protect simulations from breakdown. This report surveys approaches for fault-tolerance in numerical algorithms and system resilience in parallel simulations from the perspective of numerical weather and climate prediction systems. A selection of existing strategies is analyzed, featuring interpolation-restart and compressed checkpointing for the numerics, in-memory checkpointing, user-level failure mitigation-based and backup-based methods for the systems. Numerical examples showcase the performance of the techniques in addressing faults, with particular emphasis on iterative solvers for linear systems, a staple of atmospheric fluid flow solvers. The potential impact of these strategies is discussed in relation to current development of numerical weather prediction algorithms and systems towards the exascale. Trade-offs between performance, efficiency and effectiveness of resiliency strategies are analyzed and some recommendations outlined for future developments.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

An Intelligent Adaptable Monitoring Package. Final Report

The “Intelligent Adaptable Monitoring Package” project was a four-year effort that demonstrated the feasibility of integrated sensing packages at tidal and wave energy sites. Such integration is generally required by the breadth of sensors required to understand environmental effects at marine energy sites and the operational difficulty of deploying, maintaining, and recovering such sensors. Over the course of the project, the Adaptable Monitoring Package (AMP) was deployed in multiple settings, each corresponding to a project budget period: - Budget Period 1: Demonstration of cabled deployment at Pacific Northwest National Laboratory’s Marine Science Laboratory. The deployment highlighted AMP hardware endurance over a 4-month deployment in a tidally-dominated environment and laid the groundwork for machine learning algorithms to detect and classify targets present in active sonar data. - Budget Period 2: Demonstration of an autonomous deployment at PacWave South off the coast of Newport, Oregon. The deployment highlighted the stability of AMP hardware and software, with the autonomous package collecting data on a duty cycle over a 1.5-month deployment. - Budget Period 3: Demonstration of an autonomous deployment powered by a wave energy converter at the U.S. Navy’s Wave Energy Test Site. The deployment highlighted the potential of wave energy to power ocean observatories and led to the development of machine learning algorithms to detect and classify targets in optical camera data. In aggregate, this project’s greatest success was demonstrating the AMP’s flexibility in a range of deployment scenarios. Each budget period represented a “first of a kind” demonstration of integrated instrumentation – cabled AMP, autonomous AMP, wave-energy powered AMP – and each deployment helped to identify and set goals for the next. Further, despite the exploratory nature of these deployments, each one achieved high system up-time and proved that flexible integration of multiple sensors in a single package represents a viable strategy for marine energy environmental monitoring. The key lessons learned from the project are: - Without continuous power, either from a shore cable or in situ source, many of the benefits of integration are lost (If continuous power is not available, the ability to detect rare events is lost, as is the ability to minimize the risk of behavioral changes through adaptive sensing. However, even on a duty cycle, there is still value in being able to acquire synchronous data from multiple sensors.); and - Observations from a moving platform present substantially greater data processing challenges than those from stationary platforms. Finally, these deployments also demonstrate an important truth: successful integration alone does not guarantee that relevant data are collected. To grow the knowledge base about environmental interactions with marine energy converters, integrated systems, like the AMP, need to include the right sensor mix and connect the data pipelines to effective processing algorithms. These deployments establish a strong foundation for future collaborations with the environmental research community: not only to understand the environmental effects of marine energy, but also to improve our general ability to study life in the sea.

16 TIDAL AND WAVE POWER↗

DOE OSTI2020

Development of an In-Situ Method for Cable Condition Monitoring in Nuclear Power Plants (SBIR Phase IIB Final Report)

This is the final report of a Small Business Innovation Research (SBIR) project that Analysis and Measurement Services Corporation (AMS) has conducted for the U.S. Department of Energy (DOE) over a seven-and-a-half year period (February 2013 through April 2020 with the awards of Phase I, Phase II and Phase IIB projects). The goal of the project was to design, develop, validate, and demonstrate a technique for in-situ testing of cable insulation polymers that will identify, locate, and provide the degree of aging for cables commonly used in nuclear power plants. During the Phase I project, AMS established that the frequency domain reflectometry (FDR) technique can successfully identify and measure cable insulation degradation that can be trended with aging. In Phase II, AMS performed extensive cable aging studies to correlate FDR measurements with other laboratory condition monitoring techniques and developed aging condition categories to quantify the severity of insulation degradation. In Phase IIB, the project expanded the research to include a wider variety of cable polymers that are used in the commercial nuclear power industry. This work also involved developing acceptance criteria to objectively assess age-related cable degradation while sharing the results of this research with industry, academia, and national laboratories to advance the state of the art in cable aging management technologies. The products developed under this research project provide the nuclear industry with an effective condition monitoring tool to support safe and long-term plant operation. Throughout the project, collaborations and support were received from a variety of industry organizations and individuals including DOE National Laboratories as well as nuclear plant utilities and several other industry experts and cable manufacturers. Contributions from these organizations included the donation of new cables, naturally aged cables, and research collaboration. The validation and commercialization of the products of this project were achieved through opportunities to test and demonstrate the technologies’ capabilities on-site at nuclear power generation and research facilities as well as in the laboratory alongside industry peers and cable testing service companies. The research resulted in a technology that can be used to identify, locate, and quantify age-related degradation in several types of cable polymers. This included developing software and hardware as well as the methodology for using the FDR technique to assess age-related degradation of installed cables. The technology developed under this project can provide nuclear plant management, engineers, and technicians with an in-situ electrical test method to determine if in-service cables need to be replaced, monitored on a periodic basis, or show no evidence of significant age-related degradation that may require action. Near the end of this Phase IIB project, the FDR product was sold to a nuclear power utility in South Korea. This sale of a dedicated aging assessment tool is the beginning of a comprehensive contract with the expectation of twelve (12) units sold to that country. Additionally, the FDR technology has been sold to several industry organizations including a nuclear research institute and the Diablo Canyon nuclear power plant. This technology is also being leased by other nuclear industry service companies for incorporation into aging management programs. The cable testing technology that was developed under this project was also integrated into a comprehensive cable aging assessment service that is being offered to the nuclear industry at the request of U.S. nuclear utilities and is currently part of onsite testing services provided by AMS.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗