Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “empirical validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Spectroscopic Measurements and Models of Energy Deposition in the Substrate of Quantum Circuits by Natural Ionizing Radiation

Naturally occurring background radiation is a potential source of correlated decoherence events in superconducting qubits that will challenge error-correction schemes. In order to characterize the radiation environment in an unshielded laboratory representative of superconducting qubits’ environments, we performed broadband, spectroscopic measurements of background radiation events inside a millikelvin refrigerator. The spectrometer was designed to mimic the size and composition of a quantum circuit. Specifically, we measured the background radiation spectra in silicon substrates of two thicknesses, 500 and 1500 µm, and one area, 25 mm 2 . The observed spectra span energies from a few kilo-electron-volts up to nearly 10 MeV, are nearly featureless, and decrease in intensity by a factor of 40 000 between 100 keV and 3 MeV for the 500-µm substrate. We integrate the spectra to obtain the average event rates and deposited power levels. These quantities correspond to a rate of 0.023 events per second and a power of 4.9 keV s -1 , when counting events that deposit at least 40 keV for the 500-µm-thick substrate. We find that the cryogenic measurements are in good agreement with predictions based on simple measurements of the terrestrial gamma-ray flux outside the refrigerator, published models of cosmic-ray fluxes, a crude model of the cryostat, and radiation-transport simulations. This model requires no free parameters to predict the background radiation spectra in the silicon substrates. The agreement between measurements and predictions demonstrates that the model we present can be used to assess the relative contributions of terrestrial and cosmic-ray sources to background radiation interactions in silicon substrates of varying thickness. These spectroscopic measurements are performed with a novel combination of superconducting microresonators located on micromachined silicon islands that define the interaction volume with background radiation. The resonators transduce deposited energy to a readily detectable electrical signal. Microresonator readout closely resembles dispersive superconducting qubit readout, so similar devices—with or without micromachined islands—are suitable for integration with superconducting quantum circuits as detectors for background radiation events. For our specific laboratory conditions, we find that gamma-ray emissions from radioisotopes are responsible for the majority of events that deposit E < 1 ⁢Me⁢V. We present results demonstrating that the background radiation spectrum contains relevant contributions from cosmic-ray particles other than muons, particularly a tail of multi-mega-electron-volt events due to protons and neutrons. These observations suggest several paths to reducing the impact of background radiation on quantum circuits, supported by an empirically validated model for generating reliable predictions of radiation interactions with silicon substrates.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Flexibility Requirements for Energy Systems with Renewable Generation under Forecast Uncertainties

Energy systems with high fractions of renewable energy-based resources require adequate assets providing flexibility in electricity usage to maximize the benefits of renewable energy. In this paper, we provide an analytical approach to estimate the flexibility requirements of such energy systems, with forecast uncertainties in both demand and generation. Our analytical results show that even with forecast errors, the expected system operating cost decreases with an increase in the amount of flexibility capacity -- however, there is an inflection point, beyond which addition of further flexibility capacity does not reduce expected system cost any further. Additionally, an enumeration-based approach is presented to estimate the maximum flexibility capacity needed to optimize the operating cost. Numerical experiments conducted on a network-abstracted modified IEEE 30-bus system are used for empirical validation and gaining additional insights on the effect of prosumers' willingness to offer flexibility on the dispatch performance.

Bhattacharya, Saptarshi↗

MIJAMP

Here, we develop MIJAMP (MIJAMP Is Just A MethylBED Parser), a software package that was developed to discover methylated motifs from the output of ONT’s Modkit or other data in the methylBED format. MIJAMP employs a human-driven refinement strategy that empirically validates all motifs against genome-wide methylation data, thus eliminating false, under-, or overexplained motifs. MIJAMP can also report methylation data on a specific, user-defined motif.

Alexander, William↗

Hypothesis Tests on Rayleigh Wave Radiation Pattern Shapes: A Theoretical Assessment for Source Screening (Independent Review: LANL Source Physics LCP) [Slides]

Background for TRL 0-1 Research: we require a simple regional source discriminant that has a predictive capability and a quantifiable screening performance (probability of correct attribution); Challenge: many local and near-regional source discriminants do not test source mechanism; rather, they test depth. Such empirically validated discriminants are not all theoretically justified; and, Proposal: we test Rayleigh wave radiation patterns for any significant deviation from circular shape as a discriminant.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

3D Reality Energy Modeling Software

The team will combine Bentley Systems’ ContextCapture and extend Oak Ridge National Laboratory’s building energy modeling capabilities in order to create digital twins of buildings that allow simulation-informed improvement for energy efficiency and demand response in the design and operation of the built environment. Bentley Systems’ ContextCapture software processes data from 3D laser scanning and photographs (through photogrammetry) to create a photorealistic, 3D mesh with a scale of individual objects to building to city-sized. This capability easily provides city-level visualization models and platforms where sustainable design alternatives are readily evaluated. Oak Ridge National Laboratory (ORNL) serves the U.S. Dept. of Energy (DOE) as one of three core laboratories developing building energy modeling tools EnergyPlus and OpenStudio. ORNL’s AutoBEM software (bit.ly/AutoBEM) can process imagery (satellite, aerial, and street level), LiDAR, cartographic layers, tax assessor’s data, and other data sources to extract building footprints, height, window-to-wall ratio, building type, vintage, and other building properties. AutoBEM has created 178,368 building energy models that were empirically validated with 15-minute whole-building electrical data from a utility.

97 MATHEMATICS AND COMPUTING↗

FY25 Report on Water NSTF Testing: Parametric and Accident Testing with Lower Tank Inlet

The Natural Convection Shutdown Heat Removal Test Facility (NSTF) at Argonne National Laboratory has continued to generate empirical validation data on the performance of water-based reactor cavity cooling system (RCCS) for seven years. This data is actively being used to support the development of passive decay heat removal systems for advanced reactors. Distinguishing this facility are 1) the large, ½ scale of the facility and 2) its governance under an NQA-1 qualified program for producing data of the highest pedigree for advanced reactor designers and regulators. In addition to the experimental activities discussed in this report, a computational modeling program continues to support the experimental program and further accuracy and understanding of the computational models. Together, the experimental and computational work create a mutually beneficial relationship integral to the overall program objective of advancing the understanding of the RCCS technology.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Randomized Federated Learning Methods for Nonsmooth, Nonconvex, and Hierarchical Optimization (Final Technical Report)

This final technical report summarizes the outcomes of a DOE-funded project on federated scientific machine learning (FL) under nonsmooth, nonconvex, and hierarchical optimization settings. The project develops new mathematical models, algorithms, and theoretical guarantees for decentralized stochastic, bilevel, and minimax optimization problems arising in DOE mission-relevant applications. A unified framework of randomized and zeroth-order federated optimization methods is introduced, providing provable convergence, communication efficiency, and sample-complexity guarantees. The report documents algorithmic design, theoretical analysis, and empirical validation of the proposed federated learning methods. The project also contributes to workforce development through graduate training and dissemination of results via publications and seminars.

97 MATHEMATICS AND COMPUTING↗

Best Practices for Measuring the Modulation Transfer Function of Video Endoscopes

Endoscopes are crucial for assisting in surgery and disease diagnosis, including the early detection of cancer. The effective use of endoscopes relies on their optical performance, which can be characterized with a series of metrics such as resolution, vital for revealing anatomical details. The modulation transfer function (MTF) is a key metric for evaluating endoscope resolution. However, the 2020 version of the ISO 8600-5 standard, while introducing an endoscope MTF measurement method, lacks empirical validation and excludes opto-electronic video endoscopes, the largest family of endoscopes. Measuring the MTF of video endoscopes requires tailored standards that address their unique characteristics. This paper aims to expand the scope of ISO 8600-5:2020 to include video endoscopes, by optimizing the MTF test method and addressing parameters affecting measurement accuracy. We studied the effects of intensity and uniformity of image luminance, chart modulation compensation, linearity of image digital values, auto gain control, image enhancement, image compression and the region of interest dimensions on images of slanted-edge test charts, and thus the MTF based on these images. By analyzing these effects, we provided recommendations for setting and controlling these factors to obtain accurate MTF curves. Our goal is to enhance the standard’s relevance and effectiveness for measuring the MTF of a broader range of endoscopic devices, with potential applications in the MTF measurement of other digital imaging devices.

47 OTHER INSTRUMENTATION↗

NEMESIS: Exoplanet Transit Survey of Nearby M-dwarfs in TESS FFIs. I

In this work, we present an analysis of 33,054 M-dwarf stars, located within 100 parsecs, via the Transiting Exoplanet Survey Satellite (TESS) full-frame images (FFIs) of observed sectors 1–5. We present a new pipeline called NEMESIS, developed to extract detrended photometry, and to perform transit searches of single-sector data in TESS FFIs. As many M-dwarfs are faint, and are not observed with a two-minute cadence by TESS, FFI transit surveys can provide an empirical validation of how many planets are missed, using the 30-minute cadence data. In this work, we detect 183 threshold crossing events, and present 29 candidate planets for sectors 1–5, 24 of which are new detections. Our sample contains orbital periods ranging from 1.25 to 6.84 days, and planetary radii from 1.26 to 5.31 R {sub ⊕}. With the addition of our new planet candidate detections, along with detections previously observed in sectors 1–5, we calculate an integrated occurrence rate of 2.49 ± 1.58 planets per star, for the period range ∈ [1, 9] days, and planet radius range ∈ [0.5,11] R {sub ⊕}. We project an estimated yield of 122 ± 11 transit detections of nearby M-dwarfs. Of our new candidates, 23 have signal-to-noise ratios >7, transmission spectroscopy metrics >38, and emission spectroscopy metrics >10. We present all of our data products for our planet candidates via the Filtergraph data visualization service, located at https://filtergraph.com/NEMESIS.

47 OTHER INSTRUMENTATION↗

Transformation rate maps of dissolved organic carbon in the contiguous US

Riverine dissolved organic carbon (DOC) plays a vital role in regional and global carbon cycles. However, the processes of DOC conversion from soil organic carbon (SOC) and leaching into rivers are insufficiently understood, inconsistently represented, and poorly parameterized, particularly in land surface and Earth system models. As a first attempt to fill this gap, we propose a generic formula that directly connects SOC concentration with DOC concentration in headwater streams, where a single parameter, the transformation rate from SOC in the soil to DOC leaching flux (P r ), accounts for the overall processes governing SOC conversion to DOC and leaching from soils (along with runoff) into headwater streams. We then derive high-resolution P r maps over the contiguous US (CONUS) using SOC data from two different sources: the Harmonized World Soil Database v1.2 (HWSD) and SoilGrids 2.0. Both maps are developed following the same five major steps: (1) selecting independent catchments where observed riverine DOC data are available with reasonable quality; (2) estimating catchment-average SOC for the independent catchments; (3) estimating the P r values for these catchments based on the generic formula and catchment-average SOC; (4) developing a predictive model of P r with machine learning (ML) techniques and catchment-scale climate, hydrology, geology, and other attributes; and (5) deriving a national map of P r based on the ML model. For evaluation, we compare the DOC concentration derived using the P r map and the observed DOC concentration values at evaluation catchments. The resulting mean absolute scaled error and coefficient of determination are 0.73 and 0.47 for the HWSD-based model and 0.58 and 0.72 for the SoilGrids-based model, respectively, suggesting the effectiveness of the overall methodology. Efforts to constrain uncertainty and evaluate sensitivity of P r to different factors are discussed. To illustrate the use of such maps, we derive a riverine DOC concentration reanalysis dataset over CONUS. The two P r maps, robustly derived and empirically validated, lay a critical cornerstone for better simulating the terrestrial carbon cycle in land surface and Earth system models. Our findings not only set a foundation for improving our predictive understanding of the terrestrial carbon cycle at the regional and global scales, but also hold promises for informing policy decisions related to decarbonization and climate change mitigation. The data presented in this study are publicly available at https://doi.org/10.5281/zenodo.14563816 (Li et al., 2024).

54 ENVIRONMENTAL SCIENCES↗

Overlapped conic simulation of three-body trajectories

Trajectory computation technique for three-body motion is based on analytical derivation and empirical validation of pseudostate theory. Application of technique yields ''overlapped conic'' trajectories with error magnitudes only 20 percent as great as those of patched conic trajectories.

Wilson, S. W., Jr.↗

The independence of software metrics taken at different life-cycle stages

Over the past few years a large number of software metrics have been proposed and, in varying degrees, a number of these metrics have been subjected to empirical validation which demonstrated the utility of the metrics in the software development process. Attempts to classify these metrics and to determine if the metrics in these different classes appear to be measuring distinct attributes of the software product are studied. Statistical analysis is used to determine the degree of relationship among the metrics.

Kafura, D.↗

Surrogate measures: A proposed alternative in human factors assessment of operational measures of performance

Surrogate measures are proposed as an alternative to direct assessment of operational performance for purposes of screening agents who may have to work under unusual stresses or in exotic environments. Such measures are particularly proposed when the surrogate can be empirically validated against the operational criterion. The focus is on cognitive (or throughput) performances in humans as opposed to sensory (input) or motor (output) measures, but the methods should be applicable for development of batteries which will tap input/output functions. A menu of performance tasks is under development for implementation on a battery-operated portable microcomputer, with 21 tests currently available. The tasks are reliable and become stable in minimum amounts of time; appear sensitive to some agents; comprise constructs related to actual job tasks; and are easily administered in most environments. Implications for human factors engineering studies in environmental stress are discussed.

Kennedy, Robert S.↗

Predictive performance models and multiple task performance

Five models that predict how performance of multiple tasks will interact in complex task scenarios are discussed. The models are shown in terms of the assumptions they make about human operator divided attention. The different assumptions about attention are then empirically validated in a multitask helicopter flight simulation. It is concluded from this simulation that the most important assumption relates to the coding of demand level of different component tasks.

Wickens, Christopher D.↗

OFMspert: An architecture for an operator's associate that evolves to an intelligent tutor

With the emergence of new technology for both human-computer interaction and knowledge-based systems, a range of opportunities exist which enhance the effectiveness and efficiency of controllers of high-risk engineering systems. The design of an architecture for an operator's associate is described. This associate is a stand-alone model-based system designed to interact with operators of complex dynamic systems, such as airplanes, manned space systems, and satellite ground control systems in ways comparable to that of a human assistant. The operator function model expert system (OFMspert) architecture and the design and empirical validation of OFMspert's understanding component are described. The design and validation of OFMspert's interactive and control components are also described. A description of current work in which OFMspert provides the foundation in the development of an intelligent tutor that evolves to an assistant, as operator expertise evolves from novice to expert, is provided.

Mitchell, Christine M.↗

A research review of quality assessment for software

Measures were recommended to assess the quality of software submitted to the AdaNet program. The quality factors that are important to software reuse are explored and methods of evaluating those factors are discussed. Quality factors important to software reuse are: correctness, reliability, verifiability, understandability, modifiability, and certifiability. Certifiability is included because the documentation of many factors about a software component such as its efficiency, portability, and development history, constitute a class for factors important to some users, not important at all to other, and impossible for AdaNet to distinguish between a priori. The quality factors may be assessed in different ways. There are a few quantitative measures which have been shown to indicate software quality. However, it is believed that there exists many factors that indicate quality and have not been empirically validated due to their subjective nature. These subjective factors are characterized by the way in which they support the software engineering principles of abstraction, information hiding, modularity, localization, confirmability, uniformity, and completeness.

Source record↗

Analyzing human errors in flight mission operations

A long-term program is in progress at JPL to reduce cost and risk of flight mission operations through a defect prevention/error management program. The main thrust of this program is to create an environment in which the performance of the total system, both the human operator and the computer system, is optimized. To this end, 1580 Incident Surprise Anomaly reports (ISA's) from 1977-1991 were analyzed from the Voyager and Magellan projects. A Pareto analysis revealed that 38 percent of the errors were classified as human errors. A preliminary cluster analysis based on the Magellan human errors (204 ISA's) is presented here. The resulting clusters described the underlying relationships among the ISA's. Initial models of human error in flight mission operations are presented. Next, the Voyager ISA's will be scored and included in the analysis. Eventually, these relationships will be used to derive a theoretically motivated and empirically validated model of human error in flight mission operations. Ultimately, this analysis will be used to make continuous process improvements continuous process improvements to end-user applications and training requirements. This Total Quality Management approach will enable the management and prevention of errors in the future.

Bruno, Kristin J.↗

Load Balancing Sequences of Unstructured Adaptive Grids

Mesh adaption is a powerful tool for efficient unstructured grid computations but causes load imbalance on multiprocessor systems. To address this problem, we have developed PLUM, an automatic portable framework for performing adaptive large-scale numerical computations in a message-passing environment. This paper makes several important additions to our previous work. First, a new remapping cost model is presented and empirically validated on an SP2. Next, our load balancing strategy is applied to sequences of dynamically adapted unstructured grids. Results indicate that our framework is effective on many processors for both steady and unsteady problems with several levels of adaption. Additionally, we demonstrate that a coarse starting mesh produces high quality load balancing, at a fraction of the cost required for a fine initial mesh. Finally, we show that the data remapping overhead can be significantly reduced by applying our heuristic processor reassignment algorithm.

Biswas, Rupak↗