Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “supervised”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

A Mixed-Method Design Approach for Empirically Based Selection of Unbiased Data Annotators

Implicit bias embedded in the annotated data is by far the greatest impediment in the effectual use of supervised machine learning models in tasks involving race, ethics, and geopolitical polarization. For societal good and demonstrable positive impact on wider society, it is paramount to carefully select data annotators and rigorously validate the annotation process. Current approaches to selecting annotators are not sufficiently grounded in scientific principles and are limited at the policy-guidance level, thereby rendering them unusable for machine learning practitioners. This work proposes a new approach based on the mixed-methods design that is functional, adaptable, and simpler to implement in selecting unbiased annotators for any machine learning problem. By demonstrating it on a real-world geopolitical problem, we also identified and ranked key inane profile characteristics towards an empirically-based selection of unbiased data annotators.

Thakur, Gautam Malviya↗

High-dimensional and permutation invariant anomaly detection

Methods for anomaly detection of new physics processes are often limited to low-dimensional spaces due to the difficulty of learning high-dimensional probability densities. Particularly at the constituent level, incorporating desirable properties such as permutation invariance and variable-length inputs becomes difficult within popular density estimation methods. In this work, we introduce a permutation-invariant density estimator for particle physics data based on diffusion models, specifically designed to handle variable-length inputs. We demonstrate the efficacy of our methodology by utilizing the learned density as a permutation-invariant anomaly detection score, effectively identifying jets with low likelihood under the background-only hypothesis. To validate our density estimation method, we investigate the ratio of learned densities and compare to those obtained by a supervised classification algorithm.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Novel Low-Cost Method of Manufacturing Nb3Sn Superconductors with Multiple-Tin-Tube Sources (CRADA FRA-2008-0001 Final Report)

In order to successfully sustain a fusion reaction, peak magnetic fields on the order of 12-13 Tesla will be required. Magnetic fields of this magnitude can only be accomplished by advanced superconductors such as Nb3Sn. However, the economic success of a fusion machine will depend on further improvements in the cost-performance of the Nb3Sn conductor. This project will develop a novel, low-cost, multiple-tin-tube process as a new manufacturing approach for large-scale Nb3Sn-conductor production. The process will be suitable for the efficient production of larger strands (0.83 mm), consistent with ITER (International Thermonuclear Experimental Reactor) specifications. In Phase I, Cu/Nb composites were manufactured and shaped into sub-elements. These sub-elements were tin-coated by electroplating, assembled into a precise-fit restack billet tube, and drawn to 0.83 mm diameter. In Phase II, the process will be scaled-up to full production levels. The improved Nb3Sn conductor should have an immediate benefit for high-field magnet applications. A prototype fusion machine, based on a cost effective Nb3Sn conductor, would have enormous economic and social benefits. In addition, the conductor should be applicable to nuclear magnetic resonance (NMR), which has requirements for use in chemical research, biochemistry, pharmaceutical chemistry, polymer science, petroleum research, agricultural chemistry, and medicine. Leszek Motowidlo, Principal Investigator, will be responsible for the overall coordination of the effort. He and others of SupraMagnetics staff will design and fabricate protoype PIT Nb3Sn conductors for evaluation at Fermilab. Emanuela Barzi will be responsible for the Fermilab subcontract and will coordinate and supervise critical current testing Nb3Sn strands and cable fabrication and evaluation.

43 PARTICLE ACCELERATORS↗

100th Anniversary of the discovery of Ferroelectricity: How did it impact the Current Day Physics

Ferroelectric phenomenon in materials was identified for the first time about 100 years ago in 1920 (paper presented at the American Physical Society (APS) Meeting in Washington, DC, April 1920), at the University of Minnesota, MN, USA; by then a graduate student Joseph Valasek working under the supervision of Prof. W. F. G. Swann. Before this announcement, some prominent physicists had envisaged and even predicted the possibility of an analogous electrical behavior in some materials to that of the well-established hysteresis behavior of magnetic materials. Debye’s work tried to put the concept of Curie temperature in some solids in 1912 but it Schrodinger in the same year who formalized the term ferroelectricity. The names ferroelectrics, ferroelectricity, etc. are fully symbolic of the hysteresis loop-like behavior originally displayed by the magnetic materials. Later on when the physics of ferroelectrics was formalized, most of the terminology, e.g. Curie constant, Curie temperature, etc. that characterized the hysteresis loop or its related characteristics, was inherited from the magnetic materials. Over the years basic ferroelectricity concepts were significantly developed. The observed ferroelectric hysteresis loop between electric polarization vs applied electric field in the then well-known material, Rochelle salt, was presented at the April meeting of the APS, held at, then known as, the National Bureau of Standards or NBS (currently known as the National Institute for Standards and Technology or NIST). Interestingly, even though Valasek submitted the abstract but it was presented by Swann (and Valasek was not present). It happened to be a unique case of the earlier predictions but it did not catch the attention of many researchers working in the field of electronics. Whatever the reason, there was a little attention paid to this newly identified effect in Rochelle salt in 1920s. In late 1920, Valasek’s paper was submitted to Physical Review and that appeared in April 1921. Both ferroelectricity and ferromagnetism are the observational or experimental characteristics of a special class of materials which were not predicted by any basic theoretical approaches to start with at that time.

36 MATERIALS SCIENCE↗

Automated Threat Recognition For Aviation Security Applications

We have developed a framework for automated threat recognition (ATR) of explosive threat materials for both single-energy and dual-energy X-ray CT systems. Under this framework, two different types of ATR have been developed. The first type of ATR employs supervised machine learning with statistical characterization of target materials for threat identification training. The reliance only on statistical characterization information for threat training uniquely enables this style of ATR to adapt quickly to evolving threats. The second type of ATR employs deep learning through convolutional neural networks. Convolutional neural networks are attractive due to their human-like capacity for learning and strong ability to identify trends and patterns. Although this method is more powerful than the first type, it requires large amounts of training data and therefore is less agile. Each ATR performs threat characterization at the voxel neighborhood level. This approach avoids the use of threat shape as a detection criterion, which is prohibited by DHS and TSA guidelines.

97 MATHEMATICS AND COMPUTING↗

Identifying Suspect Instrument Intervals Using Midnight Noise Time Histories

With an intense work ethic, and high levels of devotion to their craft, seismologists continue to battle the elements and wrestle with complex logistics in their efforts to field instrumentation over the entire globe. We are fortunate to see data volumes accelerating in size, and quality continuing to improve; for example, universal timing issues can now be considered rare. However, instrument response issues are still common, and can hinder research that seeks to understand amplitudes of seismic wavefields. We are interested in using the accumulations of seismic data to develop models that will predict high frequency (0.2-20 Hz, and higher) signal amplitudes for explosion monitoring purposes over broad areas, which requires large data sets and extensive quality control. To identify response and station health issues, we have collected noise time histories for global seismic data, focusing on measurements near (but not restricted to) midnight to eliminate diurnal variations, and have manually determined time intervals that appear inconsistent with background behavior. We assign descriptive labels, but do not attempt to diagnose causes. We use these intervals to discard data. To date, we have examined 39,260 channels from 11,105 stations, heavily weighted toward IRIS holdings, dates through 2017 (depending on station, roughly the date we started our manual review), bands between 1 and 8 Hz, finding 24,733 anomalous time intervals. The great majority (90%) of these intervals appear to be shifts of constant offset, often bounded by times of known instrument changes, likely the result of poor documentation of response parameters at one of many stages between the field and the plotter. We hope these results can be of use to our colleagues, and would encourage community efforts to diagnose anomalous behavior, and fix poor responses. We also hope these results will support automation efforts, including application of supervised learning techniques.

47 OTHER INSTRUMENTATION↗

Leading-Order Analysis by Artificial Intelligence [Slides]

The following topics are addressed in this seminar presentation: The author's background; What is leading-order analysis?; What are supervised and unsupervised machine learning and what is artificial intelligence?; The definition of AI; and, Conclusions and outlook.

42 ENGINEERING↗

2020 LLNL Nuclear Science and Security Summer Internship Program

The Lawrence Livermore National Laboratory (LLNL) Nuclear Science and Security Summer Internship Program (NS 3 IP) is designed to give graduate students an opportunity to come to LLNL for 8–10 weeks of hands-on research. Students conduct research under the supervision of a staff scientist, attend a weekly lecture series, interact with other students, and present their work in poster format at the end of the program. Students also have the opportunity to meet staff scientists one-on-one, participate in LLNL facility tours (e.g., the National Ignition Facility and Center for Accelerator Mass Spectrometry), and gain a better understanding of the various science programs at LLNL. Due to the travel and access restrictions imposed by the COVID-19 pandemic, the 2020 NS 3 IP was organized as an “all-virtual” internship program. With LLNL’s extensive institutional support, students accessed the laboratory’s cyberinfrastructure through a secure virtual desktop environment and all seminars, mentor interactions, summer presentations, and laboratory tours were performed remotely. While this virtual internship format did not allow for hands-on laboratory research projects, both the interns and their mentors constructed creative research projects that maximized student exposure to nuclear science research that is relevant to DTRA and LLNL interests in nuclear security.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Applying Machine Learning to the Classification of DC-DC Converters. NA-22 Final Report

Tools are now available that enable measurement electromagnetic radiation (EMR) from active electronics in an item. This radiation may be intended WIFI or cellular network links, for example or unintended such as the switching noise generated by DC-to-DC converters. It would be extremely valuable to have the capability to discriminate between the low-voltage DC-to-DC converters or other digital noise prevalent in most modern electronics, versus the high-voltage DC-to-DC converters used in utility firesets. Previous work performed under a Sandia Laboratory Directed Research and Development (LDRD) project on Charge State Detection using a deep neural network has been continued in this effort. A state-of-the-art supervised machine learning algorithm has not only been extended to discriminate between low and high voltage converters but has been validated in determining a converters make and model.

42 ENGINEERING↗

Transient superconductivity at nano- and meso-scales

High-T c superconductivity is surpassed by few, if any, other unsolved problems in contemporary physics in terms of its richness, complexity, impact on other fields, and potential technological importance in energy applications. Recent discoveries reveal that the highest transition temperatures emerge under extraordinary experimental conditions such as the strong perturbation of a single atomic layer material by the underlying substrate, application of ~200 GPa pressure or ~MV/cm static electric fields, or irradiation by intense femtosecond optical fields. Research in superconductivity under extreme experimental conditions is challenging and requires the development of novel experimental methods and new theoretical tools suitable to tackle the problem. Our team has approached the challenges of transient superconductivity under intense optical fields by rethinking the types of experimental observables that are best suited to elucidate the physics of light-induced effects. This exercise has identified the need for: i) ultra-fast spatio-temporal probes enabling access to plasmonic properties and also nano-scale inhomogeneities that are ubiquitous in unconventional superconductors; ii) meso-scale structures and hybrid meta-surfaces imperative for strong enhancement of optical fields and iii) theoretical approaches suitable to explain and predict the response of superconductors under ultra-fast photo-excitation. Co-PIs have already made major advances with developing capabilities i)-iii). Therefore, our team is poised to make significant progress in transient superconductivity by exploring novel spatio-temporal effects that currently remain unattainable. Co-investigators will search for light-induced superconductivity in the high-T c cuprates to build upon spectacular recent results still lacking independent confirmations. Novel data acquisition methods combined with nano-plasmonic imaging will allow our team to test the hypothesis of photo-induced superconducting pairing. Spatio-temporal experiments will provide insights into the interplay between superconductivity and competing orders in the cuprates. Co-PIs will also investigate strong light-matter interaction and superconductivity in FeSe monolayers. Finally, we will study spatio-temporal electrodynamics of planar Josephson junctions. This latter direction will allow our team to thoroughly characterize one of the most fundamental examples of inhomogeneity in all of unconventional superconductivity. The proposed experiments in combination with theoretical analysis will provide information that is difficult to obtain using alternative methods. Basov and Averitt will carry out pump-probe spectroscopy and nano-imaging experiments. Averitt and Hone will design and fabricate state-of-the-art meta-surfaces. Theoretical and computational studies of ultrafast transient phenomena will be carried out by Millis and Fogler. Modeling of time-resolved nano-optical effects will be done by Fogler. The bulk of the requested budget will be used to support graduate students at Columbia & UCSD that will be co-supervised by co-PIs. The proposed program is transformative, since it will enable an entire suite of experiments previously either impossible or technically implausible. It will deliver critically important insights not only into mechanisms of unconventional superconductivity but also to many other correlated quantum materials.

36 MATERIALS SCIENCE↗

Human Factors Considerations for Automating Microreactors

The U.S. Nuclear Regulatory Commission (NRC) has interacted with vendors pursuing the commercialization of microreactors ( <10 MW th ). It is envisioned that microreactors could be assembled and fueled in a factory and shipped to a site. Many of the sites are expected to be remote locations requiring off-grid power or in some cases military bases. However, before this new class of nuclear reactor can be fully developed and implemented by designers, an effort must be made to explore the technical issues and provide reasonable assurance to the public regarding health and safety impacts centered on various technical issues. Prior works have examined many of these issues. One issue not yet fully explored is the possible change in role of the operations and support personnel. Due to the passive safety features of microreactors and their low level of nuclear material, the microreactor facilities may automate more functions and rely on inherent safety features more than its predecessor nuclear power plants. In some instances, human operators may not be located onsite and may instead be operating or monitoring the facility from a remote location. Some designs also call for operators to supervise and control multiple microreactors from the control room. This report explores the issues around reduced staffing of microreactors, highlights the historical safety functions associated with human operators, assesses current licensing requirements for appropriateness to varying levels of personnel support, and describes a recommended regulatory approach for reviewing the impact of reduced staff to the operation of microreactors. The report evaluates these issues through an extensive literature survey and Subject Matter Expert interviews. The literature covers research topics related to Human Factors Engineering as well as regulatory guidance given by the Nuclear Regulatory Commission.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Transfer Learning using Denoising Auto-Encoders for Cellular-Level Annotation of Tumor in Pathology Slides

Adversarial examples can produce altered classifications using only seemingly innocuous, imperceptible perturbations to the original image. The imperceptibility of adversarial perturbations suggests that the corresponding classifiers use decision criteria different than those of a human. In a medical setting, inexplicable decision criteria confound a pathologist’s willingness to trust machine-generated annotations. Here, we analyze denoising tumor detection models to see if they are robust to imperceptible adversarial perturbations. Moreover, to be more fully trusted by pathologists, we require tumor detectors that generate interpretable annotations which segment pathology slides into tumorous and normal regions at the cellular level. We therefore compare transfer learning based on two different autoencoder architectures, one derived from a deep denoising bottleneck autoencoder and one from an over-complete sparse autoencoder. Both autoencoders were first trained in an unsupervised manner on a set of pathology slides drawn from the Camelyon16 dataset. The latent representations produced by each autoencoder were then passed to separate neural networks that were trained in a supervised manner on binary tumor-normal masks generated by pathologists at cellular resolution. Both tumor detectors supported better than 90% AUC PR as measured by the area under the precision/recall curve on a held-out pathology slide. To assess the underlying decision criteria used by both tumor detectors, we constructed imperceptible adversarial examples which reduced the AUC PR of both models to less than 70%. Random noise of the same amplitude had almost no effect on the AUC PR of either model. Additionally, each tumor detector was resistant to adversarial “transfer” attacks targeting the other. The adversarial perturbations showed strong characteristic differences: the deep denoising models perturbations were a very diffuse, seemingly unrecognizable pattern while the sparse coding models perturbations showed traces of tissue cells.

47 OTHER INSTRUMENTATION↗

Characterization of Extremes and Compound Impacts: Applications of Machine Learning and Interpretable Neural Networks

Focal Area: This white paper responds to Focal area III by exploring data fusion, learning and explainable AI methods in characterizing hydrological extremes and interconnections. It also addresses Focal area II by using probabilistic AI and ensemble ML for predicting extremes and compound extremes. Science Challenge: A key question associated with the integrated water (or hydrological) cycle grand challenge in the Earth and Environmental Systems Sciences Division (EESSD) strategic plan, is how the frequency and intensity of hydrological events will change. Prediction of the tail behavior (extremes) of the hydrological cycle is especially challenging, because of their stochasticity and low probability. These extreme events and their compound impacts have significant societal and economic consequences. It is anticipated for the next-generation Earth System models (ESMs), that model predictability of the water cycle will improve with increased resolution (e.g., regionally refined E3SM), advanced software and computational architectures, and improved model physics based on the data from ARM measurements and high-fidelity models. However, the challenges for predictability of low-probability high-impact extreme events will unlikely be alleviated with conventional modeling and data-driven approaches, as ESMs are calibrated largely for capturing the high-frequency mean climate states. Recent AI and ML applications have shown great potential in quantifying well-defined climate extremes (e.g., supervised learning of tropical cyclones/atmospheric rivers by ClimateNet1) but few efforts are dedicated to compound events, extreme drivers and uncertainty estimation. We envision the opportunity to develop and apply ML and interpretable AI methods extended on the existing efforts, specifically, for: (1) identification of compound extremes, (2) diagnosing drivers of extremes, (3) bias correction in extreme predictions and (4) probabilistic modeling of extremes.

54 ENVIRONMENTAL SCIENCES↗

Seascape Interface Control Document (V.1)

This paper serves as the Interface Control Document (ICD) for the Seascape automated test harness developed at Sandia National Laboratories. The primary purposes of the Seascape system are: (1) provide a place for accruing large, curated, labeled data sets useful for developing and evaluating detection and classification algorithms (including, but not limited to, supervised machine learning applications) (2) provide an automated structure for specifying, running and generating reports on algorithm performance. Seascape uses GitLab, Nexus, Solr, and Banana, open source codes, together with code written in the Python language, to automatically provision and configure computational nodes, queue up jobs to accomplish algorithms test runs against the stored data sets, gather the results and generate reports which are then stored in the Nexus artifact server.

97 MATHEMATICS AND COMPUTING↗

RAVEN Theory Manual

RAVEN is a software framework able to perform parametric and stochastic analysis based on the response of complex system codes. The initial development was aimed at providing dynamic risk analysis capabilities to the thermohydraulic code RELAP-7, currently under development at Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose stochastic and uncertainty quantification platform, capable of communicating with any system code. In fact, the provided Application Programming Interfaces (APIs) allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by input files or via python interfaces. RAVEN is capable of investigating system response and explore input space using various sampling schemes such as Monte Carlo, grid, or Latin hypercube. However, RAVEN strength lies in its system feature discovery capabilities such as: constructing limit surfaces, separating regions of the input space leading to system failure, and using dynamic supervised learning techniques. The development of RAVEN started in 2012 when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework arose. RAVEN’s principal assignment is to provide the necessary software and algorithms in order to employ the concepts developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just to identify the frequency of an event potentially leading to a system failure, but the proximity (or lack thereof) to key safety-related events. Hence, the approach is interested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. peak pressure in a pipe) is exceeded under certain conditions. Most of the capabilities, implemented having RELAP-7 as a principal focus, are easily deployable to other system codes. For this reason, several side activates have been employed (e.g. RELAP5-3D, any MOOSE-based App, etc.) or are currently ongoing for coupling RAVEN with several different software. The aim of this document is to provide a set of commented examples that can help the user to become familiar with the RAVEN code usage.

97 MATHEMATICS AND COMPUTING↗

Seascape Interface Control Document (V. 2)

This paper serves as the Interface Control Document (ICD) for the Seascape automated test harness developed at Sandia National Laboratories. The primary purposes of the Seascape system are: (1) provide a place for accruing large, curated, labeled data sets useful for developing and evaluating detection and classification algorithms (including, but not limited to, supervised machine learning applications) (2) provide an automated structure for specifying, running and generating reports on algorithm performance. Seascape uses GitLab, Nexus, Solr, and Banana, open source codes, together with code written in the Python language, to automatically provision and configure computational nodes, queue up jobs to accomplish algorithms test runs against the stored data sets, gather the results and generate reports which are then stored in the Nexus artifact server.

97 MATHEMATICS AND COMPUTING↗

Development of an Advanced Integrated Operations Concept for Hybrid Control Rooms

The U.S. Nuclear Industry has an urgent need to reduce the operations and maintenance costs to remain economically competitive in today’s energy market. Measures to improve efficiency in operations will need to leverage technology in a way that safely transforms how plants are operated. This work describes the development of an integrated operations concept that integrates data from existing Instrumentation and Control (I&C) infrastructure, upgraded I&C systems, new sensors, and field technologies such as computer-based procedures to provide operators with centralized, streamlined instructions. The concept was developed to allow for an operator to remotely supervise many plant activities and to dramatically streamline plant operations and maintenance. This report describes the design philosophy, the analysis used to inform design, the implementation in the Human Systems Simulation Laboratory, and illustrates the design concept.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Demonstration and Evaluation of an Advanced Integrated Operations Concept for Hybrid Control Rooms

The U.S. nuclear industry has an urgent need to reduce operations and maintenance costs to remain economically competitive in today’s energy market. Measures to improve efficiency in operations will need to leverage technology in a way that safely transforms how plants are operated. This work describes the Evaluation of an integrated operations concept that draws together data from existing Instrumentation and Control (I&C) infrastructure, upgraded I&C systems, new sensors, and field technologies such as computer-based procedures to provide operators with centralized, streamlined instructions. The concept was developed to allow for an operator to remotely supervise many plant activities and to dramatically streamline plant operations and maintenance. This describes the methods, results, and design recommendations for the concept based on an operator workshop to evaluate the concept.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗