SEARCH · Engineering Papers

Results for “VISION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

All sources NASA NTRS DOE OSTI

NASA NTRS2005

The NASA Bed Rest Project

NASA s National Vision for Space Exploration includes human travel beyond low earth orbit and the ultimate safe return of the crews. Crucial to fulfilling the vision is the successful and timely development of countermeasures for the adverse physiological effects on human systems caused by long term exposure to the microgravity environment. Limited access to in-flight resources for the foreseeable future increases NASA s reliance on ground-based analogs to simulate these effects of microgravity. The primary analog for human based research will be head-down bed rest. By this approach NASA will be able to evaluate countermeasures in large sample sizes, perform preliminary evaluations of proposed in-flight protocols and assess the utility of individual or combined strategies before flight resources are requested. In response to this critical need, NASA has created the Bed Rest Project at the Johnson Space Center. The Project establishes the infrastructure and processes to provide a long term capability for standardized domestic bed rest studies and countermeasure development. The Bed Rest Project design takes a comprehensive, interdisciplinary, integrated approach that reduces the resource overhead of one investigator for one campaign. In addition to integrating studies operationally relevant for exploration, the Project addresses other new Vision objectives, namely: 1) interagency cooperation with the NIH allows for Clinical Research Center (CRC) facility sharing to the benefit of both agencies, 2) collaboration with our International Partners expands countermeasure development opportunities for foreign and domestic investigators as well as promotes consistency in approach and results, 3) to the greatest degree possible, the Project also advances research by clinicians and academia alike to encourage return to earth benefits. This paper will describe the Project s top level goals, organization and relationship to other Exploration Vision Projects, implementation strategy, address Project deliverables, schedules and provide a status of bed rest campaigns presently underway.

Rhodes, Bradley↗

NASA NTRS2007

Science and the Constellation Systems Program Office

An underlying tension has existed throughout the history of NASA between the human spaceflight programs and the external scientific constituencies of the robotic exploration programs. The large human space projects have been perceived as squandering resources that might otherwise be utilized for scientific discoveries. In particular, the history of the relationship of science to the International Space Station Program has not been a happy one. The leadership of the Constellation Program Office, created in NASA in October, 2005, asked me to serve on the Program Manager s staff as a liaison to the science community. Through the creation of my position, the Program Manager wanted to communicate and elucidate decisions inside the program to the scientific community and, conversely, ensure that the community had a voice at the highest levels within the program. Almost all of my technical contributions at NASA, dating back to the Apollo Program, has been within the auspices of what is now known as the Science Mission Directorate. However, working at the Johnson Space Center, where human spaceflight is the principal activity, has given me a good deal of incidental contact and some more direct exposure through management positions to the structures and culture of human spaceflight programs. I entered the Constellation family somewhat naive but not uninformed. In addition to my background in NASA science, I have also written extensively over the past 25 years on the topic of human exploration of the Moon and Mars. (See, for example, Mendell, 1985). I have found that my scientific colleagues generally have little understanding of the structure and processes of a NASA program office; and many of them do not recognize the name, Constellation. In many respects, the international ILEWG community is better informed. Nevertheless, some NASA decision processes on the role of science, particularly with respect to the formulation of a lunar surface architecture, are not well known, even in ILEWG. At the recent annual Lunar and Planetary Science Conference, I reviewed the evolution of the program as a function of Agency leadership and the constraints put on NASA by the President in his 2004 announcement. I plan to continue my long-time ILEWG tradition of reporting a personal view of the state of development of human exploration of the solar system, this time coming from within the program office tasked to implement the vision for the United States. The current NASA implementation of the Vision for Space Exploration is consistent with certain classical scenarios that have been discussed extensively in the literature. I will discuss the role of science within the Vision, both from official policy and from a de facto interaction. While science goals are not officially driving the implementation of the Vision, the tools of scientific exploration are integral to defining the extraterrestrial design environments. In this respect the sharing of results from international missions to the Moon can make significant contributions to the success of the future human activities.

Mendell, Wendell↗

NASA NTRS2001

Mobile camera-space manipulation

The invention is a method of using computer vision to control systems consisting of a combination of holonomic and nonholonomic degrees of freedom such as a wheeled rover equipped with a robotic arm, a forklift, and earth-moving equipment such as a backhoe or a front-loader. Using vision sensors mounted on the mobile system and the manipulator, the system establishes a relationship between the internal joint configuration of the holonomic degrees of freedom of the manipulator and the appearance of features on the manipulator in the reference frames of the vision sensors. Then, the system, perhaps with the assistance of an operator, identifies the locations of the target object in the reference frames of the vision sensors. Using this target information, along with the relationship described above, the system determines a suitable trajectory for the nonholonomic degrees of freedom of the base to follow towards the target object. The system also determines a suitable pose or series of poses for the holonomic degrees of freedom of the manipulator. With additional visual samples, the system automatically updates the trajectory and final pose of the manipulator so as to allow for greater precision in the overall final position of the system.

Seelinger, Michael J.↗

NASA NTRS2009

Synthetic Foveal Imaging Technology

Synthetic Foveal imaging Technology (SyFT) is an emerging discipline of image capture and image-data processing that offers the prospect of greatly increased capabilities for real-time processing of large, high-resolution images (including mosaic images) for such purposes as automated recognition and tracking of moving objects of interest. SyFT offers a solution to the image-data processing problem arising from the proposed development of gigapixel mosaic focal-plane image-detector assemblies for very wide field-of-view imaging with high resolution for detecting and tracking sparse objects or events within narrow subfields of view. In order to identify and track the objects or events without the means of dynamic adaptation to be afforded by SyFT, it would be necessary to post-process data from an image-data space consisting of terabytes of data. Such post-processing would be time-consuming and, as a consequence, could result in missing significant events that could not be observed at all due to the time evolution of such events or could not be observed at required levels of fidelity without such real-time adaptations as adjusting focal-plane operating conditions or aiming of the focal plane in different directions to track such events. The basic concept of foveal imaging is straightforward: In imitation of a natural eye, a foveal-vision image sensor is designed to offer higher resolution in a small region of interest (ROI) within its field of view. Foveal vision reduces the amount of unwanted information that must be transferred from the image sensor to external image-data-processing circuitry. The aforementioned basic concept is not new in itself: indeed, image sensors based on these concepts have been described in several previous NASA Tech Briefs articles. Active-pixel integrated-circuit image sensors that can be programmed in real time to effect foveal artificial vision on demand are one such example. What is new in SyFT is a synergistic combination of recent advances in foveal imaging, computing, and related fields, along with a generalization of the basic foveal-vision concept to admit a synthetic fovea that is not restricted to one contiguous region of an image.

Hoenk, Michael↗

NASA NTRS2003

Smart Camera System for Aircraft and Spacecraft

This paper describes a new approach to situation awareness that combines video sensor technology and synthetic vision technology in a unique fashion to create a hybrid vision system. Our implementation of the technology, called "SmartCam3D" (SC3D) has been flight tested by both NASA and the Department of Defense with excellent results. This paper details its development and flight test results. Windshields and windows add considerable weight and risk to vehicle design, and because of this, many future vehicles will employ a windowless cockpit design. This windowless cockpit design philosophy prompted us to look at what would be required to develop a system that provides crewmembers and awareness. The system created to date provides a real-time operations personnel an appropriate level of situation 3D perspective display that can be used during all-weather and visibility conditions. While the advantages of a synthetic vision only system are considerable, the major disadvantage of such a system is that it displays the synthetic scene created using "static" data acquired by an aircraft or satellite at some point in the past. The SC3D system we are presenting in this paper is a hybrid synthetic vision system that fuses live video stream information with a computer generated synthetic scene. This hybrid system can display a dynamic, real-time scene of a region of interest, enriched by information from a synthetic environment system, see figure 1. The SC3D system has been flight tested on several X-38 flight tests performed over the last several years and on an ARMY Unmanned Aerial Vehicle (UAV) ground control station earlier this year. Additional testing using an assortment of UAV ground control stations and UAV simulators from the Army and Air Force will be conducted later this year.

Delgado, Frank↗

NASA NTRS2011

Increased Intracranial Pressure and Visual Impairment Associated with Long-Duration Spaceflight

Although humans have been flying in space since the 1960s, more recent missions have revealed a new suite of physiological adaptations and consequences of space flight. Notably, 60% of long-duration crewmembers (ISS/MIR) and >25% of short-duration (Shuttle) crewmembers have reported subjective degradation in vision (based on debrief comments) (Gibson 2011). Decreased near-visual acuity was demonstrated in 46% of ISS/Mir and 21% of Shuttle crewmembers, resulting in a shift of up to 1-2 diopters in their refractive correction. It is likely that the recently revealed ophthalmic changes have been present since the first days of human space flight, but have been overlooked or attributed to other causations. The reported changes in vision have occurred at various time points throughout missions, with ranging degrees of visual degradation. Although some cases resolved upon return to Earth, several astronauts have not regained preflight visual acuity, indicating that the damage may be permanent. While observing these changes over the years, without other overt symptomology and with the given age range of the flying population, this has largely been attributed to an expected hyperopic shift due to aging. However, the availability of onboard analysis techniques, including visual acuity assessments, retinal imagery, and ultrasounds of the eye and optic nerve tracts, along with more detailed post-flight techniques, has led to the recent recognition of a wider syndrome. Along with vision changes, findings include flattening of the globe, swelling of the optic disc (papilledema), choroidal folds in the retina, swelling of the optic nerve sheath, and visual field defects. It is widely hypothesized that this constellation of findings may be explained by an elevation of intracranial pressure (ICP). Out of the 60% of long-duration astronauts that have reported a subjective degradation in vision, a subset (currently 10 astronauts) have developed this syndrome. The National Aeronautics and Space Administration (NASA) has made it a high priority to understand this syndrome and provide mitigation techniques to protect crewmembers from visual impairment. While there are many possible factors that could contribute to intracranial hypertension associated with spaceflight, the relative contribution of these, as well as the processes by which eye damage occurs as a result of intracranial hypertension, are not fully understood. The observed pathophysiological phenomena are extremely complex and it is likely that multiple factors contribute to their incidence, rather than one simple mechanism. This paper will define and examine the findings in detail, and expound upon the potential contributing factors and their relative contribution to this syndrome.

Marshall-Bowman, Karina↗

NASA NTRS2011

Straight Ahead in Microgravity

INTRODUCTION The subjective straight-ahead direction is a very basic perceptual reference for spatial orientation and locomotion. The perceived straight-ahead along the horizontal and vertical meridian is largely determined by both otolith and somatosensory inputs which are altered in microgravity. The Straight Ahead in Microgravity (SAM) experiment will be conducted on the International Space Station (ISS) to examine how this spatial processing changes as a function of spaceflight. METHODS Data will be collected before the flight, at one-month intervals during long-duration stay (180 days) on board ISS, and after return to Earth. Control studies will also be performed during parabolic flights. Three different protocols will be used in each test session: (1) Fixation: The subject will be asked to look at actual targets (normal vision) and then to imagine these same targets (occluded vision) in the straight-ahead direction. Targets will be located at near distance (arm s length, ~0.5m), medium distance (~1 m), and far distance (beyond 2 m). This task will be successively performed with subject s body aligned with the spacecraft interior, and with subject s body tilted forward and backward by an operator. (2) Saccades: The subject will be asked to make horizontal and vertical saccades, first relative to the spacecraft interior reference system, and then relative to the subject s head reference system. This task will be successively performed with subject s body aligned with the spacecraft interior, and with subject s body tilted in roll or in pitch by an operator. (3) Linear Vestibulo-Ocular Reflex (VOR): The subject will be asked to stare at actual visual targets (normal vision) at various distances (near, medium, far) in the straight-ahead direction. Vision will then be occluded, and the subject will be asked to continue staring at the same imagined targets while he/she is passively translated forward-backward, up-down, or side-to-side. The subject's body motion will be performed by the restrained operator while the subject is free-floating. EXPECTED RESULTS The coupling of downward gaze with vergence eye movements observed on Earth is expected to increase in microgravity. Saccadic eye movements made in darkness along perceived axes are expected to be more closely aligned with the body s longitudinal axis in 0g compared to 1g, as the reference system for spatial orientation moves from an allocentric (gravitational) to an egocentric (idiotropic) vector. Changes in the linear VOR will reflect adaptive changes in otolith-ocular reflex contributions to the perceived straight-ahead. DISCUSSION A change in an individual's egocentric reference might have negative consequences on evaluating the direction of an approaching object or on the accuracy of reaching movements or locomotion. Consequently, investigating how microgravity affects the egocenter is important for understanding the problems associated with long-term effects of microgravity on astronauts' and how they re-adapt to the return of gravitational forces on Earth or other planetary surfaces. This project therefore has theoretical, practical and even clinical implications for the sensorimotor research gap "What are the changes in sensorimotor function over the course of a mission?"

Clement, G.↗

NASA NTRS2014

The Relationship Between CO2 Levels and CO2 Related Symptoms Reported on the ISS

Medical Operations, Toxicology, and the Lifetime Surveillance of Astronaut Health collaborated to assess the association of CO2 levels on board the International Space Station and USOS crew reported symptoms inflight, i.e. headache and vision changes. Private Medical Conference (PMC) documents and the weekly Space Medicine Operations Team (SMOT) Notes were used to provide a robust data set of inflight medical events. All events and non‐events were documented independent of CO2 levels and other potential contributors. Average (arithmetic mean) and single point maximum ppCO2 was calculated for the 24 hours and 7 days prior to the PMC or SMOT date and time provided by LSAH. Observations falling within the first 7 days of flight (147) were removed from the datasets analyzed to avoid confounding with Space Adaptation Syndrome. The final analysis was based on 1716 observations. For headache, 46 headaches were observed. CO2 level, age at launch, time inflight, and data source were all significantly associated with headache. In particular, for each 1 mmHg increase in CO2, the odds of a crewmember reporting a headache doubled. For vision changes, 29 reports of vision changes were observed. These observations were not found to be statistically associated with CO2 levels as analyzed. While the incidence of headache has was not high (~3%), headaches may be an indicator of underlying increases in intracranial pressure, which may result likely from the synergy between CO2‐induced cerebral vasodilatation and decreased venous drainage in microgravity. Vision changes were inconsistently reported and as a result did not align appropriately with the CO2 levels. Further analysis is needed. Our results support ongoing efforts to lower the CO2 exposure limits in spacecraft.

VanBaalen, M.↗

NASA NTRS2021

Astromaterial Curation and Research at NASA

Astromaterial sample return missions from other planetary bodies (e.g., the Moon, asteroids, the Sun) and astromaterial sample collection missions here on Earth (e.g., Antarctic Meteorites, Cosmic Dust) have been a vital part of NASA’s science vision since nearly its inception. Beginning with the Apollo missions to the Moon and extending to the recent successful sample collection by the OSIRIS-REx asteroid sample return mission, these astromaterials collections have been an invaluable resource to scientists and educators around the world. Sample studies continue to provide fundamental insight into how our solar system and its constituent bodies formed and evolved over the past 4.5 billion years. As evidence of their broad impact, there are over 19,141 samples on loan to 433 Principal Investigators in 24 countries [1]. As we plan for exploration missions through 2050, sample return missions will continue to play a vital role in NASA’s science vision. Returned samples truly are the gift that keeps on giving. Having the samples accessible on Earth allows new generations of scientists and new generations of instrumentation to pursue ever evolving scientific questions. For example, the Apollo samples were collected ~50 years ago, yet our views of how the Earth-Moon system formed, the role of volatiles in the early inner solar system, and even the positions of the gas giants in the outer solar system have changed dramatically as a result of Apollo sample analyses conducted very recently. Vital to the long-term viability of any sample return mission is the careful curation of the samples. Curatorial efforts need to begin early in the project lifecycle, not with the return of the samples, but at mission conception. The Astromaterials Acquisition and Curation Office at NASA Johnson Space Center is responsible for curating all of NASA’s current and future extraterrestrial samples. Looking at possible sample return missions over the next 35+ years [2], many samples would require curation efforts a step beyond current capabilities, e.g., cold or cryogenic curation, organically and biologically clean curation, curation of gases and ices, and curation of samples with extreme pressure, temperature, or redox requirements. During the lecture, we discuss the current curatorial efforts in JSC curation, as well as discoveries from the astromaterial research. [1] Zeigler, R. A. et al. (2017) Planetary Science Vision 2050 Workshop. [2] McCubbin F. M. et al. (2017) Planetary Science Vision 2050 Workshop.

astromaterial↗

NASA NTRS2022

IRIS: High-fidelity Perception Sensor Modeling for Closed-Loop Planetary Simulations

Perception plays a key role in autonomous and semi-autonomous planetary exploration vehicles. For instance, landers can use computer vision techniques for identifying safe landing locations, aerial vehicles use cameras as navigation sensors, and planetary rovers use them for localization and hazard detection. Engineering simulations of such systems requires the accurate modeling of perception and vision sensors for simulating autonomy scenarios. In addition, the modeling of sensors for landers, aerial and ground vehicles requires the ability to handle large and high-resolution terrains, the accurate modeling of illumination, hi-fidelity rendering via ray/path tracing and the inclusion of sensor characteristics. Vision sensor models strive to simulate sensor reality by using physics principles to model the interaction of light and objects. Furthermore, high frame rate performance is highly desirable for in-the-loop simulations involving vehicle dynamics and control software. In this paper we describe a new sensor modeling capability called Inter-planetary Rendering for Imaging and Sensors (IRIS) that meets these requirements for the real-time and high-fidelity simulation of vision sensors for planetary aerospace and robotics applications.

Elmquist, Asher↗

NASA NTRS2024

Exploration Systems Exterior Lighting Design Guidance

Humans are returning to the Moon — this time, to stay. NASA has selected a location that maximizes line-of-sight communication with Earth, solar visibility, and access to water ice: the Lunar South Pole (LSP). While the Sun is more consistently in the lunar sky at the poles, it never rises more than 7° above the horizon in the target landing regions. This harsh lighting environment--never experienced during the Apollo missions or in human spaceflight--presents an engineering challenge: Support and protect functional vision. The human vision system, which despite having a high-dynamic range, cannot see well into bright light and cannot adapt quickly from bright to dark or vice versa. The design of helmets, windows, and lighting solutions must work in a complementary fashion to achieve a system of lighting and functional vision support that enables crews to see into darkness while their eyes are light-adapted and see in bright light while still dark-adapted that protects their eyes from injury. This report brings together information and identifies gaps related to LSP Natural environment (topology, regolith, temperature, lighting, and so forth), NASA historical experience exploring the Moon, human vision capabilities and needs, exploration operations, simulation capabilities and needs (for design verification, training, mission planning, and so forth) and existing engineering, safety, medical and performance requirements related to support human exploration.

Simulation↗

DOE OSTI2022

Building Energy Modeling Enhancements to Identify Least-Cost Pathways to Net-Zero Carbon Homes: Preprint

Residential grid-interactive efficient buildings (GEBs) can utilize high levels of energy efficiency and demand flexibility to deliver value to occupants, the grid, and society. However, without the ability to analyze, design, and optimize residential GEBs there is a risk that homes will not realize their full potential value as efficient and dynamic resources, which could ultimately lead to higher than necessary energy costs for U.S. households and lower realization of potential energy efficiency and demand flexibility benefits such as increased convenience/automation, thermal comfort, durability, indoor air quality, and resilience. In 2018, the National Renewable Energy Laboratory (NREL) Residential Modeling Team developed a vision for an open source Residential GEB Analytics Platform built within DOE's EnergyPlus and OpenStudio modeling environment that would enable the design and optimization of residential GEBs, including the identification of least-cost pathways to highly energy-efficient and energy-flexible homes (e.g., net zero carbon homes). We created a detailed workplan for the development of new and enhanced residential GEB component-level models for EnergyPlus and OpenStudio needed to progress toward the vision for the analytics platform while delivering near-term benefits to industry. This paper 1) presents the vision for the platform, summarizing the workplan for residential GEB modeling enhancements; 2) highlights significant advancements that have been achieved between 2018 and 2022, including stochastic residential occupancy modeling, flexible water heater modeling, detailed lithium-ion stationary battery modeling, and realistic residential HVAC modeling; and 3) outlines ongoing efforts and next steps toward the full vision for the platform.

building energy modeling↗

DOE OSTI2022

van der Waals Semiconductor Empowered Vertical Color Sensor

We report biomimetic artificial vision is receiving significant attention nowadays, particularly for the development of neuromorphic electronic devices, artificial intelligence, and microrobotics. Nevertheless, color recognition, the most critical vision function, is missed in the current research due to the difficulty of downscaling of the prevailing color sensing devices. Conventional color sensors typically adopt a lateral color sensing channel layout and consume a large amount of physical space, whereas compact designs suffer from an unsatisfactory color detection accuracy. In this work, we report a van der Waals semiconductor-empowered vertical color sensing structure with the emphasis on compact device profile and precise color recognition capability. More attractive, we endow color sensor hardware with the function of chromatic aberration correction, which can simplify the design of an optical lens system and, in turn, further downscales the artificial vision systems. Also, the dimension of a multiple pixel prototype device in our study confirms the scalability and practical potentials of our developed device architecture toward the above applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2017

Managing the Performance/Error Tradeoff of Floating-point Intensive Applications

Modern embedded systems are becoming more reliant on real-valued arithmetic as they employ mathematically complex vision algorithms and sensor signal processing. Double-precision floating point is the most commonly used precision in computer vision algorithm implementations. A single-precision floating point can provide a performance boost due to less memory transfers, less cache occupancy, and relatively faster mathematical operations on some architectures. However, adopting it can result in loss of accuracy. Identifying which parts of the program can run in single-precision floating point with low impact on error is a manual and tedious process. In this paper, we propose an automatic approach to identify parts of the program that have a low impact on error using shadow-value analysis. Our approach provides the user with a performance/error tradeoff, using which the user can decide how much accuracy can be sacrificed in return for performance improvement. We illustrate the impact of the approach using a well known implementation of Apriltag detection used in robotics vision. In conclusion, we demonstrate that an average 1.3x speedup can be achieved with no impact on tag detection, and a 1.7x speedup with only 4% false negatives.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Intelligent Process Visualization through Nuclear Operation Process Modeling, Reasoning, and Object Detection from Field Videos (Final Report)

This report is a deliverable for the “Final Report” task of DOE NEET Project 19-16790, "Context-Aware Safety Information Display for Nuclear Field Workers." This project's overall goal is to test the hypothesis that integrating computer vision and process reasoning methods will enable proactive visualization of the safe operation and maintenance processes of Nuclear Power Plants (NPP) for field workers. Augmented Reality (AR) glasses adopting such proactive safety information visualization techniques can significantly increase personnel safety and reduce the NPP’s operating costs. The current practice of monitoring NPPs requires workers to switch between digital models, data, and physical workspaces in identifying relevant but potentially occluded objects and in assessing the risks of operation and maintenance processes. On the other hand, frequently changed field conditions require field workers to report to supervisors for real-time guidance. Such guidance is essential to ensure that changing conditions will not invalidate or endanger the work order and other ongoing processes that may jeopardize NPP operations. Additionally, incorrect recognition of equipment objects can result in communication errors and safety problems. AR techniques can assist engineers in viewing the physical workspaces with objects labeled with detailed operation procedures and safety reminders during field operations. The project team developed an “Intelligent Context-Aware Safety Information Display” (ICAD) for supporting Nuclear Power Plant (NPP) field workers in achieving safe and efficient execution of a series of operational tasks in uncertain and changing workspaces of an NPP. Before designing the ICAD-AR prototype, the project team synthesized NPP operational knowledge models through literature review studies, surveys, interviews with domain experts, and knowledge modeling. The project team conducted an extensive study of the operational procedures of various NPPs, and digital technologies that can support the safe and efficient execution of those procedures in different NPP operational contexts. This literature review helped the project team conduct surveys and interviews with nuclear engineers and field workers to identify three categories of information. The NPP knowledge modeling efforts reveal that the three categories of information identified have different levels of importance in a typical procedure of carrying out a series of tasks to achieve a specific NPP operation goal (e.g., shutdown, mode changes). These three categories of information include 1) Workspace dynamics – the changing spatial arrangements of workspaces, tools, protection equipment, and supporting materials, 2) Workflow prognostics – the dynamic dependencies between different parts of an NPP that functionally support and influence each other in terms of safety and efficiency, and 3) Hazards – objects and spaces that contain hazardous materials or physical conditions that can pose risks to workers or mechanical systems. The project team has profiled the importance levels of these categories of information into a knowledge model. This knowledge model specifies what types of information are more critical for a given task in a given workspace so that computers can automatically identify critical objects and sensors in a scene for delivering context-ware safety information to field workers through AR devices. Significant research development of this project results in technical research outcomes and a prototyping system that illustrates the technical feasibility of establishing an ICAD-AR system supporting the proactive safety information display for nuclear field workers. This final report summarizes the project team’s technological achievements in the past three years. Overall, the project team completed the development and integration of five techniques into a prototype ICAD Augmented Reality (ICAD-AR) system and demonstrated the developed system’s real-time execution in a mechanical room. The project team completed the analysis of using this prototype in other types of workspaces based on 3D image data and digital design models collected from two additional workspaces (a water treatment plant and a flow loop training facility). The integrated techniques include 1) Natural Language Processing (NLP) algorithms supporting the generation and updates of nuclear fieldwork process models based on text analysis of work packages and operation manuals; 2) sensor log analysis for predicting control actions in given sensor reading contexts; 3) computer vision algorithms for automatic localization and navigation of workers; 4) object detection algorithms for identifying task-related objects and correlated sensors for safety checking; 5) AR technique as a platform for supporting the integration. The testing results of these five techniques have shown that 1) the sensor log analysis model can predict the next control action with an accuracy of 0.883; 2) the trained natural language processing model can extract more than 80% of the critical information from paper-based procedures (PBPs); 3) the navigation algorithm with the integration of Visual Inertial Odometry (VIO) and Non-Recursive Bayesian Filter methods make operator’s trajectory estimation resilient to drift error; 4) the computer vision algorithm can detect task-specific and safety-critical objects with an average accuracy of 95.3%. The project team used work procedures collected from a flow loop training facility and two datasets collected from two mechanical rooms simulating the workspaces of NPPs to demonstrate the technical capabilities of the developed ICAD-AR prototype. The demonstration validated the technical feasibility of establishing the ICAD-AR system for nuclear field workers and identified the challenges in 1) automatic text analysis of work packages; 2) use of limited samples of sensor logs for predicting the proper timings of control actions; 3) reliably tracking workers and their task progress in mechanical rooms with many similar objects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Demonstration and Evaluation of the Human-Technology Integration Guidance for Plant Modernization

The significance of nuclear power in its role producing carbon-free electricity to the U.S. cannot be overstated. However, with changes in the energy market coupled with changes in incentives given to certain resources like solar and wind, the operating and maintenance costs for these sources have seen a significant reduction, which has consequently negatively impacted the economic viability of the existing U.S. nuclear power plant fleet. Digital instrumentation and control (I&C) and control room modernization is a major critical work domain to reduce operating and maintenance costs. Existing nuclear power plants are commonly configured with mostly legacy analog I&C as well as isolated pockets of digital I&C (a plant process computer, digital recorders, etc.). One challenge with this analog I&C is that replacement parts are becoming prohibitively more expensive and difficult to obtain. Moreover, a significant challenge with the existing analog I&C is that the way in which plants are currently operated and maintained is no longer competitive with other electricity generating sources, like natural gas, where advanced digital I&C technologies are commonplace. This gap between the waynuclear power plants are operated compared to other electricity generating sources significantly challenges the economic viability of the nuclear industry. Indeed, digital I&C systems can fundamentally change the way the plant is operated (i.e., the concept of operation). The introduction of digital I&C technologies offers a wealth of benefits to the nuclear industry. However, it is important to emphasize that, to realize these benefits, a careful understanding of how to integrate technology in a collaborative way that leverages the capabilities of people and technologies is necessary. Human-technology integration applies human factors engineering methods and tools to ensure the safe and reliable use of these technologies while ensuring that the inherent features of the technologies that provide economic value are not missed. The scope of this work documents the demonstration of the recently developed human and technology integration methodology, as applied to developing a new vision and concept of operations for a major U.S. nuclear power plant fleet. This report focuses on the methodological aspects of developing a vision and concept of operations. This report shares the tools, activities, and lessons learned during a modernization currently underway for industry as a whole to consider when planning any significant digital modification and developing a new vision and concept of operations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

Enterprise: Exploration of Concepts, Perspectives and Implications for Systems Engineering

The purpose of this paper is to explore the concept of ‘enterprise’ in the context of Systems Engineering (SE). The term ‘enterprise’ has been used extensively to generally describe large complex entities that have an extensive scope of operations. However, a deeper examination of ‘enterprise’ significance for SE can provide insights as our challenges continue with increasingly complex, uncertain, ambiguous, and integrated entities struggling to thrive in the future. The paper explores three central topics. First, the concept of enterprise is introduced as a central aspect of the future focus for SE, as recognized in the INCOSE SE Vision 2035. Second, a more detailed examination of the enterprise concept is developed in relationship to SE. The thrust of this examination is to understand the nature and role of ‘enterprise’ across a broad spectrum of literature and knowledge, ultimately providing a more informed perspective of enterprise for SE. As part of this exploration, a bibliometric analysis of the term ‘enterprise’ is performed. This exploration extracts key themes (clusters) in the ‘enterprise’ literature. Third, challenges for further development and inculcation of ‘enterprise’ within the SE discipline and support for realization of the SE 2035 Vision are suggested. These challenges point out the need to ‘think differently’ about ‘enterprise’ within the SE context. ‘Enterprise’ is proposed as a central, albeit different, perspective for the SE discipline. Finally, the paper closes with a first–generation perspective for ‘enterprise’ in pursuit of the SE Vision 2035.

42 ENGINEERING↗

DOE OSTI2018

A sample holder for simultaneous Raman and neutron vibrational spectroscopy

We have built a sample holder (called a center stick or sample stick) for performing simultaneous Raman and neutron vibrational spectroscopy on samples of material at the VISION neutron vibrational spectrometer of the Spallation Neutron Source at Oak Ridge National Laboratory. This equipment holds material samples in the neutron beam within the cryogenic environment of the VISION spectrometer, allowing for samples to be studied at temperatures as low as 5 K. It also provides the capability for gas to be loaded to or evacuated from the sample while it is loaded at VISION. The optical components for directing and filtering light are located within the cryogenic volume, in physical proximity to the sample. We describe the construction of this sample holder and discuss our first measurements of simultaneous Raman and neutron vibrational spectra. Here, the samples that we report on were of 4-nitrophenol at a temperature of 20 K and of cryogenic hydrogen of a number of different orthohydrogen fractions.

4-nitrophenol↗