Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Continual learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Integrated path planning and control through proximal policy optimization for a marine current turbine

This paper presents an integrated path planning and tracking control framework for a marine current turbine (MCT), where the MCT is treated as an energy-harvesting autonomous underwater vehicle (AUV). Considering the ocean (space of action) is continuous, the proposed framework employs two modules to address path planning and path tracking enabled by the proximal policy optimization (PPO) algorithm, which is a policy gradient deep reinforcement learning (RL) method. Further, to enable fully autonomous operation in a stochastic oceanic environment, the proposed path planning seeks a primary objective of maximizing the harvested energy; then, the path tracking module is designed to minimize the tracking error and avoid collisions with static and dynamic obstacles. Using field-collected acoustic Doppler current profiler (ADCP) data, the performance of the proposed framework is evaluated. Comparative studies with baseline algorithms in three different scenarios of path planning, path tracking without an obstacle, and path tracking with collision avoidance verify the effectiveness of our proposed approach.

16 TIDAL AND WAVE POWER↗

Accelerated Education Program in Radiation Medicine: International Learner Perceptions of Experiences, Outcomes, and Impact

The Accelerated Education Program (AEP) at the Princess Margaret Cancer Centre (PM) has been offering continuing medical education courses since 2006. The purpose of this study was to assess learner experiences, perspectives, and outcomes using Kirkpatrick’s Four Level Training Evaluation Model (ie, reaction, learning, behavior, results) to ascertain whether it was meeting stated goals.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A Summary of Advances in Document Summarization from 2023-2024

In computer science, Document Summarization is the task of condensing some quantity of text and related content through automated means. In this document, we review recent literature in text summarization. “Hybrid” extractive-abstractive approaches continue to be explored. Some of the latest efforts have also sought to enable users to adjust summaries with queries or other structure and begun to test reinforcement-learning style agentic LLM-based solutions.

97 MATHEMATICS AND COMPUTING↗

OLCF’s Advanced Computing Ecosystem (ACE): FY25 Update for Ongoing Efforts

The advent of widespread use of artificial intelligence (AI) and machine learning (ML) models in science, coupled with fast data production rates of scientific instruments strain the traditional batch-oriented high-performance computing (HPC) environment. As scientific exploration continues to require more data and faster processing and analysis, new emerging technologies and capabilities to enable cross-facility and time-sensitive workflows are required for seamless integration of HPC and experimental facilities. The Advanced Computing Ecosystem (ACE) is a strategic initiative within the Oak Ridge Leadership Computing Facility (OLCF) established in 2024 to support the development of cutting-edge technologies to advance computational research and infrastructure at OLCF and across the Department of Energy (DOE). Several DOE initiatives are spearheading the evolution of the scientific landscape by blurring facility boundaries and connecting the user facilities to advance scientific capabilities and ensure energy dominance. The DOE Integrated Research Infrastructure (IRI) program is one example that is laying a foundation to support complex cross-facility workflows. The IRI program aims to integrate diverse computational resources, data infrastructures, and scientific instruments to facilitate collaboration and accelerate scientific discovery. The Interconnected Science Ecosystem (INTERSECT) initiative at Oak Ridge National Laboratory (ORNL) is another example that aims to revolutionize scientific research through AI-driven, interconnected autonomous laboratories and research facilities. Finally, the American Science Cloud (AmSC), recently announced in the “One Big Beautiful Bill”, aims to leverage prior infrastructure efforts of the IRI and automation and AI efforts of INTERSECT (and others) to build a federated, AI-augmented AmSC platform to unify the DOE’s computing, experimental, and data resources to catalyze scientific innovation.

97 MATHEMATICS AND COMPUTING↗

Machine learning deciphers CO 2 sequestration and subsurface flowpaths from stream chemistry

Endmember mixing analysis (EMMA) is often used by hydrogeochemists to interpret the sources of stream solutes, but variations in stream concentrations and discharges remain difficult to explain. We discovered that machine learning can be used to highlight patterns in stream chemistry that reveal information about sources of solutes and subsurface groundwater flowpaths. The investigation has implications, in turn, for the balance of CO 2 in the atmosphere. For example, CO 2 -driven weathering of silicate minerals removes carbon from the atmosphere over ~106-year timescales. Weathering of another common mineral, pyrite, releases sulfuric acid that in turn causes dissolution of carbonates. In that process, however, CO 2 is released instead of sequestered from the atmosphere. Thus, understanding long-term global CO 2 sequestration by weathering requires quantification of CO 2 - versus H 2 SO 4 -driven reactions. Most researchers estimate such weathering fluxes from stream chemistry, but interpreting the reactant minerals and acids dissolved in streams has been fraught with difficulty. We apply a machine-learning technique to EMMA in three watersheds to determine the extent of mineral dissolution by each acid, without pre-defining the endmembers. The results show that the watersheds continuously or intermittently sequester CO 2 , but the extent of CO 2 drawdown is diminished in areas heavily affected by acid rain. Prior to applying the new algorithm, CO 2 drawdown was overestimated. The new technique, which elucidates the importance of different subsurface flowpaths and long-timescale changes in the watersheds, should have utility as a new EMMA for investigating water resources worldwide.

54 ENVIRONMENTAL SCIENCES↗

Space Shuttle Orbiter logistics - Managing in a dynamic environment

The importance and methods of monitoring logistics vital signs, logistics data sources and acquisition, and converting data into useful management information are presented. With the launch and landing site for the Shuttle Orbiter project at the Kennedy Space Center now totally responsible for its own supportability posture, it is imperative that logistics resource requirements and management be continually monitored and reassessed. Detailed graphs and data concerning various aspects of logistics activities including objectives, inventory operating levels, customer environment, and data sources are provided. Finally, some lessons learned from the Shuttle Orbiter project and logistics options which should be considered by other space programs are discussed.

Renfroe, Michael B.↗

Investigating the Simulink Auto-Coding Process

Model based program design is the most clear and direct way to develop algorithms and programs for interfacing with hardware. While coding "by hand" results in a more tailored product, the ever-growing size and complexity of modern-day applications can cause the project work load to quickly become unreasonable for one programmer. This has generally been addressed by splitting the product into separate modules to allow multiple developers to work in parallel on the same project, however this introduces new potentials for errors in the process. The fluidity, reliability and robustness of the code relies on the abilities of the programmers to communicate their methods to one another; furthermore, multiple programmers invites multiple potentially differing coding styles into the same product, which can cause a loss of readability or even module incompatibility. Fortunately, Mathworks has implemented an auto-coding feature that allows programmers to design their algorithms through the use of models and diagrams in the graphical programming environment Simulink, allowing the designer to visually determine what the hardware is to do. From here, the auto-coding feature handles converting the project into another programming language. This type of approach allows the designer to clearly see how the software will be directing the hardware without the need to try and interpret large amounts of code. In addition, it speeds up the programming process, minimizing the amount of man-hours spent on a single project, thus reducing the chance of human error as well as project turnover time. One such project that has benefited from the auto-coding procedure is Ramses, a portion of the GNC flight software on-board Orion that has been implemented primarily in Simulink. Currently, however, auto-coding Ramses into C++ requires 5 hours of code generation time. This causes issues if the tool ever needs to be debugged, as this code generation will need to occur with each edit to any part of the program; additionally, this is lost time that could be spent testing and analyzing the code. This is one of the more prominent issues with the auto-coding process, and while much information is available with regard to optimizing Simulink designs to produce efficient and reliable C++ code, not much research has been made public on how to reduce the code generation time. It is of interest to develop some insight as to what causes code generation times to be so significant, and determine if there are architecture guidelines or a desirable auto-coding configuration set to assist in streamlining this step of the design process for particular applications. To address the issue at hand, the Simulink coder was studied at a foundational level. For each different component type made available by the software, the features, auto-code generation time, and the format of the generated code were analyzed and documented. Tools were developed and documented to expedite these studies, particularly in the area of automating sequential builds to ensure accurate data was obtained. Next, the Ramses model was examined in an attempt to determine the composition and the types of technologies used in the model. This enabled the development of a model that uses similar technologies, but takes a fraction of the time to auto-code to reduce the turnaround time for experimentation. Lastly, the model was used to run a wide array of experiments and collect data to obtain knowledge about where to search for bottlenecks in the Ramses model. The resulting contributions of the overall effort consist of an experimental model for further investigation into the subject, as well as several automation tools to assist in analyzing the model, and a reference document offering insight to the auto-coding process, including documentation of the tools used in the model analysis, data illustrating some potential problem areas in the auto-coding process, and recommendations on areas or practices in the current Ramses model that should be further investigated. Several skills were required to be built up over the course of the internship project. First and foremost, my Simulink skills have improved drastically, as much of my experience had been modeling electronic circuits as opposed to software models. Furthermore, I am now comfortable working with the Simulink Auto-coder, a tool I had never used until this summer; this tool also tested my critical thinking and C++ knowledge as I had to interpret the C++ code it was generating and attempt to understand how the Simulink model affected the generated code. I had come into the internship with a solid understanding of Matlab code, but had done very little in using it to automate tasks, particularly Simulink tasks; along the same lines, I had rarely used shell script to automate and interface with programs, which I gained a fair amount of experience with this summer, including how to use regular expression. Lastly, soft-skills are an area everyone can continuously improve on; having never worked with NASA engineers, which to me seem to be a completely different breed than what I am used to (commercial electronic engineers), I learned to utilize the wealth of knowledge present at JSC. I wish I had come into the internship knowing exactly how helpful everyone in my branch would be, as I would have picked up on this sooner. I hope that having gained such a strong foundation in Simulink over this summer will open the opportunity to return to work on this project, or potentially other opportunities within the division. The idea of leaving a project I devoted ten weeks to is a hard one to cope with, so having the chance to pick up where I left off sounds appealing; alternatively, I am interested to see if there are any opening in the future that would allow me to work on a project that is more in-line with my research in estimation algorithms. Regardless, this summer has been a milestone in my professional career, and I hope this has started a long-term relationship between JSC and myself. I really enjoy the thought of building on my experience here over future summers while I work to complete my PhD at Missouri University of Science and Technology.

Gualdoni, Matthew J.↗

Feasibility Study to Interactive Workshop: Building End-user Capacity to Integrate Earth Observation Data into Federally Endangered Atlantic Salmon (Salmo salar) Habitat Monitoring in Main

Changes in temperature and precipitation patterns, along with alterations in land cover threaten ongoing conservation efforts for Federally Endangered Atlantic salmon (Salmo salar) in Maine. Earth observation data offers a unique perspective for habitat monitoring that can complement habitat restoration and conservation activity on the ground. As a dual capacity building program, the NASA DEVELOP National Program strives to build the capacity of program participants by leveraging Earth observation data to address environmental concerns across the globe, while also building capacity in partner organizations to integrate Earth observation data into their decision making practices. Between September 2021 and August 2022, three NASA DEVELOP teams demonstrated the feasibility of utilizing NASA Earth observations including Aqua Moderate Resolution Imaging Spectroradiometer (MODIS), Terra MODIS, Landsat 5 Thematic Mapper (TM), Landsat 8 Operation Land Imager (OLI), and Shuttle Radar Topography Mission (SRTM) in conjunction with Sentinel-2 MultiSpectral Instrument (MSI) to assess temperature, precipitation, and land use land cover (LULC) over time throughout salmon habitat in Maine. While the first two teams completed projects that were categorized as NASA DEVELOP’s traditional feasibility projects, the third and final project team generated resources and planned an interactive workshop to transfer project methods to end-user organizations. Ultimately, the goal of this work was to not only inform the partner’s ongoing salmon population recovery and habitat restoration initiatives but provide tools that allow partner organizations to continue integrating Earth observation data into their work beyond their partnership with the program. This project serves as a case study within the NASA DEVELOP Program and provides lessons learned for moving beyond traditional feasibility studies to more interactive partner engagement and knowledge transfer practices.

Nicole Ramberg-Pihl↗

Maintenance Modernization in the Era of Artemis An RCM Journey

The NASA Artemis Program mission to return humans to the moon requires it ground test facilities to meet today’s performance and throughput demands. The NASA Ames Arc Jet Complex (AJC) at Ames Research Center is the Agency’s sole ground test facility supporting reentry thermal protection system testing and was developed to support Apollo era spacecraft. The research and development required to meet current and future mission demands continually grows, but the maintenance upkeep to ensure safe and reliable operations holds stagnant. This paper presents the journey and subsequent industry relatable story that includes the challenges, lessons learned, and testimonials to the AJC’s approach to the modernization of maintenance using RCM at NASA.

Reliability Centered Maintenance↗

The International Space Station (ISS) Solar Alpha Rotary Joint (SARJ): Materials & Processes (M&P) Lessons Learned for a Large, Spacecraft Rotating Mechanism

The ISS utilizes two large rotating mechanisms, the SARJ, as part of the solar arrays alignment system for more efficient power generation. The SARJ is a 10.3m circumference, nitrided 15-5PH steel race ring of triangular cross-section, with 12 sets of trundle bearing assemblies transferring load across the rolling joint. The SARJ mechanism rotates continuously and slowly - once every orbit, or every 90 minutes. In 2008, the starboard SARJ suffered a lubrication failure, resulting in severe damage (spalling) of one of the race ring surfaces. Extensive effort was conducted to prevent the port SARJ from suffering the same failure, and fortunately was ultimately successful in recovering the functionality of the starboard SARJ. The M&P function was key in determining the cause of failure and the means for mechanism recovery. From a M&P lessons-learned perspective, observations are made concerning the original SARJ design parameters (boundary conditions), the perceived need for nitriding the race ring, the test conditions employed during qualification, the environmental controls used for the hardware preflight, and the lubrication robustness necessary for complex kinematic mechanisms expecting high-reliability and long-life.

Golden, Johnny L.↗

22 N HPGP Thruster Life Testing

In the ever-changing paradigm of efficient and capable spacecraft design, scientific missions continue pushing the envelope enabling spacecraft subsystems to deliver effective solutions to meet challenging new mission/spacecraft needs. From an in-space storable liquid chemical propulsion perspective, monopropellant hydrazine has been, and continues to be, a dependable propellant with considerable flight heritage, a variety of engine thrust classes available from multiple vendors, with repeatable and reliable performance. Additionally, the space propulsion industry has learned to successfully handle hydrazine, its regulations, the safety protocols, the personnel protective equipment, and the unique training standards–all requisite for loading spacecraft propulsion systems with toxic hypergolic hydrazine. The question now arises as to “what is next for in-space chemical propulsion?” Further, with the evolution and concrete advancements in innovative in-space green propellant technologies, capable of providing realizable benefits to scientific missions, concern over the reliability and availability of this higher performing and safer to handle class of propellants is waning. As science missions move forward with the potential flight in fusion of High Performance Green Propulsion (HPGP), NASA and its industry partners are working to address any gaps in system reliability, performance, or unique operational considerations. Propellant technology that offers both higher performance and significant reduction in personnel hazards compared to hydrazine presents an attractive propulsion subsystem design opportunity. Increased propulsion subsystem performance can result in lower spacecraft launch mass, larger scientific payloads, or extended on-orbit lifetimes. Mission trades using green propulsion technologies have been documented on multiple NASA Goddard Space Flight Center (GSFC) mission classes, examining various parameters and requirements to support mission architectures in Low Earth Orbit (LEO), High Earth Orbit (HEO), geostationary, lunar, planetary, and Quasi-halo orbit around Sun-Earth Lagrange point (L2). The results of these trade studies show promising, attainable benefits. The perceived programmatic risk of flying a newer propulsion technology has, unfortunately, not outweighed the benefits to date. To take advantage of the improved performance and mitigate programmatic risk, HPGP engines must demonstrate life testing at higher propellant throughputs than have currently been demonstrated. In an effort to proactively address the challenges with technology infusion into a risk-averse community, NASA and the Swedish National Space Agency (SNSA) outlined a collaborative Implementing Arrangement (IA) for the respective agencies to pursue increased HPGP technology maturation. This initial IA effort began in 2013, fresh off the heels of the successful PRISMA HPGP technology demonstration mission. The IA targeted objective is to reduce risk to potential future HPGP missions and fully characterize the LMP-103S propellant and associated engine performance. Over the past eight years, HPGP has flown in propulsion systems on twenty-five(25) spacecraft from seven(7) different Launch Ranges around the globe and on seven (7) different Launch Vehicles. Six(6) of these launches involved multiple loading operations for multiple spacecraft. For U.S. Range operations, nine (9) HPGP systems have been processed at Vandenberg Space Force Base(VSFB):six(6) in 2017, and three (3) in 2018. Six (6) more have been processed at Cape Canaveral Air Force Station (CCAFS)in May 2020, with three (3) systems launched in June 2020 and the remaining three (3) system were left loaded and ready until their launch in August of 2020. Three (3) more systems have been processed at Wallops Flight Facility(WFF)and launched in June 2021. In addition, these propulsion subsystems employed heritage propulsion subsystem component such as valves, filters, and pressure transducers, and have further demonstrated nominal functionality in both diaphragm and Propellant Management Device (PDM) propellant tanks. Based on these successes, HPGP technology continues to be considered for NASA Science Mission Directorate missions at GSFC. The work presented herein represents many years of development and collaborative efforts to successfully align higher performance, low toxicity hydrazine alternatives into scientific missions. NASA GSFC Propulsion Engineering, in collaboration with Bradford ECAPS, has developed mission specific thruster design and testing requirements to establish GSFC’s desired test conditions and firing sequences.In2017, the first flight-like 22N HPGP thruster Engineering Qualification Model (EQM-1)was designed and built by Bradford ECAPS to prove out the thruster design, materials, build process, and test campaign with respect to NASA GSFC critical component and mission requirements. This test program was developed to comprehensively test the thruster, the technology, and ultimately increase the 22N HPGP Technology Readiness Level(TRL). EQM-1was tested to environmental qualification levels prior to hot fire performance testing to represent the relevant end-to-end environment (launch to on-orbit operation)with required margin. This thruster demonstrated steady-state and pulse mode operational capability with propellant thruster throughput up to~53kg.At this throughput level, the EQM-1 engine began to present off-nominal performance and the test campaign was halted to allow for non-destructive testing and identify the root cause for the an omalous performance. Capitalizing on the successful elements of the EQM-1 campaign, an upgraded 22N HPGP EQM-2 has been manufactured by Bradford ECAPS to meet the complete GSFC requirements. The EQM-2 thruster’s test campaign has further demonstrated the robustness of the HPGP propulsion technology and increased the Technology Readiness Level (TRL) by undergoing a full acceptance test program, then proceeding into qualification, including environmental testing (vibration and shock to qualification levels),as well as hot-fire life testing, operating at steady-state and pulse modes with increased propellant thruster throughput to~150kg. The HPGP thruster performance testing enables effective HPGP thruster readiness evaluation to meet NASA candidate mission requirements in the future.

High↗

TRANSFORMING THE SRS ENVIRONMENTAL BUSINESS: COMMUNICATION AND APPLIED PROJECT MANAGEMENT PRINCIPLES

A process for communicating information relating to core business functions that also encourages improving internal communications has been established at SRS. This process continues to grow and strengthen as the multiple Contractors, Regulators and DOE-SR relationships mature. A number of management communication tools have been initiated, retooled, rebooted or continued with enhancements to ensure appropriate information is communicated to all levels with environmental responsibility at SRS. The types of information that are the focus of this improved process are feedback from the customer and from informational exchange forums (i.e., Challenge Opportunity and Resolution (COR), SRS Regulatory Integration Team (SRIT), Environmental Quality Management Division (EQMD), Senior Environmental Managers Council (SEMC), etc.). These forums, SRS environmental functions centralization, and the creation of a Regulatory Integration process allows for cross-functional decision making, problem solving and information sharing that involves the field organizations, Environmental Compliance Authorities (ECA), Subject Matter Experts (SME), DOE and the Regulators. Numerous examples of effective decision-making and problem solving will be shared. Lessons Learned involving inadequate communications and the resulting impacts on the environment, customer satisfaction, and relationships will also be discussed. Additionally, the focus on improved communications also includes maintaining awareness of business activities. The tools being utilized to facilitate the continuing improvement of internal communications include weekly staff meetings for all individuals within the organization, quarterly ECA and SME meeting, quarterly Regulatory Integration & Environmental Services (RI&ES) All-Hands meetings hosted by the Director, bi-weekly EQMD and EQMD Lite meetings with the customer, bi-annual SRIT meetings, and COR meetings on an as need basis. In addition, an existing Required Reading Program is being formally utilized in RI&ES to ensure all individuals get formal notification of new/revised business documents. In all cases, the development of environmental communication topics that occur at SRS have a cost-scope-schedule basis that can be linked to delivery of environmental services.

99 GENERAL AND MISCELLANEOUS↗

Pilot-Scale CFP Commissioning: Creative Problem Solving and Lessons Learned

We have commissioned a pilot-scale, ex-situ catalytic fast pyrolysis (CFP) reactor system in the Thermal and Catalytic Process Development Unit (TCPDU) at the National Renewable Energy Laboratory. The FCC-style CFP system, including a riser and continuous regeneration, was added to the existing half-ton-per-day biomass fast pyrolysis unit and was designed to run a zeolite-type catalyst. The system is unique due to its scale and catalyst flow control scheme. As the design of this system was informed by early data from a bench-scale reactor, several technical scale-up challenges had to be overcome. Additionally, physical constraints and the complexities of biomass vapors required and inspired creative solutions. This talk will discuss the specific challenges we found and addressed, including an oxygen deficiency in the regenerator and plugging in the exit streams. We explored several options for increasing oxygen availability and selected a cyclone-catalyst return design on the exit line so we could increase air flow through the regenerator. We found that hot gas filtration is essential in any exit streams containing water vapor and trace amounts of catalyst; any combination of catalyst and condensate quickly makes mud that plugs equipment and severely limits run time. Duplicate filters are also required to extend run time. Most of the equipment and solutions were designed and installed by our team of engineers and technicians, working closely together in an iterative process to design, install, operate, then redesign. Collaborations with other national laboratories with computational fluid dynamics expertise helped inform designs and identify creative solutions to these scale-up challenges. Ultimately, data from the reactor system will be used to validate a comprehensive kinetic model of CFP that can be used to better design and inform new systems at various scales.

09 BIOMASS FUELS↗

Stirling Convertor Controller Development at NASA Glenn Research Center

Over the past decade, NASA Glenn Research Center (GRC) has been supporting the development of Radioisotope Power Systems (RPS). NASA desires higher conversion efficiency RPS options that are reliable and robust with long life design. Dynamic conversion, such as Stirling and Brayton, offer the potential for higher conversion efficiencies but have yet to be demonstrated in a flight application. The RPS program sent out a solicitation to investigate options for dynamic conversion technologies. As a result of this solicitation, four dynamic power convertor (DPC) technologies were selected for design and fabrication of a prototype dynamic convertor. One lesson learned from the Advanced Stirling Radioisotope Generator (ASRG) project is that controller development should start early in the development of a dynamic convertor. As a result of this, NASA GRC has been utilizing hardware from past Stirling convertor projects including that of the ASRG to support controller development for the DPC's. NASA GRC has developed a strong knowledge base on both analog and digital Stirling dynamic power convertor controllers and will continue to expand and apply that knowledge to the four DPC's. Over the past 15 years, controllers were developed in-house at GRC, at Lockheed Martin Coherent Technologies (LMCT) and by the Johns Hopkins University/Applied Physics Laboratory (JHU/APL). Various generations of the controllers, have been developed as lessons were learned through various component and system level tests. Some of the tests performed were fault tolerance, qualification vibration level, electromagnetic interference, Radioisotope Power System Systems Integration (RSIL) tests, and extended operation. The fault tolerance test characterized the controller's ability to handle various fault conditions, including high or low bus power consumptions, total open load or short circuit, and replacing a failed controller card while the backup maintains control of the ASC. The vibration test confirms the controller's ability to control an ASC during launch. The EMI test characterized the AC and DC magnetic and electric fields emitted by the single ASC and if the controller has an impact on the radiated EMI. RSIL testing provided insight into the electrical interactions between the representative RPS, its associated control schemes, and realistic electric system loads. The extended operation test allows data to be collected over a period of thousands of hours to obtain long term performance data of the system. This paper describes the history of controller development at NASA GRC, tests performed on these controllers, and lessons learned.

Dugala, Gina M.↗

Optimizing Individualized Treatment Planning for Parkinson’s Disease Using Deep Reinforcement Learning

More than one million people currently live with Parkinson's Disease (PD) in the U.S. alone. Medications, such as levodopa, can help manage PD symptoms. However, medication treatment planning is generally based on patient history and limited interaction between physicians and patients during office visits. This limits the extent of benefit that may be derived from the treatment as disease/patient characteristics are generally non-stationary. Wearable sensors that provide continuous monitoring of various symptoms, such as bradykinesia and dyskinesia, can enhance symptom management. However, using such data to overhaul the current static medication treatment planning approach and prescribe personalized medication timing and dosage that accounts for patient/care-giver/physician feedback/preferences remains an open question. We develop a model to prescribe timing and dosage of medications, given the motor fluctuation data collected using wearable sensors in real-time. We solve the resulting model using deep reinforcement learning (DRL). The prescribed policy determines the optimal treatment plan that minimizes patient's symptoms. Our results show that the model-prescribed policy outperforms the static a priori treatment plan in improving patients' symptoms, providing a proof-of-concept that DRL can augment medical decision making for treatment planning of chronic disease patients.

Watts, Jeremy↗

Quantifying Uncertainty of Deep Reinforcement Learning Based Decision Making for Operations and Maintenance of Nuclear Power Plant

This paper summarizes research that integrates condition monitoring and prognostics with decision making for nuclear power plant operations and maintenance. As part of this research, we have developed an online asset management tool to help reduce life-cycle maintenance and repair costs. Using the latest advancements in condition monitoring, supply chain analytics, and deep reinforcement learning, we have created a predictive maintenance tool that can optimize the maintenance and spare-part management of a repairable nuclear system. To demonstrate these methods, preliminary studies were conducted on a simple, representative maintenance system undergoing a stochastic degradation process that requires repairs or replacement to continue operation. Through Monte Carlo simulations, we were able to reduce maintenance spending by approximately 50% compared to optimized, time-based maintenance strategies. Not only does the decision maker reduce the average life-cycle costs, it also minimizes the chance of high cost scenarios, lowering the variance of the expected cost distributions, and reducing overall financial risk. Furthermore, this work also studies the ability of the decision maker to handle various levels of noise from observation uncertainty. By introducing uncertainty into the decision-making process, we have quantified the robustness and resiliency of the decision maker, as well as identified necessary levels of observability to demonstrate cost effectiveness.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Cost-Benefit Analysis of Automated Physiological Data Acquisition Systems Using Data-Driven Modeling

Precision medicine and the continuous analysis of “Big data” promises to improve patient outcomes dramatically in the near future. Very recently, healthcare facilities have started to explore automatic collection of patient-specific physiological data with the aim of reducing nursing workload and decreasing manual data entry errors. In addition to those purposes, continuous physiological data can be used for the early detection and prevention of common, and possibly fatal, diseases. For instance, poor patient outcomes from sepsis, a leading cause of mortality in healthcare facilities and a major driver of hospital costs in the USA, can be mitigated when detected early using screening tools that monitor the changing dynamics of physiological data. However, the potential cost of collecting continuous physiological data remains a barrier to the widespread adoption of automated high-frequency data collection systems. In this paper, we perform cost-benefit analysis (CBA) of machine learning applied to various types of acquisition systems (with different collection intervals) to determine if the benefits of such systems will outweigh their implementation costs. Although such systems can be used in the detection of various complications, in order to showcase the immediate benefits, we focus on the early detection of sepsis, one of the major challenges of hospital systems. We present a general approach to conduct such analysis for a wide range of hospitals and highlight its applicability using a case study for a small hospital with 150 beds and 3000 annual patients where the acquisition system would collect data at 1-min intervals. Finally, we discuss how the analysis may help guide incentives/policies with regard to adopting automated data acquisition systems.

99 GENERAL AND MISCELLANEOUS↗

What Students Think About (Nuclear) Radiation – Before and After Fukushima

Preparing successful science lessons is very demanding. One important aspect a teacher has to consider is the students' previous knowledge about the specific topic. This is why research about students' preconceptions has been, and continues to be, a major field in science education research. Following a constructivistic approach [R. Duit et al., International handbook of research on conceptual change, p. 629 (2008)], helping students learn is only possible if teachers know about students' ideas beforehand. Studies about students' conceptions regarding the major topics in physics education (e.g. mechanics, electrodynamics, optics, thermodynamics), are numerous and well-documented. The topic radiation, however, has seen very little empirical research about students' ideas and misconceptions. Some research was conducted after the events of Chernobyl [P. Lijnse et al., International Journal of Science Education 12, 67 (1990); B. Verplanken, Environment and Behavior 21, 7 (1989)] and provided interesting insight into some of the students' preconceptions about radiation. In order to contribute empirical findings to this field of research, our workgroup has been investigating the conceptions students have about the topic radiation for several years [S. Neumann et al., Journal of Science Education and Technology 21, 826 (2012)]. We used children's drawings and conducted short follow-up interviews with students (9 – 12 years old) and more detailed interviews with 15-year-old students. Both studies were originally done before the events in Fukushima and replicated a year later. We not only asked students about their general associations and emotions regarding the term radiation, but also examined the students' risk perceptions of different types of radiation. Through the use of open-ended questions we were able to examine students' conceptions about different types of radiation (including nuclear) that could be a hindrance to student learning. Our results show that students' associations with the term radiation are almost exclusively related to nuclear radiation. Their emotions concerning the word radiation are predominately negative, and the idea that radiation is something to be avoided is widespread among students. Since most students were not familiar with the idea of naturally occurring nuclear radiation, it does not seem surprising that a lot of them generally described radiation as something artificial and man-made. Also, none of the students interviewed mentioned applications of nuclear radiation in medicine or technology (besides its use in nuclear power plants). All of these results have shown to be even more prevalent in the interview session that was conducted after the tragic events in Fukushima in 2011. In this article, we will also include suggestions for improving the teaching of the topic radiation in school.

54 ENVIRONMENTAL SCIENCES↗