We propose a method to train an autonomous agent to learn to accumulate a 3D scene graph representation of its environment by simultaneously learning to navigate through said environment.
Publications
SASRA: Semantically-aware Spatio-temporal Reasoning Agent for Vision-and-Language Navigation in Continuous Environments
This paper presents a novel approach for the Vision-and-Language Navigation (VLN) task in continuous 3D environments.
Broadening AI Ethics Narratives: An Indic Arts View
In this paper, we investigate uncovering the unique socio-cultural perspectives embedded in human-made art, which in turn, can be valuable in expanding the horizon of AI ethics.
Pathway Tools Management of Pathway/Genome Data for Microbial Communities
The Pathway Tools software provides a suite of capabilities for storing and analyzing collections of genomic and metabolic information .
Real-Time Hyper-Dimensional Reconfiguration at the Edge using Hardware Accelerators
In this paper we present Hyper-Dimensional Reconfigurable Analytics at the Tactical Edge using low-SWaP embedded hardware that can perform real-time reconfiguration at the edge leveraging non-MAC deep neural nets (DNN) combined with hyperdimensional (HD) computing accelerators.
Sparking Connections: Evaluations of Mobile Messaging on Responsive Caregiving
Mobile messaging programs are a low-cost, scalable approach to building parents’ knowledge and capacity to support their children’s development. These programs directly deliver simple and straightforward information, tips, and activities that parents can incorporate into daily routines.
Head-Worn Markerless Augmented Reality Inside a Moving Vehicle
This paper describes a system that provides general head-worn outdoor AR capability for the user inside a moving vehicle.
An Ontology-Based Dialogue Management Framework for Virtual Personal Assistants in Common Lisp
We present a new approach to dialogue specification for Virtual Personal Assistants (VPAs) based on so-called dialogue workflow graphs. Our approach relies on Semantic Web technology (OWL), implemented in Common Lisp with the help of the Racer reasoner.
Encouraging impacts of an Open Education Resource Degree Initiative on college students’ progress to degree
SRI Authors: Rebecca J. Griffiths, Jessica L. Mislevy Abstract Textbooks are traditional and useful learning resources for college students, but commercial texts books have been widely criticized for their high costs, restricted access, limited flexibility, and uninspiring learning experiences. Open Education Resources (OER) are an alternative to commercial textbooks that have the potential to increase […]
SIGNAV: Semantically-Informed GPS-Denied Navigation and Mapping in Visually-Degraded Environments
We present SIGNAV, a real-time semantic SLAM system to operate in perceptually-challenging situations.
Study of the Engage New England Initiative Cross-Site Learning Brief 4: Early Insights from Academic Case Conferencing
The Barr Foundation launched the Engage New England Initiative in 2017 to support the development of innovative schools to serve students who are off track to graduate from high school.
Findings from a two-year effectiveness trial of the Science Notebook in a Universal Design for Learning Environment
This cluster randomized control trial examines the effects of the Science Notebook in a Universal Design for Learning Environment (SNUDLE) on elementary school student science academic achievement and motivation outcomes.
A Summary of PDG B-5 Grantee’s Coordinated Eligibility and Enrollment Activities and the Impact of COVID-19
In this report, we summarize the initial 23 Preschool Development Grant Birth through Five (PDG B-5) renewal states’ planned CEE activities as they were written into their grant applications in late 2019.
Elementary Teacher Adaptations to Engineering Curricula to Leverage Student and Community Resources
This paper addresses an important consideration for promoting equitable engineering instruction: understanding how teachers contextualize curricular materials to draw upon student and community resources.
Metabolic Modeling with MetaFlux
The MetaFlux software supports creating, executing, and solving quantitative metabolic flux models using flux balance analysis (FBA).
