In this presentation, we describe and demonstrate a novel vision-enhanced low-light imager system to provide GPS-denied navigation and ML-based visual scene understanding capabilities for both day and night operations.
Machine learning publications
Cross-View Visual Geo-Localization for Outdoor Augmented Reality
We address the problem of geo-pose estimation by cross-view matching of query ground images to a geo-referenced aerial satellite image database. Recently, neural network-based methods have shown state-of-the-art performance in cross-view matching.
Sensor Control for Information Gain in Dynamic, Sparse and Partially Observed Environments
We present an approach for autonomous sensor control for information gathering under partially observable, dynamic and sparsely sampled environments.
Unpacking Large Language Models with Conceptual Consistency
We propose conceptual consistency to measure a LLM’s understanding of relevant concepts. This novel metric measures how well a model can be characterized by finding out how consistent its responses to queries about conceptually relevant background knowledge are.
Incremental Learning with Differentiable Architecture and Forgetting Search
In this paper, we show that leveraging NAS for incremental learning results in strong performance gains for classification tasks.
Dual-Key Multimodal Backdoors for Visual Question Answering
In this work, we show that multimodal networks are vulnerable to a novel type of attack that we refer to as Dual-Key Multimodal Backdoors.
Saccade Mechanisms for Image Classification, Object Detection and Tracking
We examine how the saccade mechanism from biological vision can be used to make deep neural networks more efficient for classification and object detection problems. Our proposed approach is based on the ideas of attention-driven visual processing and saccades, miniature eye movements influenced by attention.
Conformal Prediction Intervals for Markov Decision Process Trajectories
This paper extends previous work on conformal prediction for functional data and conformalized quantile regression to provide conformal prediction intervals over the future behavior of an autonomous system executing a fixed control policy on a Markov Decision Process.
Conformal Prediction Intervals for Markov Decision Process Trajectories
This paper extends previous work on conformal prediction for functional data and conformalized quantile regression…