Dueling Classifiers for Task Assessment

Sometimes many different aspects of an activty need to be analyzed: what task is being performed? How well is this task being performed? What pose is the person in for this task? Multitask learning is the process of learning multiple tasks at once from the same data, but often the classifier interactions are primitive (i.e. sharing the same base network). I have multiple classifiers inform one-another of the task at hand- allowing them to “argue” or inform one another about their task at multiple levels of resolution

Dynamic Deep Learning

Modern deep learning is handicapped by the immense amount of time needed to find the optimal network structure to solve a given problem. This project, featured at CVPR 2018, not only automatically selects the optimal architecture, but can also be used to shrink the network to a fraction of its original size with little loss in performance. This work has also yielded a patent for the network optimization process (currently pending).

Deep Learning for Black Box Detection

Sonar imagery utilizes sonic reverberations to detect objects. In low-visibility undersea environments, this is very helpful for finding the black boxes of crashed airplanes. This project, presented at Acoustic Society America 2017, showed the use of deep learning for this task. This work also yielded a patent (pending) and won MIT Lincoln Laboratory’s Tech Office Challenge 2016.

Canned Mentorshipcm_interface

The subject of my Master’s thesis, Canned Mentorship combines human and AI agents in order to create how-to manuals using crowdsourcing and machine learning techniques. Previously this was an unsolved problem in the field. By leveraging advances in human computational hierarchy, Canned Mentorship was able to solve the problem by creating a low-complexity solution backed by a machine-learning supervisor.

Imagistic Modeling System


Recent psychological evidence suggests that humans run a simulation of 3D objects in their minds as part of the reasoning process. Can we create a program to do the same? The IMS project seeks to answer that question. In cooperation with Eric Bigelow, Alex Wilson, and Dr. Lenhart Schubert, we have developed a 3D reasoning specialist for EPILOG that does just this. This project is written in python and uses Blender for 3D modeling. Publication on the project has been accepted for both a journal entry and an oral presentation in Biologically Inspired Cognitive Architectures (BICA) 2014.