Evolution of active categorical image classification via saccadic eye movement

I put together a couple demo videos for our Active Categorical Classifier (ACC) project that we’ll be presenting at the PPSN 2016 conference.

If you’re interested in this project and can’t wait for PPSN, we have:

In the first video, I show the entire image as the ACC roams around it trying to classify the object. Even though we can see the entire image at once, the ACC only sees the 9 pixels in its immediate vicinity.

In the second video below, I only show the pixels that the ACC has seen during the simulation. Can you guess what digit it is before the ACC?

I think the second video does a great job of showing how little information the ACC is processing to classify each image. Talk about a light-weight classifier!

Dr. Randy Olson is a Senior Data Scientist at the University of Pennsylvania, where he develops state-of-the-art machine learning algorithms with a focus on biomedical applications.

Posted in machine learning, research Tagged with: , ,

About this blog

This blog is my labor of love, and I've spent hundreds of hours working on the projects that you'll read about here. Generally, I write about data visualization and machine learning, and sometimes explore out-of-the-box projects at the intersection of the two. I hope you enjoy my projects as much as I have.

If you would like to use one of my graphs on your website or in a publication, please feel free to do so with appropriate attribution, but I would appreciate it if you email me first to let me know.

Archives

Subscribe

Enter your email address to subscribe to this blog and receive notifications of new posts by email.