\( \newcommand{\matr}[1] {\mathbf{#1}} \newcommand{\vertbar} {\rule[-1ex]{0.5pt}{2.5ex}} \newcommand{\horzbar} {\rule[.5ex]{2.5ex}{0.5pt}} \)
deepdream of
          a sidewalk


I'm interested in how people experience color. These pages are a work in progress. As I write this, I'm hoping to try and begin to form an answer to the following 2 questions:

  • In the space that the human brain builds to represent the surrounding world, the color that the brain assigns to a surface of an object in this space is dependent on many things in addition to the light coming from the corresponding surface in the real world. This is a known fact, and one of the reasons people developed the field of color appearance models. With this in mind, it is interesting to ask: do modern neural networks for image recognition integrate the same information to identify certain colors? If not, there are likely conditions under which they perform poorly as a result.

    The above question can be played in reverse: if neural networks do model colors well, then will inspecting the internals of a trained network help reveal how color might be processed in human brains?

Experiment 1: orange vs. brown

import numpy as np import pandas as pd import sklearn as sk import sklearn.tree import graphviz import matplotlib as mpl import matplotlib.pyplot as plt import colorsys import json presentation_mode = True if presentation_mode: import warnings warnings.filterwarnings('ignore') mpl.rcParams.update({'font.size': 20}) mpl.rcParams.update({'axes.labelsize': 20}) mpl.rcParams.update({'text.usetex': False}) Experiment 1: orange vs. brown. This experiment aims to investigate the perception of orange and brown by both humans and by standard neural networks trained for image recogition. Read more...