What people mean when they say the dress is blue and black is that they are inferring from the photo that the dress is blue and black under natural lighting. They can perceive that the black is not a true black, by pixel value, but in order for the brownish color to "make sense" alongside the blue in the photograph is for the brownish areas to be representing black.