The problem isn't that he used color to make interesting new art. I think he explored new areas of color which were not known before - and I applaud his artistic efforts.
However, Josef Albers went beyond his art to make false claims about color theory, how the human brain perceives color and made broad generalizations - based on anecdotal evidence and intuition. He went unchallenged for the most part. See the criticism linked in my original post.
I just checked the book "Color for the Sciences" that you had mentioned. I think I am going to purchase this one! Thanks.
Jan Koenderink's book on color measurement looks good.