From the perspective that "only" can mean only one, sole, etc., this is still the correct usage of the idiom "one of the only". Idioms don't match the literal meanings of the words that make them up. Even if unsure, the context makes it clear.

This is in contrast to people mistaking one word for another.