Biological evolution takes place over millions of years: actually, it's a bit faster than that and can be observed quite quickly in simpler organisms, but I agree with what you are saying. At present, cultural and technological evolution are so fast that biological evolution seems to be glacial in comparison.

I would argue that the occlusion of hunter-gatherer lifestyles by agriculture is an "evolutionary" process, even though one in the cultural rather than biological sphere (since it's unlikely that there were substantial genetic differences between the two types of people). As with biological evolution, what survives is what is most fit and not what is "best".