You can do this on Windows 7 and Windows 10 too. Actually, I think it's the default, because it's one of the first things I disable whenever I get a new machine (I'm not a fan)!

I'm on mobile now, but from memory you right click the start button and go into taskbar settings.

Sorry, I meant taskbar similar to e.g. WinXP - where running apps are at one side, and icons (quick launch) at another side of the taskbar. It is possible to show quick launch on Win7 as well but icon/button sizes are different and somewhat ugly. As for "grouping" (into one button) - yes, that the first thing I turn off as well.

As I recall, the only way to group taskbar icons in 7 requires you to also display window titles in the taskbar, which is endlessly annoying; the way to work around this is to enable grouped icons/window titles and then edit your registry to impose a max pixel width on taskbar buttons so that the titles are unseen.

It's been a while, but I'm quite sure that when I ran Windows 7, I had grouped, icon-only taskbar buttons.

It's grouped by default on 10, and you can have the title on or off.

Personally, I have both set to "only when full". I miss that feature on Cinnamon.