I don't need to wear a fleece whilst on the move I have a layering system (thin ones). I don't have a warm jacket, my jacket is to keep the rain off (and windchill) nothing else. I rarely wear it in / around the tent.
Yes I hike wearing a gorilla costume, good for scaring folk up Ben Macdhui
My layers aren't anything special; I have an M&S microfibre tee shirt - soaks up lots of sweat but dries quickly, two North Face tee shirts (one is long sleeved) polyester I assume, and a bamboo long sleeved top which is also thin. I don't wear all these layers at once btw, although I can if I want if it's that cold with my fleece on top - it's still comfy, several long sleeved layers doesn't work too great though. I'm taking an extra layer this time round (the North Face long sleeved one) on my Cairngorms trip next week because of all the snow around, although it seems to have warmed up a bit now. I often just hike with a tee shirt on, top half I mean not naked from the waist down I don't tend to get cold lugging around 20kg's on my back funnily enough.