I haven't got any fleece trousers, and will probably make my own when I do want some, but for flopping around in I have some really nice Nike tracksuit bottoms. They're drop waist, straight legged, have zips at the bottom and are quick drying. I took them to the Dolomites as my only pair of trousers.
The other trousers that really are nice are the Mountain Hardwear Canyon pants. They seem to have the cut right for women, although I don't actually oen a pair. However, for hanging around in these are probably a bit expensive.
What do you mean by flopping around? If you're not talking heavy duty walking then I'd get down the fashion houses and pick up some cheap troos.