Layering is less about adding more and more about creating a relationship between pieces. A fine base, an unexpected hem and a structured outer layer can change the rhythm of an entire look.
Keep the palette focused and allow differences in texture and proportion to do the work.