Why You Don’t Always Get What You Want

I am confused about how to consciously create my own reality. In one sense I may want something consciously, but then I feel that my higher self brings me the experience that I need to have for my soul growth instead. So how does creating my reality consciously work?