The left side usually refers to what has been or what needs to be “left” behind. Can also imply that you are feeling left out.