ok when you get to the flashing android you have to press up or down on the volume rocker to switch between windows and android. you will notice that the other icon will start flashing. then just tap the power button again and it should boot up into that selected os.
So I figured out what happed to my OS Icon Switch in windows. I was in tablet mode. If you switch back to desktop mode, the alien icon is on the tool bar. You can make the icon show up in tablet mode by long pressing the tool bar and selecting show icons. The os switch can still be accessed in android by swiping down from the upper right.