5v power when Alpha is running

Is there a way to get 5v when the Alpha is turned on (not just has power)? I need to turn on a 5v relay to power other devices, but only want those devices to have power when the Alpha is on. All of the pins I tested have 5v when the Arduino is on, and the Arduino turns on when there is power.