Latte Panda power button no response

I turned off the power to put on the latte panda case. I put the case on and pressed the power button, but the red light doesn't turn on. I took off the case and tried again, but the same red led didn't light up. When I plug in the power cord, the blue and red lights come on at the same time, the red light goes out after a few seconds and the blue light stays on. Is there any workaround?

My native language is not English so the context may be awkward. Thank you for your understanding :)