Hi, welcome to iMore.
Hold the power button and the home button pressed at the same time for 10 to 15 seconds until the screen goes black and then release both buttons.
Your phone will restart now.
If you still keep seeing the Apple icon, connect your phone to iTunes with the lightning cable and check what it says.