Is he alone on stage when he speaks these words? Does he think he is alone?

No, Hamlet is not alone. Ophelia pretended to leave the room, bit she is in fact hiding behind the tapestry. Claudius and Polonius are also hiding in the hopes of finding out exactly where his madness is coming from.