I've had patients who experience pain or itching on their belly button during a pregnancy, but never warmth. Without examining you, it is hard to say what might be causing this sensation. Certain medical conditions, such as umbilical hernia, should be ruled out at your next OB visit.