There's 2 processors in there. The main one that parses everything and answers. And a small one that only listens for "hey Google" before turning the rest on to save power.
Google probably decided not to mute the other one so it could remind you it was muted and you didn't scream "HEY GOOGLE" got ten minutes before throwing it across the room.