I think I know what you mean. It doesn't stay that way for long, does it? When I've seen that before, it's only lasted a matter of seconds. I suspect it's an issue with either Allegro or PulseAudio, but I can't reproduce it consistently enough to pin it down.
Are there any messages if you run in a terminal?