So I filled my coolant recently and the coolant overflow jug is full as well. But recently running the car on max heat seems to help alleviate it a little. Sometimes even if my finger simply grazes the button for heat the buzzer comes back on. But it's random whenever it happens.

 

you have air in the system, you will just need to find out how it is getting in there. pressure test and bleed the system.