Not sure if this is being referred to by Current state in a button element
My idea is to have a 'Last' state for a button so users can see the last pressed button. (It doesn't have to be the word 'Last' but you get the idea.)
To have the button behave as it currently does you would leave the 'Last' setting the same settings as 'Normal'.
Have a checkbox somewhere that adds the 'Last' state.
So it doesn't get in the way for folk who don't need to use it.