From guilt to gratitude
If you’ve done something wrong, take responsibility for it and make amends. Say you're sorry. The feeling of guilt comes up from within your body to let you know you’ve crossed a line. Once you’ve made a sincere apology and righted the wrong, then let go of the guilt.
If the guilt sticks around it’s because you’re feeling less-than in some way. That is, your self esteem has taken a hit. That’s pretty normal, so don’t worry about it too much. Instead get grateful. In other words, replace guilt with gratitude. Be grateful that in spite of the things you’ve done and left undone in your life God is still constantly in pursuit of you. And when he catches up to you he’s going to lavish undeserved love and grace on you. Now that’s something to be grateful for! Yes, you’re the guy or girl who did the thing that you did, but you’re also the son or daughter who is infinitely loved by God who doesn’t even seem to notice all of your brokenness. That’s unconditional love.
Guilt is a messenger simply coming to tell you that you did something wrong. Receive the message, make your amends, then move on to gratitude. Be grateful that God loves you just the way you are.