I think it's similar to a child - like when I was 3 I'm sure I did things that I knew would get a bad reaction and I looked guilty but didn't feel guilty only cause I didn't know what guilty was and didn't have the experience to interpret my feelings or the ability to voice my feelings.

I think dogs have similar feelings to humans including guilt, they just don't really know what they're feeling or why they're feeling it.