I missed you

One of the office assistants (Daimaru-san or 大丸）was gone yesterday, and so when I tried to say "I missed you yesterday" I of course used the wrong "miss" so she tilted her head and was like "what?" Turns out, I said "I failed to hit you yesterday."  And I said it in a sad tone, so she probably thought that I really wanted to hit her.