The reason is that early remotes used ultrasonic sound. The sound was usually made by striking a chime bar with a spring loaded hammer. You couldn't hear the ultrasonic ringing, but you could hear a mechanical click, hence the term.
You could have fun with these things. Put your finger over the pickup mike on the TV, and the remote stops working. Since they respond to ultrasonic, you could sometimes make the set go screwy by jingling a set of keys in front of it. Today's remotes only respond to infrared, and the codes have to match.
This particular clicker came to me in pieces. Since then, I have found a home for it.