I haven’t played it yet, but that sounds very much like the interactions in the first couple of Penumbra games that they made. If it’s similar, then it is easier with a mouse, and it’s pretty much an interactive design choice.
I understand the idea, but yes it is very awkward at first.