Ok this is kind of an odd problem I turned off key echo and it works. Now, on my terminal I have a screen session running, and within that screen session I have ssh sessions going to my remote servers, which also have screen sessions running on them. If I go to those remote screen sessions, my keys start echoing again. What's happening here?
