To anyone who finds this thread, here's how I ended up doing it:
First, I started a Windows machine in EC2 and used these instructions to enable SSH via RDP. Then I created my own custom AMI and used that to deploy on.
I'm disappointed that this is how I had to do it. There must be a way to take a standard Windows EC2 AMI and deploy it without RDP.