Pyth, 8 bytes
-zr*2hz3
Uses Pyth's version of python's str.title
to convert a string of the first letter twice into the form "<Upper><Lower>"
. Then it removes each element from the input that is in that string. Spaces work fine because they are unaffected by str.title
.