It's not the most intuitive thing to use, there's a shift button, but it doesn't switch letters to uppercase, for that you need the separate caps lock button, which you reach with shift+Z.
There's a shift lock, which has nothing to do with caps lock.