Solved this simply by putting CollisionComponent in the default properties
I have another question though: Are there only collisionCYLINDERS for components? How would one go about to have like a door kinda shape as a collision component? So just a box that is higher than its wide.
EDIT: After VendorX's post below this is what I'm using now. Instead of two cylinders I have a flat door-shaped mesh now as a touchproxy
Begin Object Class=StaticMeshComponent Name=TouchProxy