Personally I think the hardest part is not being able to comprehend everything that is presented to us. Everything from our existence to what atoms are made of is beyond our reach. I don't think there is anything that can frustrate anyone more than the feeling of isolation and lack of control that we get from this.