Why Higher Altitude Is Colder?

Because of the air pressure. The lower the ground level, the more air pressure it gets, and the better it to gain heat because more air molecules per volume air. Less air means less molecules to trap heat.

Additionally, the atmosphere is heated from the ground up so higher altitude are further from the heat source.