There is no right or wrong, really. It depends on the grammar book. However, we do not capitalize unless the phrase is being used for a title or heading: present simple, the present simple, simple present, the simple present, the present simple tense, the simple present tense.