Previous researches have shown that the inferior frontal gyrus (IFG) is involved in time and numerosity processing. This study aimed at examining (i) interval timing and (ii) interaction between duration and numerosity processing in four drug-resistant epileptic patients with postoperative lesions in the IFG in comparison with thirteen healthy controls. The duration reproduction and discrimination tasks performed in the sub- and supra-second ranges did not reveal any significant differences between patients and controls. The duration discrimination task of stimuli varying in numerosity (DurN) and the numerosity discrimination task of stimuli varying in duration (NumD) revealed that only numerosity judgment was altered in IFG patients. A time-order effect was notably observed in the NumD task but in opposite directions for the two groups: The second patch was perceived as more numerous than the first patch in controls and conversely as less numerous in patients. Finally in the DurN task, we observed a congruency effect which was dependent on numerical distance in patients but not in controls. These converging results suggest that the IFG would be more specifically involved in numerosity than in duration processing, possibly playing a role in numerical decision.