He is pestering for ?

It's not your fault at all. It shouldn't be you that has to change to keep up with him at his speed, because if he really liked you then he should respect your feelings and decisions.