He might just be trying to keep you interested. He might actually want to have sex but acts like he isn't interested every once in awhile to make you want him more. And if thats the case, he is doing a good job because look how you're thinking about it..