I get the feeling Jim is solely thinking of how they look together now and feels a little unsure of himself, maybe he's testing Mary here with all these people of a similar age to Mary, the issue is how it might affect Mary, what with her incident losing control of herself.....