Having only one pair with weak kicker I'd probably fold,too. He could've been bluffing, but most likely he had something.