to suffer a lot as a result of a particular action or event:

中文解释

If you refuse to cooperate with us, you will pay dearly for it. 如果拒绝与我们合作，那么你将为此付出沉重代价。