Does this fencing company have a right to their money?

I got a fence from a company, and told them it was specifically to enclose the area so my dog cannot get out. The company put in a gate door that did not open and close properly and could be knocked off by a slight 10-pound push. They also took our trash can and blocked the gaping 3 foot hole with it, so we could not see what they had done. My dog escaped the yard a week later, and because of this we canceled the check we were going to pay him. Now, he threatens to write a police report against us, stating that Georgia Law says we must pay him because he installed and took down the fence. Is he seriously protected for scamming us?