Coughing can be anything, really. How old is he? What breed? In smaller dogs (and sometimes larger dogs...just more common in smaller dogs) it can be a sign of a heart issue. Other possibilities are lung problems such as pneumonia, collapsing trachea, kennel cough, paralysis of the larynx, heartworms, etc. If it doesn't improve, I'd definitely get him to a vet.