Judith, You may need an attorney for this. HOAs can be notoriously difficult to reason with. As I see the issue is that although the fence was approved, the previous homeowner didn't install it according to their approval.
Look up the legal doctrine called - laches. If someone does not assert a right for a long time, then finally they may lose the right due to laches.