We've reached an agreement, since I am working on the porch that I can keep the construction equipment and materials out, and they will give me a lot more leeway on the porch since it's an active project. I do have to renew the permit (which was planned anyway) and clean up the rest of the junk, but because I am actually doing the work, they're a lot more lenient.
I am taking suggestions as to what to do about the neighbor though. Nothing I can get arrested for, and nothing of any permanent damage.