Instead of touching the cones, which as you say may pee him off, why not write a nice, friendly letter, anonymously and post it through his letter box. Difficult I know to write a nice letter under the circumstances, but it leaset it wont anger him, yeah it may annoy him a bit but there is no justification to get arsey about it.