You are walking on a slippery slope! No one wants to tackle this issue that is for sure. First off you are on a public lake, BUT it is YOUR blind. You did the right thing being around kids and didn't make it an issue. Likely you will never see that guy again, but if he shows next time tell him politely to leave and if he doesn't call Iron Man!
I wouldn't be mad that he was hunting it, because for all he knew it was abandoned (and it was).
For the record though: I HATE private blinds on public lakes, but unfortunately the rules will not be changed anytime soon
