After reading all this, I was just starting to think, it might be useful to use www.doodle.ch to plan the time. Here you could put in checkboxes for each hour of the day and then let all the potential participants check which times work for them. At the end, you see which time has the most checks, and then choose that.
Best wishes, Chuck