Last week, 7,000 people – including Tom Cruise – descended on the West Sussex town for an event that divides local opinion