I can't imagine what Apple was thinking when they hid the On/Off switch, but be that as it may, I've been almost universally successful at resolving this sort of problem by turning Ghostery off right from my toolbar as a first step.
Apple has an OCD for simplifying interfaces, mainly in the interest of improving aesthetics. Often it adds inconvenience for a few, but occasionally for many.
I work for the Department of Redundancy Department
