I have some private doubts whether turning off voice recognition on any device works. I turned it off on my MBP and guess [what]? When I went to the sound input monitor, it was moving when I was talking.
That's odd, although the monitor function may always be on, but as long as you can verify that it's not 'broadcasting', it's probably safe.
That said, you should probably try to ascertain exactly what's going on, especially whether it's turned on or off.
