Is It OK to Record People Without Their Knowledge?

More people are using smart glasses to record, often secretly, in public. Is that ethical?