We introduce a method for situation understanding in natural, face-to-face conversation. Our method combines a network of commonsense knowledge with keyword spotting and contextual information automatically obtained from a wearable device such as a PDA or cell phone. Using this method we demonstrate the potential for high accuracy, detailed classification of conversation topic.