I've had similar experiences. In some cases it was a talk that was way over my head and seeing people who I viewed as way above me also struggling. In some other cases it was like you describe, seeing talks that I viewed as elementary boggling the minds of many attendees. Granted other times I was befuddled and no one else was. So the real lesson is everyone has different strengths & weaknesses.