zlacker

[parent] [thread] 3 comments
1. xNeil+(OP)[view] [source] 2023-09-01 21:34:10
That sounds awesome! Was coming back to Cycorp to permanently work ever in the works for you? Or did you think the intern was nice but you didn't want a career in the field?

Also - what exactly did you do in the internship as a 17 year old - what skills did you have?

replies(1): >>snowma+Db
2. snowma+Db[view] [source] 2023-09-01 23:12:31
>>xNeil+(OP)
I was certainly interested in working at Cycorp full-time. But after two summers there, I could tell that the technical approach they were taking was just not working.

My first summer, I was an ontologist, which was a unique role that only existed at Cycorp where they hired people to literally hand-enter facts like "A cat has four legs" into Cyc using formal logic. My second summer I programmed (poorly) in Lisp for them.

replies(1): >>dang+dY1
◧◩
3. dang+dY1[view] [source] [discussion] 2023-09-02 18:10:54
>>snowma+Db
> I could tell that the technical approach they were taking was just not working.

Could you say more about that? How could you tell?

replies(1): >>snowma+W12
◧◩◪
4. snowma+W12[view] [source] [discussion] 2023-09-02 18:37:45
>>dang+dY1
Perhaps other people with deeper AI knowledge can weigh in here too. But at the time, there were the two things that tipped me off.

1) Cyc's reasoning fundamentally did not feel "human". Cyc was created on the premise that you could build AGI on top of formal logic inference. But after seeing how Cyc performed on real-world problems, I became convinced that formal logic is a poor model for human thought.

The biggest tell is that formal logic systems are very brittle. If there is any fact that is even slightly off, the reasoning chain fails and the system can't do anything. Humans aren't like that; when their information is slightly off, their performance degrades gracefully.

2). Imagine a graph where time/money was on the x-axis, and Cyc's performance was on the y-axis. You could roughly plot this using benchmarks like SAT scores. It was clear if you extrapolated this that Cyc was never going to hit human-level performance; the curve was going to asymptotically approach something well below human-level performance.

As a side note, if you look at the performance of LLMs, I would argue that you get the opposite result for both criteria.

[go to top]