{"id":1827,"date":"2023-03-12T13:41:43","date_gmt":"2023-03-12T13:41:43","guid":{"rendered":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/?p=1827"},"modified":"2023-06-22T22:44:35","modified_gmt":"2023-06-22T21:44:35","slug":"1827","status":"publish","type":"post","link":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/2023\/03\/12\/1827\/","title":{"rendered":"ChatGPT, Language and Symbol Grounding"},"content":{"rendered":"\n

Emily Bender<\/a> <\/strong>(as well as Timnit Gebru and \u201cShmargaret Shmitchell\u201d) are warning that AI is not really \u201cthinking\u201d by a \u201cthinker,\u201d that its development and use is contaminated by commercial and malign interests, and that it poses dangers. They are right. But they do not seem to have any new insights into why and how AI is not really thinking (nor do they, or anyone, have any solutions for the dangers it poses).<\/p>\n\n\n\n

Bender\u2019s point<\/strong><\/a> about the difference between form and meaning in language is actually about the symbol grounding problem<\/a> <\/strong>(which she does cite, but as far as I can see, she does not have a proposal for solving it).<\/p>\n\n\n\n

There is way too much chatter going on about chatGPT right now, so it\u2019s very hard to see whether there is any signal in all the noise about it. It seems to be the same thing over and over about \u201ctake-overs\u201d and \u201csingularities\u201d.<\/p>\n\n\n\n

About chatGPT, my own tentative understanding is that its performance capacity shows how much latent structure<\/em> there is in words and propositions, across all languages, even though the shape of words is arbitrary, and so is the shape of the syntactic conventions we adopt in our languages (with the possible exception of Chomsky’s Universal Gramma<\/a><\/strong>r<\/a>).<\/p>\n\n\n\n

The reason is simple: Despite the obvious differences between images and words (or objects and their verbal descriptions)\u00a0some of the structure of things in the world is systematically shared by the structure of the sentences describing them.<\/em>\u00a0And that\u2019s what gives the ungrounded universe of words that chatGPT swallows, together with the algorithms it applies to them, both the real capabilities it has, and the illusion that it gives us, of talking to a real \u201cthinker.\u201d<\/p>\n\n\n\n

A trivial example will illustrate this. Although a cat lying on a mat can be described in countless different ways (\u201ca picture is worth more than 1000 words\u2026\u201d), within and across countless languages, even the simple arbitrary english proposition \u201cThe cat is on the mat\u201d shares, systematically, some structural properties of the scene and object it is describing. That structure, encoded in the verbal description, is systematically present in all verbal descriptions, and it is extended systematically in bags of googols and googolplexes of words and propositions.<\/p>\n\n\n\n

That structure is, in a way, a formal shado<\/em>w of the thing described, in the description. It\u2019s also what makes google\u2019s database of \u201ccommented\u201d images so searchable and navigable. (It does it doubly well for software code, if the code itself is also commented in English [or any language]).<\/p>\n\n\n\n

This shadowed structure is an epiphenomenon; it is not meaning, or thinking. But it can still do a lot of things that look intelligent, because it is parasitic on the grounded meanings of the words in the heads of all the human speakers that spoke or wrote all the googols of words, mined by the algorithms underlying chatGPT and the like.<\/p>\n\n\n\n

Apart from all the money and mischief to be made by mining and manipulating these shadows, they are also reflections of the revolutionary nature and power of language itself, the cognitive capacity it provides to real, grounded brains and bodies to encode the structure of their sensorimotor experience and learning into communicable and storable words and propositions.<\/p>\n\n\n\n

All the rest is in the sensorimotor (robotic) grounding in the brains of the real thinkers who ground and use the words.<\/p>\n\n\n\n

None of this is deep or rocket-science stuff. But it\u2019s what makes us perceive that we are communicating with a thinker when we communicate with it in words. That in turn is driven by our \u201cmirror neurons<\/strong><\/a>,\u201d which trade on the neurological similarity of shape between what we do, and what we see others doing. That is what enables us to mimic and imitate, not just with mutual gestures, but also with words and propositions and their shared sensorimotor grounding. That is what underlies both our everyday mutual mind-reading and (robotic) Turing-Testing. It\u2019s also what is completely missing in chatGPTs, which are just ungrounded, well-mined wordbags that Bender calls \u201cstochastic parrots<\/a>,\u201d<\/strong> parasitic on the shared structure between our words and the world they are about.<\/p>\n\n\n\n

\"\"
Word-Cloud Golem (Dall-E) 12\/3\/2023<\/figcaption><\/figure>\n","protected":false},"excerpt":{"rendered":"

Emily Bender (as well as Timnit Gebru and \u201cShmargaret Shmitchell\u201d) are warning that AI is not really \u201cthinking\u201d by a \u201cthinker,\u201d that its development and use is contaminated by commercial and malign interests, and that it poses dangers. They are right. But they do not seem to have any new insights into why and how AI … <\/p>\n

Continue reading “ChatGPT, Language and Symbol Grounding”<\/span><\/a><\/p>\n","protected":false},"author":3074,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146,106,153,147],"tags":[],"class_list":["post-1827","post","type-post","status-publish","format-standard","hentry","category-chatgpt","category-language","category-symbol-grounding","category-turing-test"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/wp-json\/wp\/v2\/posts\/1827","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/wp-json\/wp\/v2\/users\/3074"}],"replies":[{"embeddable":true,"href":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/wp-json\/wp\/v2\/comments?post=1827"}],"version-history":[{"count":11,"href":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/wp-json\/wp\/v2\/posts\/1827\/revisions"}],"predecessor-version":[{"id":1841,"href":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/wp-json\/wp\/v2\/posts\/1827\/revisions\/1841"}],"wp:attachment":[{"href":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/wp-json\/wp\/v2\/media?parent=1827"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/wp-json\/wp\/v2\/categories?post=1827"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/generic.wordpress.soton.ac.uk\/skywritings\/wp-json\/wp\/v2\/tags?post=1827"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}