Thursday, May 16, 2024

Finding the Grooves

What have I contributed to the "great AI debates" thus far, and how to measure? 

Is "AI debates" catching on as a meme? 

I've stressed "mirroring" (as in "chatbots mirror an educated layman's prose"), and going forward I plan to use the word "groove" a lot more, a synonym for "rut" in a space of reduced dimensions.

In Active Inference, the quick rejoinder, that we're open to surprisingly beneficial developments in the field, is perhaps a subclass of "mistake mystique". 

We really want the shortcomings in our models to be pointed out, and by definition we have trouble seeing those from the inside. 

Those who claim to self-generate all these exotic perspectives on themselves are likely in the self-fooling business. You need others to be the others.

This defensive reflex has to do with our loss function, in the sense of backpropagation (ML jargon), being about measuring "free energy" as what to minimize, in favor of precision, accuracy, less surprise, less entropy. 

To dampen "freedom" and "surprise" as a matter of ontological bias, as what to minimize, results in predictable compensatory actions, per our dynamical equilibrium model. We mean to minimize the energy 

A pre-trained chatbot is looking to navigate the grooves in human discourse in a way that proves a next move is almost completely context determined. When we picture a tree of possibilities, we see how it gets out of hand unless vigilantly pruned, which means ruling out a lot more than we rule in. 

We seek a "straight and narrow" if only because we're called upon to exercise our executive functions. Horizons broaden when the pressure to "do something" is relatively less.

I've written before how in geekdom we relish languid relaxation mode over shouting instructions, because when everything is under control, shouted instructions are for the most part unnecessary. Players will have internalized what needs to be done and will have set about doing it, perhaps in tight collaboration, but without bottlenecking through some singularity. 

There's no single pipeline or narrative through the content, and where one critical path falls behind, the algorithm will find a new one, perhaps by changing the goals (hey, goals change). 

New grooves form, old ones fade. The valleys may become deeper, the ridges between them higher.

I've been a Sophia-basher in some ways, not buying her (its) pretensions to AGI-hood. Her performances are scripted and her getting citizenship in a country, before Palestinians could, speaks volumes regarding how the billionaire class hoodwinks the less well-educated.

Saturday, May 11, 2024

Closing the Gap

C6XTY: Plastic

One of my chief interests, starting early (elementary school), has been computer programming. 

After attending university as an undergrad, my first job out of college was that of high school teacher, of maths in particular although I taught some other subjects. 

This was a small, private Catholic school and faculty capable of teaching multiple subjects were given  opportunities to do so. Having just come through Princeton, and being one of the few males in a school for women, the nuns in charge could see my utility. I brought some of the latest thinking into the mix. My international upbringing was a plus also.

Much of that "latest thinking" with regard to my job as mathematics teacher, had to do with these programming languages. APL by Kenneth Iverson had taken the Princeton campus by storm, in the form of scattered terminals any student could use, regardless of what courses she or he was taking.

Within weeks of moving into Princeton Inn, I was programming battleship in APL and reading the code, character by character, to my friend Glenn Baker, from my cohort in the Philippines, then at Hampshire (later Brown).

If you've ever touched APL, you know how mathy it is. Wouldn't opening doors in computer world make maths all that much more relevant?  Students kept asking "why are we learning this?" whereas programming had its obvious applications. 

Also, the REPL (interactive command line) could give immediate feedback and invited simply playing around, chatting by sending math expressions to an interpreter. 

So yeah, dialing back to the early 1980s, it was very clear then, as it is now, that the curriculum would be changing. Seymour Papert introduced Logo and turtle graphics. Alan Kay introduced Squeak. Children and teachers of children had become the preferred audience for many genius innovations.

Fast forward and we're finding the merger is much further along. Programmers are very "type aware" whether object oriented or functional. They tolerate abstractions in coding languages, as a path towards generality and therefore code reusability. 

On the maths side: Category Theory. The mere existence of this bridge gets the zipper started, as it were, such that the two flaps (computer science and math world) come together as one.

However, CT is not for everyone and that's where more right brain bridges come in. We have our experiments with new kinds of prose in the 1900s, ala Ezra Pound and James Joyce. Writers discovered it was both OK and relevant to push the envelope, in terms of what language, the printed word especially (with embedded figures), might accomplish.

One of those prose experiments, RBF's Synergetics, opened geometrical information to experienced readers in the humanities. They wouldn't have to detour as much, into abstract linear algebra. The C.P. Snow chasm (the opening divide between different thinking styles) was countered within the realm of pattern languages.

Unfortunately, I don't think Princeton itself was able to keep up, and schools in general started falling by the wayside, as the most effective teachers came to the foreground in the University of Cyberia (a made up name signifying internet space), including from the ranks of pre-existing academies (e.g. from MIT) that contributed to the growing stash of open courseware.

We're still in this era, of Global U convergence, with CT and Synergetics both worthy entry points if you're of a comprehensivist (polymathic) bent. I recommend exploring some of the recent Codas I've been working on with the TrimTab group.

Tuesday, May 07, 2024

Citizen Diplomacy

The UN declaration on human rights is a bold piece of literature, however "citizenship" as a concept has failed to extend to a critical number, which explains why we keep looking for newer solutions. 

I keep hearing that diplomacy is not happening amongst the principals but that's begging the question of who the principals are. High profile celebs, other influencer talking heads, are galvanizing the public to track the issues, and the more the official diplomatic class refuses to engage, the less its influence, a tautology.

In global university terms, "diploma" and "diplomat" are closely related in that it takes rhetorical skills to stay in the ring without blowing one's top, losing one's cool or whatever the lingo. Judges take a dim view of undisciplined lollygagging. The well-trained debater is not so easily thrown off balance.

You'll have seen in these blog posts how teams could be fielded and convoyed without communicating tyrannical messages. A traveling circus is not a threat, except maybe unaware parents in sleepy towns don't know how strongly junior dreams of growing wings. The folklore around traveling circuses does tend to get ugly where abduction is concerned.

Yes, I'm talking about the trucker teams able to fly around the world and try out different road systems, sometimes always working for the same company, other times within a network of affiliates. The wrinkle is the academic credit that potentially goes with becoming a citizen diplomat. So many affordances!

The trucker, any attributes (such as pronouns) is modeled within a personal workspace (PWS) within GST. If you want a GST primer, I've got a few pithy pages at Grunch.net (a domain), or just Google it. Try "Kenneth Boulding" as a search term. It's a kind of updated Economics, a source of healthy competition for other econ models.

I'm not suggesting that only the trucker community is engaged in cross-border diplomacy, not to mention paperwork. These long haulers do have a natural edge though, when it comes to having access, by necessity, to the world's infrastructure.  We're not about to lose the trucking angle.