In a previous post (Predicting proximity), I reviewed the NLP (natural language processing) operation of calculating the relationships between words in a corpus of texts. So the word “architectural” is closer to the word “urban” than “architectural” is to “culinary.” Very close word proximity could mean that one word can be substituted for another in…More
Category Archives: Artificial Intelligence
The invention of language
Automated natural language processing (NLP) technology is impressive, though I need to remind myself of its limits. It is easy to elide thoughts about its linguistic capabilities with a sense that it is on the way to mastery of language, and therefore human intelligence. In what follows I will follow the line that NLP is…More
Imperfect patterns
Training a neural network (NN) involves automatically adjusting numerical weights and thresholds (biases) to account for all input and output pairs presented to the NN. After training on these input-output patterns the NN should reproduce the appropriate output pattern when presented with any one of the input patterns. Note that it is not patterns that…More
Just one neuron
I revisited our earlier (1990) article on neural networks “Spatial applications of neural networks in computer-aided design.” Neural networks were novel in architecture and CAD. What follows is an update of the part of that article in starting to explain how neural networks function. Neural network layers Neural network (NN) models store information as numbers…More
Automatic pattern completion
In 1990 Arthur Postmus and I published an article about “spatial applications” of artificial neural networks (ANNs). In a more recent article, Gabriele Mirra and Alberto Pugnale at the University of Melbourne developed up-to-date applications of AI in design. They generously cited our article (amongst articles by others). I concur with their assessment of the…More
Who’s listening?
In every mind there is a higher function watching or listening to the inflow of sense data and monitoring its own thought processes. In his seminal book on the philosophical challenge of consciousness, Daniel Dennett argues convincingly against this proposition. He directs his criticism against those who presuppose that somewhere, conveniently hidden in the obscure…More
The next word
“We are so in sync we finish each other’s … sandwiches.” That’s a variation on a joke from several sources: The Simpsons, Arrested Development, The Good Place, etc. In some social situations where I can’t think of anything appropriate to say, I just start a sentence anyway, not knowing what comes next or how it…More
Predicting proximity
Tokens NLP (natural language processing) systems don’t necessarily consider only words as the basic components of prediction. They may break words into smaller units roughly corresponding to syllables, punctuation marks and even single characters. The general term for these textual units is “tokens.” An NLP system will include in its algorithmic workflow the construction of…More
Nothing beyond text
In explaining the political philosopher Jean-Jacques Rousseau’s (1712-1778) autobiographical book Confessions, the continental philosopher Jacques Derrida observed that there is nothing to support Rousseau’s claims about his relationships with his family members, other than what the text discloses. Derrida generalises this observation to the controversial proposition that any attempts to ground spoken or written assertions…More
Learning to transduce
Human beings at their most rational are able to generalise from examples. If you stand under the shower head before turning on the tap then it is likely you will be dowsed with cold water before it gets to a temperature you are happy with. That if-then rule is a generalisation borne of a few…More