I’ve just completed an essay for a special edition of Architectural Theory Review in honour of my friend and former colleague Adrian Snodgrass, who passed away last year. Adrian introduced me to structuralism, semiotics and hermeneutics. In part of that essay I reference the writing of the literary theorist and cultural semiologist Roland Barthes (1915-1980).…More
Tag Archives: language
Too much feedback
Google has introduced an AI-driven document analysis platform called NotebookLM. You upload a document to the NotebookLM server via its website (notebooklm.google.com). The LLM generates a summary of the entire document and suggests some questions of the kind you see in textbooks that test a reader’s comprehension of the content. These are not generic questions,…More
AI as critic
I listened recently to a radio program in which a collection of prominent entrepreneurs discussed some of the key examples this year of overhyped marketing. As an aside, one of the participants mentioned the disturbing error rate in ChatGPT’s responses to questions of fact, e.g. name ten distinguished alumni of the Fitzwilliam College, Cambridge? It’s…More
“The words made me do it”
In Neo-Victoria, Detective Hayes confronts Dr. Marlowe, who insists that ancient alien language compelled her to commit murder. This fictional scenario reflects the power of language to influence actions. Language, as a generative force, shapes urban dynamics and societal behavior, as explored by influential thinkers like Foucault and Heidegger. Orwell’s 1984 exemplifies language’s capacity to manipulate behavior.More
Derrida on AI
The radical philosopher Jacques Derrida challenged the conventional belief that speech precedes writing, arguing that writing is fundamental to language’s structure and meaning. Current large language models, reliant on text, support Derrida’s theory, emphasizing the enduring and analyzable nature of written language compared to the ephemeral and context-dependent qualities of speech. (Word count: 50)More
Words in order
Neural network researchers invented several methods that store and make inferences about the order of words in a sentence. The main method I will present here provides one of the components that undergirds the recent impressive performance of natural language processing (NLP) models known as transformer models. The method also resonates with my prior investigations…More
Mandala and metaphor
I’m on sabbatical as I write this, and taking the opportunity to research AI in the urban context as I travel. Here I am in Central Java, at Borobudur for the first time. This trip was prompted by my early work with Adrian Snodgrass, with whom I joint authored the book Interpretation in Architecture in…More
Attention is everything
Attention is a key element in cognition. At our most thoughtful we direct attention to features in our environment that are most important to us at that moment. Attention can wander, of course, we daydream, and we can pay attention to inexistent things, memories and objects of the imagination. A lecturer will come to the…More
Learning to transduce
Human beings at their most rational are able to generalise from examples. If you stand under the shower head before turning on the tap then it is likely you will be dowsed with cold water before it gets to a temperature you are happy with. That if-then rule is a generalisation borne of a few…More
Cryptography for space aliens
“Anticryptography” is a loose term to designate a type of cryptographic message that is legible to someone who has no knowledge of the plain text language from which the message derives. Nor do they have access to the method of encryption, or anything like an encryption or decryption key. Nor is the message meant to…More