Knowledge as a graph of concepts and the links between them.
π Where this lives: a semantic net is what a knowledge graph is, drawn on paper. When a search engine knows that Kathmandu is-a city, is-in Nepal, and has-population some number, it is storing exactly the node-and-labelled-arc structure of this topic. The reason the idea survived from the 1960s into today's largest databases is that it matches how relational facts naturally decompose β into triples of subject, relation, object. Search "semantic network knowledge graph triple store".
The structure
A SEMANTIC NET (or ASSOCIATIVE NET) represents knowledge as a
GRAPH:
NODES represent objects, concepts, events or situations
ARCS (labelled, directed) represent the RELATIONSHIPS
between them
Originally proposed by Quillian (1968) as a model of human
associative memory, which is why the emphasis is on retrieval by
following links rather than on logical inference.
THE ESSENTIAL IDEA: knowledge is in the CONNECTIONS. A concept's
meaning is given by its position in the network β what it is a
kind of, what its parts are, what it can do β rather than by an
internal definition.
THE STANDARD ARC TYPES, and the distinction that matters most:
isa class inclusion: one class is a subclass of
another
Bird isa Animal
instance_of class membership: an individual belongs to a
class
Tweety instance_of Bird
has_part part-whole (partonomy)
Bird has_part Wing
property arcs any attribute: colour, size, ability
Tweety colour Yellow
ISA VERSUS INSTANCE_OF IS EXAMINED CONSTANTLY, and confusing
them is a genuine modelling error:
isa is a relation between two CLASSES and it is TRANSITIVE β
Sparrow isa Bird, Bird isa Animal, therefore Sparrow isa
Animal.
instance_of relates an INDIVIDUAL to a CLASS and it is NOT
transitive β Tweety instance_of Bird and Bird isa Animal
gives Tweety instance_of Animal (which is inheritance
working), but Tweety is not an instance of "the class of
classes".
A TEST: if you can meaningfully say "a member of it", it is a
class and takes isa; if it is a particular thing with a name,
it is an individual and takes instance_of.
A WORKED NETWORK:
Animal
β² isa
β
Bird ββhas_partβββΆ Wing
β² β
βββββββββ΄βββββββββ β number
isa isa βΌ
Sparrow Penguin 2
β² β²
instance_of instance_of
β β
Tweety Pingu
β
colour βββΆ Yellow
plus property arcs at the class level:
Bird can_fly βββΆ True
Penguin can_fly βββΆ False β an OVERRIDE
Bird covering βββΆ Feathers
ANSWERING QUERIES BY TRAVERSAL:
Q: Can Tweety fly?
Tweety has no can_fly arc β follow instance_of to Sparrow β
no can_fly β follow isa to Bird β can_fly = True.
ANSWER: yes, INFERRED in three hops.
Q: Can Pingu fly?
Pingu β instance_of Penguin β can_fly = False FOUND HERE,
so the search stops before reaching Bird.
ANSWER: no. THE MORE SPECIFIC VALUE WINS, which is how
exceptions are handled β and it depends entirely on the
search stopping at the first value found.
Q: How many wings does Pingu have?
Pingu β Penguin β Bird β has_part Wing, number 2.
ANSWER: 2, inherited across a part-whole arc.
THE INFERENCE MECHANISM IS THEREFORE JUST GRAPH TRAVERSAL β
which is the source of both the appeal and the limitations.
Extensions, and the limitations
TWO EXTENSIONS that address real gaps.
1. PARTITIONED SEMANTIC NETS (Hendrix)
THE PROBLEM: a plain net cannot express quantification or
scope. "Every dog bit a postman" β is it one postman or one
per dog? A net has no way to say.
THE SOLUTION: divide the network into SPACES (partitions),
with a node for each space and arcs indicating which
statements lie inside which. A universally quantified
statement becomes a general statement node (a GS node) whose
`form` arc points to a partition containing the quantified
relation, with β and β arcs naming the variables.
WHY IT MATTERS: it restores the ability to express what
first-order logic expresses, at the cost of the diagram
becoming considerably harder to read β which is a fair
summary of the whole expressiveness trade-off.
2. CONCEPTUAL DEPENDENCY and CONCEPTUAL GRAPHS
Schank's CONCEPTUAL DEPENDENCY represents sentences by a
small set of PRIMITIVE ACTS, so that sentences with the same
meaning get the same representation regardless of wording.
the primitives include ATRANS (transfer of an abstract
relationship, e.g. give), PTRANS (transfer of physical
location, e.g. go), PROPEL, MOVE, INGEST, MTRANS (transfer
of mental information, e.g. tell), MBUILD, ATTEND, SPEAK,
GRASP, EXPEL
WORKED: "John gave Mary a book" and "Mary received a book
from John" both become an ATRANS with actor John, object
book, recipient Mary, donor John. CANONICAL FORM MEANS
PARAPHRASES BECOME IDENTICAL, which is exactly what a
question-answering system needs.
β the primitive set is contentious β is there really a fixed
small basis for all action? β and complex sentences produce
unwieldy structures.
THE LIMITATIONS OF SEMANTIC NETS β the examinable list:
1. NO STANDARD MEANING FOR THE LINKS. `isa` means class
inclusion to one author and class membership to another, and
nothing in the notation enforces either. TWO NETS DRAWN BY
TWO PEOPLE MAY NOT BE COMPARABLE.
2. CANNOT EXPRESS NEGATION, DISJUNCTION OR QUANTIFICATION
natively.
"Tweety is not a penguin" β there is no arc for "not"
"Either Ram or Sita will attend" β no arc for "or"
"Every student has a supervisor" β needs partitioning
THIS IS THE DECISIVE LIMITATION: it is a representational
inadequacy in the sense of the earlier topic, and it is why
logic is needed.
3. THE EXCEPTION PROBLEM. Inheritance with overrides is
convenient and NON-MONOTONIC, so it has no clean logical
semantics β and the Nixon diamond (conflicting inherited
defaults) has no syntactic resolution.
4. INFERENCE IS LIMITED TO TRAVERSAL. There is no general
inference procedure, so what can be concluded depends on what
links happen to exist rather than on what follows logically.
5. NO WAY TO REPRESENT KNOWLEDGE ABOUT THE NET ITSELF β
certainty, provenance, or the time at which something was
true β without ad-hoc additions.
6. COMBINATORIAL GROWTH. Representing a moderately complex
domain produces a graph too large to draw and hard to
maintain, and there is no modularity mechanism.
THE HONEST ASSESSMENT: semantic nets are excellent at
TAXONOMIC and RELATIONAL knowledge, and poor at everything
else. That is not a small niche β taxonomies are enormously
useful β but a system needing negation, disjunction or
quantification must use logic.
Comparing to logic, and where nets are actually used
SEMANTIC NETS AND LOGIC ARE NOT RIVALS SO MUCH AS DIFFERENT
NOTATIONS FOR OVERLAPPING CONTENT. Most of a semantic net
translates directly into first-order logic:
NET LOGIC
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Tweety instance_of Bird Bird(Tweety)
Sparrow isa Bird βx Sparrow(x) β Bird(x)
Bird has_part Wing βx Bird(x) β βy Wing(y) β§
part_of(y, x)
Tweety colour Yellow colour(Tweety, Yellow)
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
WHAT THE NET ADDS: an INDEXING STRUCTURE. Finding everything
related to Tweety is following its arcs, whereas in a flat
logical database it means scanning every sentence for the term.
THAT IS THE INFERENTIAL EFFICIENCY PROPERTY from the first KR
topic, and it is the real contribution β the net is a data
structure for logic as much as an alternative to it.
WHAT THE NET LOSES: negation, disjunction, and quantifier scope,
as above.
AND ONE THING THE NET MAKES EASY THAT LOGIC MAKES AWKWARD:
DEFAULTS WITH OVERRIDES. `Penguin can_fly False` overriding
`Bird can_fly True` is a one-arc edit in a net, and requires
non-monotonic machinery in logic.
WHERE THIS STRUCTURE IS ACTUALLY USED TODAY:
KNOWLEDGE GRAPHS search-engine entity graphs, Wikidata;
facts as (subject, predicate, object)
triples, which IS a semantic net
WORDNET a lexical database of English organised
by synonymy, hypernymy (isa) and
meronymy (has_part) β used throughout
natural language processing
ONTOLOGIES RDF and OWL, with formal semantics
added precisely to fix limitation 1
PRODUCT TAXONOMIES every online catalogue's category tree
BIOMEDICAL the Gene Ontology, SNOMED CT β among
TERMINOLOGIES the largest deployed knowledge
structures anywhere
THE HISTORICAL LESSON WORTH DRAWING: the original semantic net's
fatal weakness was the absence of agreed link semantics, and the
modern successors fixed exactly that. RDF specifies that a
triple is a triple; OWL specifies what `subClassOf` means and
what a reasoner may conclude from it. THE STRUCTURE SURVIVED;
WHAT WAS ADDED WAS A DEFINITION OF WHAT THE ARCS MEAN.
A WORKED SCALE COMPARISON, to make the point that this is not a
historical curiosity:
the 8-node bird example above 8 nodes, ~12 arcs
WordNet ~117,000 synsets
Wikidata over 100,000,000 items
β the same node-and-arc idea, at nine orders of magnitude
difference in scale, which is only possible because the
arc semantics are fixed and the structure is machine-
readable rather than drawn.
The Pingu query shows how exceptions work and how fragile the mechanism is: the answer "no" depends entirely on the search stopping at the first value found. Change the traversal order and the same network answers differently β which is precisely the criticism that semantic nets have no agreed semantics for their links.
π Go further:WordNet is the semantic net you can download and query today, and it is worth doing. Around 117,000 synsets of English organised by synonymy, hypernymy (the isa hierarchy), meronymy (has-part) and antonymy β and because the hierarchy is explicit, you can compute semantic similarity between words from their distance in the graph, which was the standard technique in natural language processing for years before embeddings. Comparing WordNet's structured, hand-built relations with a modern embedding's learned but unlabelled similarity is the symbolic-versus-statistical contrast in one concrete pair. Search "WordNet hypernym path similarity NLTK".
π‘ Exam angle: define a semantic net and draw one for a described domain, using isa, instance_of, has_part and property arcs β this is a guaranteed question. Be precise about isa versus instance_of (class-to-class and transitive, versus individual-to-class and not). Trace a query through the net by inheritance, including an override such as a penguin that cannot fly. Explain partitioned semantic nets and what they solve (quantification and scope), and name conceptual dependency with a few primitives. List the limitations: no standard link semantics, no negation/disjunction/quantification, the exception problem, and inference limited to traversal.
Syllabus points
Semantic network representation
Create a free account to tick topics off, take notes as you read, watch the video lessons and get a day-by-day study plan built around your exam date.