Artificial Intelligence & Neural Networks β Introduction to AI and Intelligent Agent, NEC licence examination syllabus (Nepal Engineering Council).
Concept of AI & Perspectives
Four different definitions of "artificial intelligence", and why the disagreement matters.
π Where this lives: the word "AI" is doing enormous work in public conversation right now, and most arguments about it are really arguments about which of the four definitions below the speaker has in mind. A system that plays chess superhumanly and cannot tie a shoelace is intelligent under one definition and not under another β and knowing which is which is the difference between a useful discussion and a circular one. Search "what is artificial intelligence definitions disagreement".
The four definitions
Russell and Norvig organise the definitions of AI along TWO
DIMENSIONS, giving four quadrants. This 2Γ2 is the standard
opening question of the subject.
DIMENSION 1: THOUGHT vs BEHAVIOUR
is the goal to replicate the internal REASONING PROCESS, or
only the external ACTIONS?
DIMENSION 2: HUMAN vs RATIONAL
is success measured against HUMAN performance, or against an
ideal standard of RATIONALITY?
HUMAN RATIONAL
ββββββββββββββββββββββ¬βββββββββββββββββββββ
THOUGHT β Systems that THINK β Systems that THINK β
PROCESSES β like humans β RATIONALLY β
β (cognitive β (laws of thought) β
β modelling) β β
ββββββββββββββββββββββΌβββββββββββββββββββββ€
BEHAVIOUR β Systems that ACT β Systems that ACT β
β like humans β RATIONALLY β
β (the Turing test) β (rational agent) β
ββββββββββββββββββββββ΄βββββββββββββββββββββ
1. ACTING HUMANLY β THE TURING TEST APPROACH
Turing (1950) proposed the IMITATION GAME: a human
interrogator converses by text with a human and a machine; if
the interrogator cannot reliably tell which is which, the
machine passes.
THE CAPABILITIES IT REQUIRES:
natural language processing Β· knowledge representation Β·
automated reasoning Β· machine learning
(and for the TOTAL Turing test, adding video and physical
objects: computer vision and robotics)
THE OBJECTION: it defines intelligence by IMITATION, which
rewards deception. It also sets an anthropocentric target β
aeronautical engineering does not aim to fool pigeons.
2. THINKING HUMANLY β THE COGNITIVE MODELLING APPROACH
To say a program thinks like a human, you must first know how
humans think. Three routes to that knowledge:
INTROSPECTION β catching our own thoughts as they pass
PSYCHOLOGICAL EXPERIMENTS β observing a person in action
BRAIN IMAGING β observing the brain in action
COGNITIVE SCIENCE is the interdisciplinary field this
produces. The test is not "does it get the right answer?" but
"does its reasoning trace resemble a human's, including the
mistakes?"
3. THINKING RATIONALLY β THE LAWS OF THOUGHT APPROACH
Aristotle's SYLLOGISMS gave patterns of argument that always
yield correct conclusions from correct premises:
Socrates is a man; all men are mortal;
therefore Socrates is mortal.
This became formal LOGIC, and the LOGICIST tradition in AI:
represent knowledge as logical statements and derive
conclusions.
TWO OBSTACLES:
Β· informal knowledge is hard to state with the certainty
logical notation demands β most things we know are
probable, not certain
Β· a problem solvable in principle may be intractable in
practice, because the search space explodes
4. ACTING RATIONALLY β THE RATIONAL AGENT APPROACH
An AGENT perceives and acts. A RATIONAL AGENT acts so as to
ACHIEVE THE BEST OUTCOME, or, under uncertainty, the best
EXPECTED outcome.
THIS IS THE DEFINITION RUSSELL AND NORVIG ADOPT, and modern
AI generally follows them. Its advantages:
Β· MORE GENERAL than the laws-of-thought approach: correct
inference is one way to be rational, but not the only
one β a reflex that works needs no inference at all
Β· MORE AMENABLE TO SCIENCE than the human-based
approaches, because rationality is mathematically
specifiable while "human-like" is not
Β· it does not require the agent to think at all, only to
do the right thing
THE DISTINCTION THAT RESOLVES MOST CONFUSION:
STRONG AI the claim that a machine can genuinely be
conscious and understand β a philosophical
position
WEAK AI the claim that a machine can act as if
intelligent, producing useful behaviour β an
engineering position
Essentially all working AI is weak AI, and almost all public
argument is about strong AI. Searle's CHINESE ROOM argument
targets strong AI specifically: a person following symbol-
manipulation rules could produce fluent Chinese without
understanding a word, so behaviour alone does not establish
understanding.
Rationality, and what makes a problem hard
WHAT RATIONALITY DOES AND DOES NOT MEAN β a frequently examined
distinction:
RATIONALITY IS NOT OMNISCIENCE. An omniscient agent knows the
actual outcome of its actions; no real agent does. Rationality
is about maximising EXPECTED performance given what is known.
Crossing a road after looking both ways is rational even if
a cargo door falls from a passing aeroplane and flattens
you. The action was right; the outcome was unlucky.
RATIONALITY IS NOT PERFECTION. Perfection maximises actual
performance; rationality maximises expected performance.
RATIONALITY DEPENDS ON FOUR THINGS:
1. the PERFORMANCE MEASURE defining the criterion of success
2. the agent's PRIOR KNOWLEDGE of the environment
3. the ACTIONS the agent can perform
4. the agent's PERCEPT SEQUENCE to date
INFORMATION GATHERING is part of rationality: doing actions in
order to MODIFY FUTURE PERCEPTS β looking before crossing β is
rational, which is why a rational agent is not merely a
calculator.
WHY AI PROBLEMS ARE HARD β the two properties that distinguish
them from ordinary computation:
1. COMBINATORIAL EXPLOSION. The space of possibilities grows
faster than any exhaustive method can search.
WORKED β the 8-queens problem, three ways of counting:
place 8 queens anywhere on 64 squares
C(64,8) = 4,426,165,368 arrangements
one queen per column
8^8 = 16,777,216
one per column AND one per row (a permutation)
8! = 40,320
THE SAME PROBLEM, and a 110,000-fold reduction obtained
purely by reformulating what counts as a candidate. THIS IS
THE CENTRAL SKILL OF AI PROBLEM SOLVING: the
representation determines the difficulty far more than the
algorithm does.
2. KNOWLEDGE-INTENSIVENESS. The behaviour depends on large
amounts of knowledge about a domain, much of it never written
down because humans consider it obvious β the DOMAIN
REQUIREMENTS problem from software engineering, at scale.
"Put the book on the table" requires knowing that books are
rigid, tables are horizontal, gravity exists, and the book
must not be placed on the cat.
THE MORAVEC PARADOX, worth knowing because it is
counter-intuitive and keeps being rediscovered: TASKS HUMANS
FIND HARD (chess, integration, medical diagnosis) TURNED OUT TO
BE EASIER FOR MACHINES THAN TASKS HUMANS FIND EFFORTLESS
(walking over uneven ground, recognising a face, understanding
a joke). The explanation is evolutionary: the effortless skills
have had hundreds of millions of years of optimisation and are
implemented in enormous specialised neural hardware we have no
introspective access to, while chess is a few thousand years
old and consciously reasoned. WHAT FEELS SIMPLE IS NOT SIMPLE.
The AI landscape
THE SUBFIELDS, and what each is responsible for:
SEARCH AND PROBLEM SOLVING finding a sequence of actions
reaching a goal (ACtE0902)
KNOWLEDGE REPRESENTATION encoding what is known so it
AND REASONING can be used (ACtE0903)
PLANNING constructing action sequences
under constraints
MACHINE LEARNING improving performance from
experience (ACtE0905)
NATURAL LANGUAGE PROCESSING understanding and generating
language (ACtE0904)
COMPUTER VISION interpreting images
ROBOTICS acting in the physical world
EXPERT SYSTEMS domain-specific reasoning from
an explicit knowledge base
TWO BROAD TRADITIONS, and the modern reconciliation:
SYMBOLIC AI ("classical", or GOFAI β good old-fashioned AI)
Intelligence as the manipulation of explicit symbols and
rules.
β INTERPRETABLE β you can read the rules and see why it
concluded what it did
β needs no data, only knowledge
β handles reasoning, planning and explanation naturally
β BRITTLE at the edges β a case the rules do not cover
produces nonsense
β the KNOWLEDGE ACQUISITION BOTTLENECK: encoding enough
knowledge by hand is enormously laborious
CONNECTIONIST / STATISTICAL AI (neural networks, ACtE0906)
Intelligence as patterns learned from data by adjusting
numerical weights.
β learns from examples, so no hand-coded rules
β tolerant of noise and of cases never explicitly
considered
β excels precisely where symbolic AI fails β perception
β OPAQUE: a 175-billion-parameter model cannot explain
itself, and "why did it decide that?" may have no
answer a human can check
β needs large amounts of data, and inherits whatever bias
the data contains
THE HONEST CURRENT POSITION: the statistical approach has won
decisively on perception and language, while the symbolic
approach retains the advantages of explanation, guarantees and
data-free reasoning. NEURO-SYMBOLIC work attempts to combine
them, and the fact that this remains an open research
direction rather than a solved problem is worth knowing β
the two traditions are not merely rival fashions, they have
complementary strengths.
A NOTE ON WHAT AI IS NOT: a program is not AI merely because it
is complicated, nor because it uses statistics. The useful
informal test is whether the program's behaviour depends on
KNOWLEDGE OR EXPERIENCE rather than on a fixed procedure the
programmer worked out in advance. A payroll system computing
tax by a published formula is not AI; a system inferring which
claims are likely fraudulent from past claims is.
The 8-queens comparison is the most transferable idea in this topic: the same problem is 4.4 billion candidates or 40,320 depending only on how you define a candidate. In AI, choosing the representation is usually a bigger win than choosing the algorithm β and it is the step beginners skip.
π Go further: the Turing test has largely been abandoned as a research target, and the reason is instructive. Modern language models pass casual versions of it routinely while failing at tasks a child manages, so the test turned out to measure fluency rather than intelligence. Its replacements are capability benchmarks β collections of concrete tasks (reasoning, mathematics, code, tool use) with measurable scores β plus adversarial tests deliberately built to resist pattern-matching. The shift from "can it fool a person?" to "what can it actually do?" is exactly the move from the acting-humanly quadrant to the acting-rationally one. Search "beyond the Turing test AI benchmarks".
π‘ Exam angle: reproduce the 2Γ2 grid of the four definitions β thinking/acting humanly, thinking/acting rationally β with what each entails; this is the single most asked question in the section. Describe the Turing test and the four capabilities it requires, and state its objections. Explain why Russell and Norvig prefer acting rationally (more general, more amenable to science). Distinguish strong from weak AI and mention the Chinese Room. Know that rationality is not omniscience or perfection and the four things it depends on. Be able to discuss symbolic versus connectionist AI with the advantages and drawbacks of each.
Syllabus points
Definition of AI
AI perspectives
Create a free account to tick topics off, take notes as you read, watch the video lessons and get a day-by-day study plan built around your exam date.
Related topics in Introduction to AI and Intelligent Agent