Art, science and the paradoxes of perception

The Orange Problem, 2019, Acrylic on panel, 72 x 72 cm. © Robert Pepperell 2019.
The author

Perception is utterly baffling. We can precisely describe the biological structure of eyes and brains. We can measure the electrochemical impulses and electrical fields generated by neurons. But reason fails us when we attempt to explain how these physical processes cause all the vivid colours, textures and objects that appear in visual perception. In fact, perception is so perplexing that we can find ourselves pushed to the edge of rational thought – and beyond – when we try to understand it.

My recent article in Art & Perception uses works of art to demonstrate that visual perception – and representations of the visual world – involve mind-stretching paradoxes and logical problems. One of the best examples in the history of art is René Magritte’s The Treachery of Images, which insists that we are not seeing what we see.

Magritte’s La Trahison des Images (The Treachery of Images), 1928-9.
University of Alabama

Works of art can reveal the bewildering conceptual conundrums at the heart of apparently straightforward visual experiences of the world. Here are some examples.

The Orange Problem

The painting at the top this article is called The Orange Problem, and the problem it poses is “where is orange?” It is painted with intense, almost fluorescent, pigments that mainly reflect light waves in the 635 to 590 nanometre range of the visible spectrum. But neither the paint nor the light it reflects are actually orange. Surprisingly, the painting as a physical object is colourless – objects reflect only different amounts of light energy. It is our nervous system that interprets these different amounts of energy as the colours we see.

One of the first to appreciate the implications of this was the pioneering neurobiologist Johannes Müller in the early 19th century. He discovered that all qualities of sensation such as colour, flavour, smell or sound are the product of identical electrical impulses travelling through the nervous system. Yet we still have little idea how these impulses create our colour sensations, or indeed if we all experience the same sensations. (The recent controversy over “The Dress” suggests we don’t).

Read more:

So if orange belongs only to our nervous system, then to which part exactly? Cut open a brain, scan it with the best available devices, and you will find no “orange-ness” among the cells and impulses. Paradoxically, the orange of the painting is right in front of us, but is nowhere to be found.

Where are the objects we see?

On the Edge. Gouache on Indian paper, 2019. 30 x 20 cm.
Robert Pepperell, Author provided

You are probably unsure what On the Edge depicts. In the absence of an obvious meaning you may find yourself scrolling through options in your mind, searching for objects that “fit” the clues (is it a sea creature or some kind of cosmic storm?) If so, you are experiencing at a slow pace what usually occurs so quickly that you never notice it. Your visual system is working to match its input with your prior knowledge to arrive at the best guess of what is being seen.

Even before this matching can occur, an enormous amount of processing has already been done by the visual system, in the retinae and in the cortex, to build up a perceptible image from “primitive” elements such as edges, corners and contrasts of colour and brightness.

The fact that the visual system has to do all this work before we can recognise an object shows us that the objects we perceive are not just “there” in the world. They have to be meticulously created within our neurobiology in order to exist for us. But again, cut open a brain, probe its neurons, and you will find no sea creatures or cosmic storms, only electrochemical activity. Objects, like colours, are tangibly real yet are also untraceable figments of the mind – a contradictory state of affairs.

We are the world we see

Drawing drawing. Pencil and gouache on paper, 2011. 40 x 30 cm.
Robert Pepperell, Author provided

In the picture Drawing drawing you see a hand holding a pencil casting a shadow on some paper. But that is not quite true. What you really see are lines and patches of dark and light. We might say that these lines and patches, which are present, conjure up things that are absent. As with all depictions, the objects we see depicted are simultaneously there and not there – which, as Magritte pointed out, is contradictory. “Pictures are paradoxes” said the eminent vision scientist Richard Gregory.

This picture also refers to itself, and to the process of its own making. The pencil lead with which I made the drawing and the paper on which it is drawn are both real lead and paper and representations of themselves.

All this might be dismissed as mere artistic eccentricity were it not for the fact that it exposes a remarkable property of our perceptual faculties. For if we run into logical problems conceiving of how something might be present and absent, or one thing and another simultaneously, we have no trouble perceiving it. Perception seems to take contradiction in its stride.

And, in fact, we must accept that all perception is self-referential. When you or I look at the world we never see it “in itself”, contrary to appearances. What we actually experience is our own perceptual reconstruction of the world. Just as the drawing shows my hand in the act of drawing itself, so perception shows us in the act of perceiving ourselves.

The mind and the world outside

The full sublimity of these problems takes some time to sink in. Unless you are feeling slightly dizzy you are probably not thinking about them hard enough. But if you are interested in how our minds work – and in the relationship between mind and world – then they cannot be avoided. Like it or not, perception and depiction throw up cognitive conundrums that push beyond the limits of conventional logic.

This is something that many artists have intuitively understood, which is why we often find expressions of paradox, contradiction and self-reference in the history of art. Combining such insights into the nature of perception and depiction with the rational investigative tools of science may be helpful – even necessary – if we are to meet the giddying challenge of explaining how we see, and how we see pictures of what we see.The Conversation

This article is republished from The Conversation under a Creative Commons license. Read the original article.


alternative Amanda Palmer Amazon ambient Andrew Elias andy warhol animal farm anna freeman anonymous Anthropocene Anthropology Anxiety Archaeology aristotle ars electronica arse art art news Art therapy Arthur O'Shaughnessy articles artists Arts Arts funding artzine ash audience Austerity australia avant garde Axwell babel bacon Bacteria bame bangalore Barnabe Barnes bat bats BBC BBC charter BBC licence fee BBC television Be Bop Deluxe beardsley bebop beer bengaluru Berlin Berlin Wall Bhutan bigotry Bill Nelson Billy Bragg billy childish Bird conservation Birds Black academics Black history Black History Month 2019 black lives matter blinded by the light blue light Blur Boards Bob Dylan books Boris Johnson bow box sets British art British Empire British Museum Bronze Age BST Byron Camper Van Beethoven cartoon castle Cate le Bon cats cds celery channel charity charlie chaplin chatterley Cheese Cheesemaking childhood rhyme choir Christina Rossetti christmas cinema Classical music Climate change clocks clothing Clubs Cold War collage colonial Comedy Coming up for Air Community competition Composition Coolio coorg Coronavirus Courtney Barnett covid-19 COVID-19 lockdown COVID-19 recovery creative industry creativity Cultural institutions culture curator curious Curious Kids D H Lawrence dada dadaism dale harding dance Dance music Darren Hayman David Bowie david hockney death declan welsh deliveroo democracy Desert locust destruction Diet digital Digital archives DJs Dominic Cummings Dóra Maurer Doris Day download Dr Johnson dream Drenge drums Dumfries dundee Dylan Thomas e-book E. E. Cummings East Germany ECO economics economy Edgar Allan Poe Edinburgh Edna St Vincent Millay Edward Lear electronic Elizabeth Barrett Browning Employment English language Ensemble environment Epicurus Erasure Eric Ravilious Esra Furman essays Ethnic minorities European Research Group Evelyn Ida Morris exhibition extinction rebellion Ezra Furman facebook fanzines fashion Federico García Lorca Feminism Feminism and art festival film folk fontaines dc Fontaines DC Food Food science foot artists France free free russia Future Gare Loch GDP gender inequality George Gascoigne George Harrison George Orwell Gig economy Glasgow Global perspectives GMT Grammar Grayson Perry green issues grenfell Grime grotesque handel happiness Harry Graham hate Heatwave heaven 17 heritage heroes history hogmanay Hollywood homeless Homer Hot Chip humour if you feel it it's real iggy ignorance illustration Inclusive Music Making india indian Indie music Industrial Revolution instagram Interdisciplinarity international labour day international workers day interweb Iron Age Isolation Italy ITV Jack Peñate James Joyce James Taylor janey godley jazz John Cooper Clarke John Keats john Lennon John Linney Journalistic ethics Judi Werthein kara walker Karl Marx Karnataka kat himmel Katharina Garrard (no relation) Katherine Mansfield Keep the Aspidistra Flying keith haring Ken Loach Ken Sprague kensington Kenya Khalil Gibran labour Lamb Language Laurie Anderson les dennis Lewis Carroll lgbtq lgbttqi lights literature live live performance lockdown Locusts london love lucy spraggan lyrics Mae West magazines Malcolm X manchester Martin Niemoeller Marvin Gaye Matthew Arnold may day Maya Angelou McGonagall Meat Meat eaters memorials mental health messiah MGM Michael Sailstorfer Milk Milton mind MISSY HIGGINS Mistakes Mobile apps modern Monty Python moon Museums music music hall Music industry Music therapy music venues Musicals Musicians my map mysore mysuru nanohour national gallery of scotland National Orchestra For All neil finn neon news nhs norfolk norwich Nostalgia Not sure if it's a poem novara media Ocean Colour Scene of course older age Older people Oliver Herford online Opera Orchestras For All Ensemble Ornithology oxfam pain Paramount Pictures Patrick Staff Paul Garrard Paul McCartney Pay gap peace Pensions financial planning people people power perception Performance Philip Larkin photo photography photos picture pitchfork podcasting podcasts poem Poet Laureate poetry Political accountability Political communication Political journalism politics Pop music poster pottery poverty Primal Scream print printing prints Psychasthenia public domain pubs Purple pussy riot quote Race racism radio rainbow Raves RBSA Relaxation religion research Retirement Rewilding Richard Hawley Ringo Starr Robert Burns Robert Frank Robert Herrick Roman Empire Rose Finn-Kelcey Roy Lichtenstein Rudyard Kipling Rutles salad sandalwood satire sayings science scooty Scotland Serpentine sex Shakespears Sister Shelley Shocking Blue Sierra Leone silvery tay sin Sixties Sixties culture sketches Slave Trade Sleaford Mods snippet Snow Patrol social media socialism soundscape sparks Species reintroductions springsteen stained glass stand up comedy Stanley Spencer Steve Knightley Stewart Lee stratford-upon-avon streaming Strypes stuff style Swinging Sixties Switzerland Sybil Andrews Sydney Smith taking back control tapes tate tay Techno music Telegram Tennyson the arts The Beatles The Clergyman's Daughter The Jam The National Gallery The Only Ones The Pocket Gods Theatre thing time tips toilet humour tories traffic trains Transatlantic slave trade Trumbull Stickney trump Turner Prize tv twitter type Uber UK comedy UK culture UK economy UK election 2019 uk music UK politics UK pop music UK theatre UKIP understanding Unemployment unfinished unions Universities unknown author US movies valie export Van Gogh Veganism Vegetarianism Victorians video Vijaya Vitthala Temple vinyl Voter registration Voting W B Yeats wanted war Wassily Kandinsky water Wellbeing Welsh poetry Wendy Cope West Germany Wetlands WH Auden whales what is art WhatsApp Wildfire Wilfred Owen William Blake William Shakespeare William Wordsworth Wilson Keppel and Betty Wolfy O'Hare women women academics Women in film woody guthrie Wordsworth working from home Writing yeah yeah yeahs Young Composer Youth Orchestra youtube Zero-hour contracts zines Zoom
Show more