Professional Documents
Culture Documents
presented through a specific interface, the user-subject must perform the necessary
function of framing, the process through which incoming stimuli is converted into
symbolic structures that serve to in-form information 3. This understanding of
information positions human perception not as the passive reception of pre-formed
meaning, but as a creative act of simulation. This act of conversion is understood by
the French philosopher Raymond Ruyer to be the function of consciousness itself,
and it is by no means limited to the realm of the digital 4. According to Ruyer, the
subjects perception of images is actually preceded by an act he calls the absolute
survey, a frameless vision-of-sorts that grasps the entirety of the visual field in a
single, temporally instantaneous take. In contrast to the image, the perceived
absolute surface is a nondimensional, subjective image that is only experienced
internally5. In many ways the physiological equivalent of the formless topography of
machinic vision, the absolute surface cannot be represented or conceptualized, but
is instead experienced internally as affection. This sensation, anterior to the
perception of actual information, is then processed qua consciousness. The absolute
surface is virtualized as dimensional forms, oriented in relation to one another
within geometric space. This process of virtualization, or the rendering of the
inchoate absolute surface into an understanding of the subjects orientation in
3 MacKay as quoted in Ibid, 79.
4 In contrast to someone like Kittler, Ruyer believes that information is meaningless
without framing by a human consciousness. Donald MacKay similarly understands
consciousness, stating: Consciousness ,might be introduced in this way: We
might say that the point of area of conscious attention on a field of data is the
point of area under active internal symbolic replication, or evocative of internal
marching response. When a man speaks to another man, the meaning of what he
says is defined by a spectrum over the elementary acts of internal response which
can be evoked in the hearer (MacKay, Information, Mechanism, Meaning, 53 as
quoted in Ibid, 285).
5 Ruyer as quoted in Ibid, 175.
relation to their surroundings, does not merely depend upon the eyes. Vision is by
its nature supramodal; enveloping bodily modalities of proprioception, tactility,
memory and duration, vision is not only separate from the other sense modalities,
but relies in fact on their synergistic synthesis 6. The absolute surface is understood
as thus to be affective. Employed by different theorists for varying purposes, I
understand affectivity as it was initially theorized by Henri Bergson: as a field or
milieu of forces that appears as a sort of permanent and diversified experience of
oneself7. In contrast to perception, which is an inter-subjective, or relatively
objective space, affectivity is a subjective field that does not exist in a strictly
empiricist epistemology.
The French philosopher Gilbert Simondon understands affectivity to mediate
between the individual (the subject in our terms) and the preindividual. The
preindividual is understood by Simondon as that which exceeds the self. Not unlike
the pre-symbolic realm of psychoanalytic theory, or the semiotic chora as it is
understood by Kristeva, the preindividual is felt by the subject as a force of
becoming or a sense of more-than that wells rhythmically across life. Affectivity is
thus the encoding of the preindividual into an amodal representation within the
6 In discussing depth perception, Brian Massumi states: We are not using our eyes
as organs of sight, if by sight we mean the cognitive operation of detecting and
calculating forms at a distance. We are using our eyes as proprioceptors and feelers.
Seeing at a distance is a virtual proximity: a direct, unmediated experience of
potential orientings and touches on an abstract surfaces combining pastness and
futurity. Vision envelops proprioception and tactility . Seeing is never separate
from other sense modalities. It is by nature synesthetic, and synaesthesia is by
nature kinesthetic. Every look reactivates a multi-dimensioned, shifting surface of
experience from which cognitive functions emerge habitually but which is not
reducible to them (Massumi in Sensing the Virtual, Building the Insensible as
quoted in Ibid, 109).
7 Henri Bergson in Matter and Memory, 74 as quoted in Ibid, 226.
body, which is then recoded and recognized by the subject through transference
into the symbolic8. It is often understood as an internal interval, through which the
preindividual is experienced as affects. Brian Massumi posits that this sensation of
more-than derives from the fact that affects are not located within the subjects
body, but instead exist across and between matter. Different from emotions, which
are merely the sociolinguistic, symbolic fixing of affects within the subject, affect is
understood as the sense of a physical system paradoxically embodying multiple and
normally mutually exclusive potentials, of which only one ever occurs. Defined as an
objects relationality autonomized, or, more simply, as the presence of the sum
total of a things interactions minus the thing, affect is the registration of an infinite
range of potential interactions, anchored around the actual physical thing that
embodies them9. Affectivity is thus the accumulation of relative perspectives and
the passages between them, an additive space of utter receptivity retaining and
8 Although this will be explored in more detail below, it may be important to note
that affectivity gives the subject a sense that their being exceeds their body.
Existing processually and relationally, rather than as a fixed form, affectivity is
essentially concerned with vitality, futurity, and creativity: Affectivity is precisely
that mode of bodily experience which mediates between the individual and the
preindividual, the body and its virtual milieu: whereas perception appeals to
structures already constituted in the interior of the individuated being, affectivity
indicates and comprises this relation between the individualized being and
preindividual reality, and appears to bring it something from the exterior, indicating
to the individualized being that it is not a complete and closed set [ensemble] of
reality. As the mode of experience in which the embodied being lives its own
excess, affectivity introduces the power of creativity into the sensorimotor body
(Simondon as quoted in Erin Manning, 8).
9 Affects are virtual synesthetic perspectives anchored in (functionally limited by)
the actually existing, particular things that embody them. The autonomy of affect is
its participation in the virtual. Its autonomy is its openness. Affect is autonomous to
the degree to which it escapes confinement in the particular body whose vitality, or
potential for interaction, it is (Massumi, 35).
combining past movements, in intensity, extracted from their actual terms 10. This
sensation within the body doesnt correspond with any precise image, as its an
experience that exists across forms movement through space (aka time); the
vision of the absolute survey, or the experience of the preindividual, is formless.
Rather than the optical, this type of vision is primarily felt within and across the
body through proprioception. Understood as the sense proper to our muscles and
ligaments, proprioception is an enfolding of tactility (the sense of our skin) into the
body. Experiencing our skin and fleshs physical contact with the external world as
conditions of movement, we form a memory of our bodys relations with the world,
bringing with it the memory of our bodys externalized responses within these
endless interactions11. Affectivity is thus temporally nonlinear: extending into the
past and future, it anticipates the potentialities of the world around us.
Perception, as a function that includes affectivity, is thus the virtualization of the
milieu of the preindividual into forms and the potential relationships that exist
between them.12 Our bodys capacity to translate images into four dimensions
suggests that perception is actually an act of simulation, a process of datarendering that takes place within the body-brain. Virtuality is therefore not a
property inherent to space, but a property that comes into fruition only in the act of
correlating spaces various parts. Nowhere is this more evident than in virtual
reality, which confers the illusion of a geometrically-extended space when in fact
10 Ibid, 57.
11 Ibid, 58-9.
12 The idea of retention and protention are key aspects of Edmund Husserls
phenomenology of temporality, essentially explaining how our perception of the
present incorporates the past and future. (Explain better and direct to some specific
passages)
there is none. In his extended analysis of the pioneering new media artist Jeffrey
Shaw, Mark Hansen illustrates this notion with The Telepresent Onlooker (1995),
which utilizes an early virtual reality interface called EVE (Extended Virtual
Environment), created in collaboration with the ZKM Karlsruhe and the
Forschungszentrum Karlsruhe (Figure 1). Housed inside a large inflatable dome, the viewer
wears 3D glasses and a helmet that identifies the position and angle of her head,
controlling a projector mounted to a robotic arm, as well as a camera, which is
similarly mounted to a robotic arm set-up outside the dome. Projecting stereoscopic
images across the interior surface of the dome, the interface follows the viewers
gaze, both capturing and seamlessly reconstructing the space just outside, which is
presumably also full of other museum-goers. By coupling the viewers movements
with that of the interface, the piece attempts to confer a sense of telepresence,
triggering the virtualization of an actual space that the viewer isnt presently in.
Disjoining media from the bounded-frame of say a photograph or movie screen, The
Telepresent Onlookers machinic components act as an extension of the process of
simulation that underlies and constitutes perception, utilizing the digital images
variability to craft a dynamic coupling of the viewer-users body and a digitallysimulated environment13. Essentially tricking the subject into affectively
experiencing the images as forms, rather than mere representations, virtual reality
dissolves the distance between the subject and the artwork, moving from a
represented reality (which is recognized as being contained within its material
support) to one that is simulated through the viewer-users bodily experience. As
virtual reality continues to be perfected with pieces such as Daniel Steegman
Mangrans lauded Phantom at the New Museums 2015 Tiennial, which utilizes the
13 Ibid, 170.
Oculus Rift virtual-reality headset to transport viewers into the disappearing Mata
Atlntica rain forest it becomes increasingly clear that virtual reality, although it
may interface purely through the audio-visual, is actualized through its engagement
with the entirety of the affective body.
temporal objects within the brain, an endogenous process in which various regions
of the brain synthesize stimuli from across the senses into coherence and
singularity. The body is thus constituted in this second phase through the
virtualization of the subjects interactions with the world over time. Through
processes of retention and protention, the subject understands their various
sensuous relations with the world as constituting a singular self, rather than as
existing as independent relations in their own right.
Duchamps rotoreliefs manifest as patterns or forms, but only momentarily. They
exist transiently, emerging as shapes only as long as the disks movements create
continuity. Endlessly materializing and dematerializing, shifting and transforming,
they confront the viewer, bringing an understanding into awareness that their
forms constitution is a feat of the body-brain. The difficulty of putting this
experience into words seems similar to the difficultly in describing the viewing of
Violas videos. While both suggest that forms are constituted across time, stabilized
in the mind as patterns or as expressions of emotions, they also catalyze the
desublimation of such form through revealing their constituent parts, which, as they
exist in stasis, dissolve into meaninglessness. Through their inversion of the
hierarchy of image over affectivity, these works reject the hylomorphism that
characterizes most art (which is the elevation of form over matter), instead opening
form to the realm of the processual. I understand new media, through its ability to
expand time beyond the 0.3 seconds of human perception, as holding the potential
for a certain kind of experience I posit as abject. This specifically digital kind of
abject art relates to a posthuman sense of time, existing somewhere beyond the
fixed perceptual capacities of human consciousness. Through the exploration of a
digital sense of temporality, certain contemporary artists are subverting the
understanding of the subject as form. But what is it about new media that feels
imitative of the corporeal? What is it about the pulse that makes one aware of
their relationship with their body?
Throughout his work, Hansen holds an interest in how digital technology is
increasingly able to interface with human affectivity. Following the assumption that
media, since the invention of writing, simultaneously diminishes and supplements
the sensory-perceptual and expressive capacities of humans, Hansen recognizes the
opportunity within digital technologies to interface with the affective interval of the
perceived now. Despite the fact that computers are cognitive machines, incapable
of a truly sensuous perception, they are capable of recording the sensuousness of
the human body, reconfiguring the ecology of microsensibilities as data 19. What this
ultimately means is that digital technology, through a machinic sense of
temporality, can accelerate cognition to the pace of human sensibility. This is
described at its most utilitarian in a keynote lecture at Eugene Lang College, in
which Hansen describes Alex Pentlands work at MITs Human Dynamics Laboratory,
as well as the third-generation search engine Recorded Future. Both of these
projects are innovating ways to measure affectivity, either of specific individuals, in
the case of the former, or of the entire internet, in the case of the latter. Pentlands
work is most easily conveyed through a device he and his fellow researchers are
calling a sociometer. About the dimensions of a credit card, the device contains a
microphone and accelerometer, analyzing patterns in movement and speech to
interpret and make claims about non-linguistic forms of communication. The
sociometer is said to be able to decode variations in the tone and pace of a
conversation to accurately predict the outcomes of job interviews, presidential
19 Hansen keynote
debates, or even first dates. I will point out that the leap made by Pentland is found
in his expansion beyond the non-linguistic communication of a single subject,
instead exploring affectivity as it exists within the back-and-forth patterns of
signaling between multiple parties. In his lecture, Hansen particularly emphasizes
its potential use in the workplace as a way to measure and improve the working
dynamics of different groups within a company. Pentland states that these
unconscious, honest signals, the title of his 2010 MIT Press-released book, can be
deciphered in order for us to become better managers, workers, and
communicators20.
This colonization of non-linguistic communication is taken to an even more
dystopian realm by the Swedish intelligence company Recorded Future. Described
by Hansen as a third-generation search engine, Recorded Future is a real-time
threat intelligence company that analyzes billions of events through publicly
available information including news articles, financial reports, tweets, Facebook
posts, blogs, and RSS feeds in order to build a timeline of events that extends into
a predicted future. Funded in its infancy by small-venture capital grants by both
Google and the CIA, the company primarily markets itself around predicting and
preventing threats to a companys cybersecurity 21. Its web intelligence platform,
however, can be employed to process and predict trends in technology, science,
business, politics, media, civil unrest, etc. for use by both corporate and
government bodies. Differing from second-generation search engines, such as
Google or Facebook, which measure direct links or interactions between pages and
users, Recorded Future analyzes implicit links between information. Looking beyond
20 Citation Needed
21 Hansen Fast Forward, 206
22 Ibid, 207.
23 If the biopolitical dimension of Google is widely debated , what is missing is a
bioeconomic analysis to explain how Google extracts value from our life and
transforms the common intellect into network value and wealth. Besides true
concerns, there is an abuse of a Foucaultian paradigm that highlights only one side
of the problem, as Googles power is not given as a metaphysical being but it is
originated from its technological platform and business model . The metaphor of
the Panopticon must be reversed: Google is not simply an apparatus of
dataveillance from above but an apparatus of value production from below
(Matteo Pasquinelli as quoted in Hansen, Feed-Forward 3969)
Further, because the data of sensibility that is captured and fed-forward has no
direct interface with consciousness, our access to this information is necessarily
mediated by technology. The prosthetic basis of media is thus thrown into question,
as our agency in utilizing technologies such as Facebook or Google is not only
limited, but intentionally foregone26. Through its attempts to find patterns and
structures within affect, twenty-first-century media dulls precisely what Whiteheads
ontology of potentiality maintains for human agency. By asserting and enforcing the
stability of human behavior, twenty-first-century media ignores and even hinders
the subjects propensity for newness and change.
Recognizing the reality that these technologies exist, Hansen calls for a
media criticism that champions their employment for non-capitalistic ends. Within
this thesis I hope to extend the notion of abject art into the digital age, employing
this bourgeoning body of theory to champion the works of certain contemporary
artists that are renegotiating and exploring our understanding of the affective body.
Although Feed-Forward does not provide specific examples of what such new media
works would look like, Hansens analyses throughout New Philosophy for New Media
provide a glimpse of what he has in mind. I find his analysis of Alan Dunning and
Paul Woodrows project Einsteins Brain (Errant Eye) (1997-present) to be
particularly salient, particularly considering the works emphasis on both the body,
and our understanding of such as it is constituted through consciousness. Donning a
stereoscopic Head Mounted Display (HMD), participants are wired through
encephalographic, galvanic, and cardio biofeedback to a computer that uses their
physiological output to generate and modify the HMDs images in real time.
Combining a navigable forest landscape with abstract visualizations of the subjects
26 NEED CITATION
internal physiological state, the work attempts to recognize the coupling of the
subjects internal landscape and the external world as it is perceived by the bodybrain. Just as the external world shapes the sensations felt within the body, so does
our sensory experience reciprocally shape the perceived world. In an artist
statement, Dunning and Woodrow state:
In the construction of a dynamic self, the mind attempts to engage the
world(s) beyond appearances. These worlds are in perpetual motion and
unstable transformation, without attributable frames of reference, without
material bodies or finite borders, in constant flux, linking past to future and
memory to prediction. It is as if we are inside ourselves, like a threedimensional eye which constructs itself as it moves through internal haptic
space (188).
Instead of the Lacanian understanding of self as a singular form as viewed from the
outside, the work attempts to catalyze an experience of self that accounts for the
more-than of affectivity. In providing a dynamic representation of self, inextricably
connected to and affected by its surroundings, Einsteins Brain explores the body as
it is sensuously experienced through its relations with the world.
The body is understood less as a self-contained form, but rather as a conduit
of affect. The visualizations of the viewer-users affectivity begin to cohere into a
navigable space; not quite forms, the distortions on the screen act as a
representation of the otherwise non-visual experience of the body. As the viewerusers anxiety increases, for example, the visualizations on the screen appear
jagged and the music becomes more dissonant. The body thus becomes porous and
leaky, constantly affecting and being affected by its surroundings. Not unlike ones
perception of the forest floor after stepping on a snake, the landscape and the body
become interconnected in a reciprocal exchange of affect. The body is recognized
as a milieu of sensations, all experiencing sensations beyond itself. I understand the
Einsteins Brain project as being abject in the sense that it threatens the unity of the
subject. Like the digital sublime, which cannot be resolved through human
consciousness, this digital manifestation of the abject refuses to be abjected.
Instead of presenting an object of ontological uncertainty, which is eventually
objectified by the subject through the act of abjection, this experience of the self
threatens to reveal the illusion behind subject-object ontology altogether. The
abstraction of the body as a singular, unchanging subject no longer seems suitable.
Instead one most confront the heterogeneity of sensations experienced; recognizing
the body as a site for the transduction of affect, of a conversion that takes place
within the body-brain of affect into experience as it is consciously understood.
Digital abject art thus functions as a means of resistance against the
colonization of affect by info-capitalism. While media as employed by the data
industry modulates affectivity to create a more lucrative consumer, digital abject art
lends the modulation of affectivity a distinctly aesthetic dimension. In attempting to
interface with affectivity in a form that is legible to consciousness, Einsteins Brain
allows the user-viewer to open-endedly explore the way the self is affected by its
surroundings, as well as how ones perception of the external world is inflected by
the latent potentialities affectively felt welling within it.