The Operations 오퍼레이션 = 인터페이스의 상위에서 벌어지고 있는 기술의 단계, 즉 응용소프트웨어 프로그램에 공통된 일반적 기술이나 명령어 = 컴퓨터 데이터를 처리하는 방식이면서 동시에 컴퓨터 시대에 일하고 생각하고 존재하는 방식 : 하드웨어와 소프트웨어로 실현되기 전에 개념으로서 존재
"사회와 소프트웨어 사용과 설계 사이의 의사소통은 양방향으로 진행된다."
- 생산자와 사용자가 중복되는 경우가 급속도로 증가 eg. 게임 패치
* 선택 Selection - Menus, Filters, Plug-ins : 메뉴에서의 선택이 순수 창조를 대신 : 전자 미디어와 디지털 미디어에서 예술 창작은 기성의 요소들에서 선택하는 것을 의미한다. : 뉴미디어는 미리 정의된 수많은 메뉴에서 가치를 선택하는 사회의 정체성 논리를 가장 잘 표현해준다.
* 합성 Compositing : 합성의 결과는 가상공간이다. : (합성과 선택 사이의) 상호작용은 뉴미디어 객체가 여러 배율로 모듈식으로 구성되었기에 가능해졌다. : 요소들은 생산과정 전반에 걸쳐 개별적인 정체성을 유지하기 때문에 쉽게 수정되고 대체되고 삭제된다. - 모듈성 - 연속성
* 원격행위 Teleaction <= 원격현전 : 물리적인 현실을 실시간으로 조작할 수 있는 능력을 제공 : 원격현전의 본질은 반존재 anti-presence이다. - 원격통신: 전자 원격통신 + 컴퓨터 => 신호로 실시간 객체 조종
The privileged role played by the manual
construction of images in digital cinema is one example of a larger
trend: the return of pre-cinematic moving images techniques.
Marginalized by the twentieth century institution of live action
narrative cinema which relegated them to the realms of animation and
special effects, these techniques reemerge as the foundation of digital
filmmaking. What was supplemental to cinema becomes its norm; what was
at its boundaries comes into the center. Digital media returns to us
the repressed of the cinema. Moving image culture is being redefined
once again; the cinematic realism is being displaced from being its
dominant mode to become only one option among many.
Cinema, the Art of the Index
Thus far, most discussions of cinema in the digital age have focused on
the possibilities of interactive narrative. It is not hard to
understand why: since the majority of viewers and critics equate cinema
with storytelling, digital media is understood as something which will
let cinema tell its stories in a new way. Yet as exciting as the ideas
of a viewer participating in a story, choosing different paths through
the narrative space and interacting with characters may be, they only
address one aspect of cinema which is neither unique nor, as many will
argue, essential to it: narrative.
The challenge which digital media poses to cinema
extends far beyond the issue of narrative. Digital media redefines the
very identity of cinema. In a symposium which took place in Hollywood
in the Spring of 1996, one of the participants
provocatively referred to movies as "flatties" and to human actors as
"organics" and "soft fuzzies." As these terms accurately suggest, what
used to be cinema's defining characteristics have become just the
default options, with many others available. When one can "enter" a
virtual three-dimensional space, to view flat images projected on the
screen is hardly the only option. When, given enough time and money,
almost everything can be simulated in a computer, to film physical
reality is just one possibility.
This "crisis" of cinema's identity also affects the terms and the
categories used to theorize cinema's past. French film theorist Christian Metz
wrote in the 1970s that "Most films shot today, good or bad, original
or not, 'commercial' or not, have as a common characteristic that they
tell a story; in this measure they all belong to one and the same
genre, which is, rather, a sort of 'super-genre' ['sur-genre']."
In identifying fictional films as a "super-genre' of twentieth century
cinema, Metz did not bother to mention another characteristic of this
genre because at that time it was too obvious: fictional films are live action
films, i.e. they largely consist of unmodified photographic recordings
of real events which took place in real physical space. Today, in the
age of computer simulation and digital compositing, invoking this
characteristic becomes crucial in defining the specificity of twentieth
century cinema. From the perspective of a future historian of visual
culture, the differences between classical Hollywood films, European
art films and avant-garde films (apart from abstract ones) may appear
less significance than this common feature: that they relied on
lens-based recordings of reality. This essay is concerned with the
effect of the so-called digital revolotution on cinema as defined by
its "super genre" as fictional live action film.
During cinema's history, a whole repertoire of
techniques (lighting, art direction, the use of different film stocks
and lens, etc.) was developed to modify the basic record obtained by a
film apparatus. And yet behind even the most stylized cinematic images
we can discern the bluntness, the sterility, the banality of early
nineteenth century photographs. No matter how complex its stylistic
innovations, the cinema has found its base in these deposits of
reality, these samples obtained by a methodical and prosaic process.
Cinema emerged out of the same impulse which engendered naturalism,
court stenography and wax museums. Cinema is the art of the index; it
is an attempt to make art out of a footprint.
Even for Andrey Tarkovsky, film-painter par
excellence, cinema's identity lay in its ability to record reality.
Once, during a public discussion in Moscow sometime in the 1970s he was
asked the question as to whether he was interested in making abstract
films. He replied that there can be no such thing. Cinema's most basic
gesture is to open the shutter and to start the film rolling, recording
whatever happens to be in front of the lens. For Tarkovsky, an abstract
cinema is thus impossible.
But what happens to cinema's indexical identity if it is now possible
to generate photorealistic scenes entirely in a computer using 3-D
computer animation; to modify individual frames or whole scenes with
the help a digital paint program; to cut, bend, stretch and stitch
digitized film images into something which has perfect photographic
credibility, although it was never actually filmed?
This essay will address the meaning of these changes
in the filmmaking process from the point of view of the larger cultural
history of the moving image. Seen in this context, the manual
construction of images in digital cinema represents a return to
nineteenth century pre-cinematic practices, when images were
hand-painted and hand-animated. At the turn of the twentieth century,
cinema was to delegate these manual techniques to animation and define
itself as a recording medium. As cinema enters the digital age, these
techniques are again becoming the commonplace in the filmmaking
process. Consequently, cinema can no longer be clearly distinguished
from animation. It is no longer an indexical media technology but,
rather, a sub-genre of painting.
A Brief Archeology of Moving Pictures
As testified by its original names (kinetoscope, cinematograph, moving
pictures), cinema was understood, from its birth, as the art of motion,
the art which finally succeeded in creating a convincing illusion of
dynamic reality. If we approach cinema in this way (rather than the art
of audio-visual narrative, or the art of a projected image, or the art
of collective spectatorship, etc.), we can see it superseding previous
techniques for creating and displaying moving images.
These earlier techniques shared a number of common
characteristics. First, they all relied on hand-painted or hand-drawn
images. The magic lantern slides were painted at least until the 1850s;
so were the images used in the Phenakistiscope, the Thaumatrope, the
Zootrope, the Praxinoscope, the Choreutoscope and numerous other
nineteenth century pro-cinematic devices. Even Muybridge's celebrated Zoopraxiscope lectures of the 1880s featured not actual photographs but colored drawings painted after the photographs.
Zoopraxiscope
Not only were the images created manually, they were also manually animated. In Robertson's Phantasmagoria,
which premiered in 1799, magic lantern operators moved behind the
screen in order to make projected images appear to advance and
withdraw. More often, an exhibitor used only his hands, rather than his
whole body, to put the images into motion. One animation technique
involved using mechanical slides consisting of a number of layers. An exhibitor
would slide the layers to animate the image. Another technique was to
slowly move a long slide containing separate images in front of a magic
lantern lens. Nineteenth century optical toys enjoyed in private homes
also required manual action to create movement -- twirling the strings
of the Thaumatrope, rotating the Zootrope's cylinder, turning the
Viviscope's handle.
Kinetoscope 1894
It was not until the last decade of the nineteenth
century that the automatic generation of images and their automatic
projection were finally combined. A mechanical eye became coupled with
a mechanical heart; photography met the motor. As a result, cinema - a
very particular regime of the visible - was born. Irregularity,
non-uniformity, the accident and other traces of the human body, which
previously inevitably accompanied moving image exhibitions, were
replaced by the uniformity of machine vision.
A machine, which like a conveyer belt, was now spitting out images, all
sharing the same appearance, all the same size, all moving at the same
speed, like a line of marching soldiers.
Cinema also eliminated the discrete character of
both space and movement in moving images. Before cinema, the moving
element was visually separated from the static background as with a
mechanical slide show or Reynaud's Praxinoscope Theater (1892). The
movement itself was limited in range and affected only a clearly
defined figure rather than the whole image. Thus, typical actions would
include a bouncing ball, a raised hand or eyes, a butterfly moving back
and forth over the heads of fascinated children -- simple vectors
charted across still fields.
Cinema's most immediate predecessors share something else. As the
nineteenth-century obsession with movement intensified, devices which
could animate more than just a few images became increasingly popular.
All of them - the Zootrope, the Phonoscope, the Tachyscope, the
Kinetoscope - were based on loops, sequences of images featuring
complete actions which can be played repeatedly. The Thaumatrope
(1825), in which a disk with two different images painted on each face
was rapidly rotated by twirling a strings attached to it, was in its
essence a loop in its most minimal form: two elements replacing one
another in succession. In the Zootrope
(1867) and its numerous variations, approximately a dozen images were
arranged around the perimeter of a circle. The Mutoscope, popular in
America throughout the 1890s, increased the duration of the loop by
placing a larger number of images radially on an axle. Even Edison's
Kinetoscope (1892-1896), the first modern cinematic machine to employ
film, continued to arrange images in a loop. 50 feet of film translated
to an approximately 20 second long presentation - a genre whose
potential development was cut short when cinema adopted a much longer
narrative form.
From Animation to Cinema
Once the cinema was stabilized as a technology, it cut all references
to its origins in artifice. Everything which characterized moving
pictures before the twentieth century - the manual construction of
images, loop actions, the discrete nature of space and movement - all
of this was delegated to cinema's bastard relative, its supplement, its
shadow - animation. Twentieth century animation became a depository for
nineteenth century moving image techniques left behind by cinema.
The opposition between the styles of animation and
cinema defined the culture of the moving image in the twentieth
century. Animation foregrounds its artificial character, openly
admitting that its images are mere representations. Its visual language
is more aligned to the graphic than to the photographic. It is discrete
and self-consciously discontinuous: crudely rendered characters moving
against a stationary and detailed background; sparsely and irregularly
sampled motion (in contrast to the uniform sampling of motion by a film
camera -- recall Jean-Luc Godard's definition of cinema as "truth 24
frames per second"), and finally space constructed from separate image
layers.
In contrast, cinema works hard to erase any traces of its own
production process, including any indication that the images which we
see could have been constructed rather than recorded. It denies that
the reality it shows often does not exist outside of the film image,
the image which was arrived at by photographing an already impossible
space, itself put together with the use of models, mirrors, and matte
paintings, and which was then combined with other images through
optical printing. It pretends to be a simple recording
of an already existing reality - both to a viewer and to itself.
Cinema's public image stressed the aura of reality "captured" on film,
thus implying that cinema was about photographing what existed before
the camera, rather than "creating the 'never-was' "
of special effects. Rear projection and blue screen photography, matte
paintings and glass shots, mirrors and miniatures, push development,
optical effects and other techniques which allowed filmmakers to
construct and alter the moving images, and thus could reveal that
cinema was not really different from animation, were pushed to cinema's periphery by its practitioners, historians and critics.
Today, with the shift to digital media, these marginalized techniques move to the center.
What is Digital Cinema?
A visible sign of this shift is the new role which computer generated special effects have come to play in Hollywood
industry in the last few years. Many recent blockbusters have been
driven by special effects; feeding on their popularity. Hollywood has
even created a new-mini genre of "The Making of..." videos and books
which reveal how special effects are created.
I will use special effects from few recent Hollywood
films for illustrations of some of the possibilities of digital
filmmaking. Until recently, Hollywood studios were the only ones who
had the money to pay for digital tools and for the labor involved in
producing digital effects. However, the sbift to digital media affects
not just Hollywood, but filmmaking as a whole. As traditional film
technology is universally being replaced by digital technology, the
logic of the filmmaking process is being redefined. What I describe
below are the new principles of digital filmmaking which are equally
valid for individual or collective film productions, regardless of
whether they are using the most expensive professional hardware and
software or its amateur equivalents.
Consider, then, the following principles of digital filmmaking:
1. Rather than filming physical reality it
is now possible to generate film-like scenes directly in a computer
with the help of 3-D computer animation. Therefore, live action footage
is displaced from its role as the only possible material from which the
finished film is constructed.
2. Once live action footage is digitized
(or directly recorded in a digital format), it loses its privileged
indexical relationship to pro-filmic reality. The computer does not
distinguish between an image obtained through the photographic lens, an
image created in a paint program or an image synthesized in a 3-D
graphics package, since they are made from the same material - pixels.
And pixels, regardless of their origin, can be easily altered,
substituted one for another, and so on. Live action footage is reduced
to be just another graphic, no different than images which were created manually.
3. If live action footage was left intact
in traditional filmmaking, now it functions as raw material for further
compositing, animating and morphing. As a result, while retaining
visual realism unique to the photographic process, film obtains the
plasticity which was previously only possible in painting or animation.
To use the suggestive title of a popular morphing software, digital
filmmakers work with "elastic reality." For example, the opening shot
of Forest Gump (Robert Zemeckis, Paramount
Pictures, 1994; special effects by Industrial Light and Magic) tracks
an unusually long and extremely intricate flight of a feather. To
create the shot, the real feather was filmed against a blue background
in different positions; this material was then animated and composited
against shots of a landscape. The result: a new kind of realism, which
can be described as "something which looks is intended to look exactly
as if it could have happened, although it really could not."
4. Previously, editing and special effects
were strictly separate activities. An editor worked on ordering
sequences of images together; any intervention within an image was
handled by special effects specialists. The computer collapses this
distinction. The manipulation of individual images via a paint program
or algorithmic image processing becomes as easy as arranging sequences
of images in time. Both simply involve "cut and paste." As this basic
computer command exemplifies, modification of digital images (or other
digitized data) is not sensitive to distinctions of time and space or
of differences of scale. So, re-ordering sequences of images in time,
compositing them together in space, modifying parts of an individual
image, and changing individual pixels become the same operation,
conceptually and practically.
5. Given the preceding principles, we can define digital film in this way:
digital film = live action material + painting + image processing +
compositing + 2-D computer animation + 3-D computer animation
Live action material can either be recorded
on film or video or directly in a digital format. Painting, image
processing and computer animation refer to the processes of modifying
already existent images as well as creating new ones. In fact, the very
distinction between creation and modification, so clear in film-based
media (shooting versus darkroom processes in photography, production
versus post-production in cinema) no longer applies to digital cinema, since each image, regardless of its origin, goes through a number of programs before making it to the final film.
Let us summarize the principles discussed thus far.
Live action footage is now only raw material to be manipulated by hand:
animated, combined with 3-D computer generated scenes and painted over.
The final images are constructed manually from different elements; and
all the elements are either created entirely from scratch or modified
by hand.
We can finally answer the question "what is digital
cinema?" Digital cinema is a particular case of animation which uses
live action footage as one of its many elements.
This can be re-read in view of the history of the
moving image sketched earlier. Manual construction and animation of
images gave birth to cinema and slipped into the margins...only to
re-appear as the foundation of digital cinema. The history of the
moving image thus makes a full circle. Born from animation, cinema pushed animation to its boundary, only to become one particular case of animation in the end.
The relationship between "normal" filmmaking and
special effects is similarly reversed. Special effects, which involved
human intervention into machine recorded footage and which were
therefore delegated to cinema's periphery throughout its history,
become the norm of digital filmmaking.
The same applies for the relationship between
production and post-production. Cinema traditionally involved arranging
physical reality to be filmed though the use of sets, models, art
direction, cinematography, etc. Occasional manipulation of recorded
film (for instance, through optical printing) was negligible compared
to the extensive manipulation of reality in front of a camera. In
digital filmmaking, shot footage is no longer the final point but just
raw material to be manipulated in a computer where the real
construction of a scene will take place. In short, the production
becomes just the first stage of post-production.
The following examples illustrate this shift from
re-arranging reality to re-arranging its images. From the analog era:
for a scene in Zabriskie Point
(1970), Michaelangelo Antonioni, trying to achieve a particularly
saturated color, ordered a field of grass to be painted. From the
digital era: to create the launch sequence in Apollo 13y
(Universal Studious, 1995; special effects by Digital Domain), the crew
shot footage at the original location of the launch at Cape Canaveral.
The artists at Digital Domain scanned the film and altered it on
computer workstations, removing recent building construction, adding
grass to the launch pad and painting the skies to make them more
dramatic. This altered film was then mapped onto 3D planes to create a
virtual set which was animated to match a 180-degree dolly movement of
a camera following a rising rocket.
The last example brings us to yet another
conceptualization of digital cinema - as painting. In his book-length
study of digital photography, William J. Mitchell
focuses our attention on what he calls the inherent mutability of a
digital image: "The essential characteristic of digital information is
that it can be manipulated easily and very rapidly by computer. It is
simply a matter of substituting new digits for old... Computational
tools for transforming, combining, altering, and analyzing images are
as essential to the digital artist as brushes and pigments to a
painter." As Mitchell points out, this inherent mutability erases the
difference between a photograph and a painting. Since a film is a
series of photographs, it is appropriate to extend Mitchell's argument
to digital film. With an artist being able to easily manipulate
digitized footage either as a whole or frame by frame, a film in a
general sense becomes a series of paintings.
Hand-painting digitized film frames, made possible
by a computer, is probably the most dramatic example of the new status
of cinema. No longer strictly locked in the photographic, it opens
itself towards the painterly. It is also the most obvious example of
the return of cinema to its nineteenth century origins - in this case,
to hand-crafted images of magic lantern slides, the Phenakistiscope,
the Zootrope.
We usually think of computerization as automation, but here the result
is the reverse: what was previously automatically recorded by a camera
now has to be painted one frame at a time. But not just a dozen images,
as in the nineteenth century, but thousands and thousands. We can draw
another parallel with the practice, common in the early days of silent
cinema, of manually tinting film frames in different colors according
to a scene's mood.
Today, some of the most visually sophisticated
digital effects are often achieved using the same simple method:
painstakingly altering by hand thousands of frames. The frames are
painted over either to create mattes ("hand drawn matte extraction") or
to directly change the images, as, for instance, in Forest Gump,
where President Kennedy was made to speak new sentences by altering the
shape of his lips, one frame at a time. In principle, given enough time
and money, one can create what will be the ultimate digital film:
90 minutes, i.e., 129600 frames completely painted by hand from
scratch, but indistinguishable in appearance from live photography.
Multimedia as "Primitive" Digital Cinema
3-D animation, compositing, mapping, paint retouching: in commercial
cinema, these radical new techniques are mostly used to solve technical
problems while traditional cinematic language is preserved unchanged.
Frames are hand-painted to remove wires which supported an actor during
shooting; a flock of birds is added to a landscape; a city street is
filled with crowds of simulated extras. Although most Hollywood releases now involve digitally manipulated scenes, the use of computers is always carefully hidden.
Commercial narrative cinema still continues to hold on to the classical realist style
where images function as unretouched photographic records of some
events which took place in front of the camera. Cinema refuses to give
up its unique cinema-effect, an effect which, according to Christian Metz's
penetrating analysis made in the 1970s, depends upon narrative form,
the reality effect and cinema's architectural arrangement all working
together.
Towards the end of his essay, Metz wonders whether
in the future non-narrative films may become more numerous; if this
happens, he suggests that cinema will no longer need to manufacture its
reality effect. Electronic and digital media have already brought about
this transformation. Beginning in the 1980s, new cinematic forms have
emerged which are not linear narratives, which are exhibited on a
television or a computer screen, rather than in a movie theater - and
which simultaneously give up cinematic realism.
What are these forms? First of all, there is the
music video. Probably not by accident, the genre of music video came
into existence exactly at the time when electronic video effects
devices were entering editing studios. Importantly, just as music
videos often incorporate narratives within them, but are not linear
narratives from start to finish, they rely on film (or video) images,
but change them beyond the norms of traditional cinematic realism. The
manipulation of images through hand-painting and image processing,
hidden in Hollywood cinema, is brought into the open on a television
screen. Similarly, the construction of an image from heterogeneous
sources is not subordinated to the goal of photorealism but functions
as a aesthetic strategy. The genre of music video has been a laboratory
for exploring numerous new possibilities of manipulating photographic
images made possible by computers -- the numerous points which exist in
the space between the 2-D and the 3-D, cinematography and painting,
photographic realism and collage. In short, it is a living and
constantly expanding textbook for digital cinema.
A detailed analysis of the evolution of music video
imagery (or, more generally, broadcast graphics in the electronic age)
deserves a separate treatment and I will not try to take it up here.
Instead, I will discuss another new cinematic non-narrative form,
CD-ROM games, which, in contrast to music video, relied on the computer
for storage and distribution from the very beginning. And, unlike music
video designers who were consciously pushing traditional film or video
images into something new, the designers of CD-ROMs arrived at a new
visual language unintentionally while attempting to emulate traditional
cinema.
In the late 1980s, Apple began to promote the
concept of computer multimedia; and in 1991 it released QuickTime
software to enable an ordinary personal computer to play movies.
However, for the next few years the computer did not perform its new
role very well. First, CD-ROMs could not hold anything close to the
length of a standard theatrical film. Secondly, the computer would not
smoothly play a movie larger than the size of a stamp. Finally, the
movies had to be compressed, degrading their visual appearance. Only in
the case of still images was the computer able to display
photographic-like detail at full screen size.
Because of these particular hardware limitations,
the designers of CD-ROMs had to invent a different kind of cinematic
language in which a range of strategies, such as discrete motion,
loops, and superimposition, previously used in nineteenth century
moving image presentations, in twentieth century animation, and in the
avant-garde tradition of graphic cinema, were applied to photographic
or synthetic images. This language synthesized cinematic illusionism
and the aesthetics of graphic collage, with its characteristic
heterogeneity and discontinuity. The photographic and the graphic,
divorced when cinema and animation went their separate ways, met again
on a computer screen.
The graphic also met the cinematic. The designers of
CD-ROMs were aware of the techniques of twentieth century
cinematography and film editing, but they had to adopt these techniques
both to an interactive format and to hardware limitations. As a result,
the techniques of modern cinema and of nineteenth century moving image
have merged in a new hybrid language.
We can trace the development of this language by analyzing a few well-known CD-ROM titles. The best selling game Myst
(Broderbund, 1993) unfolds its narrative strictly through still images,
a practice which takes us back to magic lantern shows (and to Chris
Marker's La Jetée). But in other ways Myst
relies on the techniques of twentieth century cinema. For instance, the
CD-ROM uses simulated camera turns to switch from one image to the
next. It also employs the basic technique of film editing to
subjectively speed up or slow down time. In the course of the game, the
user moves around a fictional island by clicking on a mouse. Each click
advances a virtual camera forward, revealing a new view of a 3-D
environment. When the user begins to descend into the underground
chambers, the spatial distance between the points of view of each two
consecutive views sharply decreases. If before the user was able to
cross a whole island with just a few clicks, now it takes a dozen
clicks to get to the bottom of the stairs! In other words, just as in
traditional cinema, Myst slows down time to create suspense and tension.
In Myst, miniature animations are sometimes embedded within the still images. In the next best-selling CD-ROM 7th Guest
(Virgin Games, 1993), the user is presented with video clips of live
actors superimposed over static backgrounds created with 3-D computer
graphics. The clips are looped, and the moving human figures clearly
stand out against the backgrounds. Both of these features connect the
visual language of 7th Guest to nineteenth century pro-cinematic devices and twentieth century cartoons rather than to cinematic verisimilitude. But like Myst, 7th Guest
also evokes distinctly modern cinematic codes. The environment where
all action takes place (an interior of a house) is rendered using a
wide angle lens; to move from one view to the next a camera follows a
complex curve, as though mounted on a virtual dolly.
Next, consider the CD-ROM Johnny Mnemonic
(Sony Imagesoft, 1995). Produced to complement the fiction film of the
same title, marketed not as a "game" but as an "interactive movie," and
featuring full screen video throughout, it comes closer to cinematic
realism than the previous CD-ROMs - yet it is still quite distinct from
it. With all action shot against a green screen and then composited
with graphic backgrounds, its visual style exists within a space
between cinema and collage.
It would be not entirely inappropriate to read this
short history of the digital moving image as a teleological development
which replays the emergence of cinema a hundred years earlier. Indeed,
as computers' speed keeps increasing, the CD-ROM designers have been
able to go from a slide show format to the superimposition of small
moving elements over static backgrounds and finally to full-frame
moving images. This evolution repeats the nineteenth century
progression: from sequences of still images (magic lantern slides
presentations) to moving characters over static backgrounds (for
instance, in Reynaud's Praxinoscope Theater) to full motion (the
Lumieres' cinematograph). Moreover, the introduction of QuickTime in
1991 can be compared to the introduction of the Kinetoscope in 1892:
both were used to present short loops, both featured the images
approximately two by three inches in size, both called for private
viewing rather than collective exhibition. Finally, the Lumieres' first
film screenings of 1895 which shocked their audiences with huge moving
images found their parallel in 1995 CD-ROM titles where the moving
image finally fills the entire computer screen. Thus, exactly a hundred
years after cinema was officially "born," it was reinvented on a
computer screen.
But this is only one reading. We no longer think of
the history of cinema as a linear march towards only one possible
language, or as a progression towards more and more accurate
verisimilitude. Rather, we have come to see its history as a succession
of distinct and equally expressive languages, each with its own
aesthetic variables, each new language closing off some of the
possibilities of the previous one -- a cultural logic not dissimilar to
Kuhn's analysis of scientific paradigms. Similarly, instead of
dismissing visual strategies of early multimedia titles as a result of
technological limitations, we may want to think of them as an
alternative to traditional cinematic illusionism, as a beginning of
digital cinema's new language.
For the computer/entertainment industry, these
strategies represent only a temporary limitation, an annoying drawback
that needs to be overcome. This is one important difference between the
situation at the end of the nineteenth and the end of the twentieth
centuries: if cinema was developing towards the still open horizon of
many possibilities, the development of commercial multimedia, and of
corresponding computer hardware (compression boards, storage formats
such as Digital Video Disk), is driven by a clearly defined goal: the
exact duplication of cinematic realism. So if a computer screen, more
and more, emulates cinema's screen, this not an accident but a result
of conscious planning.
The Loop
A number of artists, however, have approached these strategies not as
limitations but as a source of new cinematic possibilities. As an
example, I will discuss the use of the loop in Jean-Louis Boissier's Flora petrinsularis (1993) and Natalie Bookchin's The Databank of the Everyday (1996).
As already mentioned, all nineteenth century
pro-cinematic devices, up to Edison's Kinetoscope, were based on short
loops. As "the seventh art" began to mature, it banished the loop to
the low-art realms of the instructional film, the pornographic
peep-show and the animated cartoon. In contrast, narrative cinema has
avoided repetitions; as modern Western fictional forms in general, it
put forward a notion of human existence as a linear progression through
numerous unique events.
Cinema's birth from a loop form was reenacted at
least once during its history. In one of the sequences of the
revolutionary Soviet montage film, A Man with a Movie Camera
(1929), DzigaVertov shows us a cameraman standing in the back of a
moving automobile. As he is being carried forward by an automobile, he
cranks the handle of his camera. A loop, a repetition, created by the
circular movement of the handle, gives birth to a progression of events
-- a very basic narrative which is also quintessentially modern: a
camera moving through space recording whatever is in its way. In what
seems to be a reference to cinema's primal scene, these shots are
intercut with the shots of a moving train. Vertov even re-stages the
terror which Lumieres's film supposedly provoked in its audience; he
positions his camera right along the train track so the train runs over
our point of view a number of times, crushing us again and again.
Early digital movies share the same limitations of
storage as nineteenth century pro-cinematic devices. This is probably
why the loop playback function was built into QuickTime interface, thus
giving it the same weight as the VCR-style "play forward" function. So,
in contrast to films and videotapes, QuickTime movies are supposed to
be played forward, backward or looped. Flora petrinsularis realizes some of the possibilities contained in the loop form, suggesting a new temporal aesthetics for digital cinema.
The CD-ROM, which is based on Rousseau's Confessions,
opens with a white screen, containing a numbered list. Clicking on each
item leads us to a screen containing two frames, positioned side by
side. Both frames show the same video loop but are slightly offset from
each other in time. Thus, the images appearing in the left frame
reappear in a moment on the right and vice versa, as though an
invisible wave is running through the screen. This wave soon becomes
materialized: when we click on one of the frames we are taken to a new
screen showing a loop of a rhythmically vibrating water surface. As
each mouse click reveals another loop, the viewer becomes an editor,
but not in a traditional sense. Rather than constructing a singular
narrative sequence and discarding material which is not used, here the
viewer brings to the forefront, one by one, numerous layers of looped
actions which seem to be taking place all at once, a multitude of
separate but co-existing temporalities. The viewer is not cutting but
re-shuffling. In a reversal of Vertov's sequence where a loop generated
a narrative, viewer's attempt to create a story in Flora petrinsularis leads to a loop.
The loop which structures Flora petrinsularis
on a number of levels becomes a metaphor for human desire which can
never achieve resolution. It can be also read as a comment on cinematic
realism. What are the minimal conditions necessary to create the
impression of reality? As Boissier demonstrates, in the case of a field
of grass, a close-up of a plant or a stream, just a few looped frames
become sufficient to produce the illusion of life and of linear time.
Steven Neale
describes how early film demonstrated its authenticity by representing
moving nature: "What was lacking [in photographs] was the wind, the
very index of real, natural movement. Hence the obsessive contemporary
fascination, not just with movement, not just with scale, but also with
waves and sea spray, with smoke and spray." What for early cinema was
its biggest pride and achievement -- a faithful documentation of
nature's movement - becomes for Boissier a subject of ironic and
melancholic simulation. As the few frames are looped over and over, we
see blades of grades shifting slightly back and forth, rhythmically
responding to the blow of non-existent wind which is almost
approximated by the noise of a computer reading data from a CD-ROM.
Something else is being simulated here as well,
perhaps unintentionally. As you watch the CD-ROM, the computer
periodically staggers, unable to maintain consistent data rate. As a
result, the images on the screen move in uneven bursts, slowing and
speeding up with human-like irregularity. It is as though they are
brought to life not by a digital machine but by a human operator,
cranking the handle of the Zootrope a century and a half ago ...
If Flora petrinsularis uses the loop to comment on cinema's visual realism, The Databank of the Everyday
suggests that the loop can be a new narrative form appropriate for the
computer age. In her ironic manifesto which parodies the avant-garde
manifestos from the earlier part of the century, Bookchin reminds us
that the loop gave birth not only to cinema but also to computer
programming. Programming involves altering the linear flow of data
through control structures, such as "if/then" and "repeat/while"; the
loop is the most elementary of these control structures.
As digital media replaces film and photography, it is only
logical that the computer program's loop should replace photography's
frozen moment and cinema's linear narrative. The Databank champions the
loop as a new form of digital storytelling; there is no true beginning
or end, only a series of the loops with their endless repetitions,
halted by a users's selection or a power shortage. Natalie Bookchin
The computer program's loop makes its first "screen debut" in one particularly effective image from The Databank of the Everyday.
The screen is divided into two frames, one showing a video loop of a
woman shaving her leg, another - a loop of a computer program in
execution. Program statements repeating over and over mirror the
woman's arm methodically moving back and forth. This image represents
one of the first attempts in computer art to apply a Brechtian
strategy; that is, to show the mechanisms by which the computer
produces its illusions as a part of the artwork. Stripped of its usual
interface, the computer turns out to be another version of Ford's
factory, with a loop as its conveyer belt.
As Boissier, Bookchin also also explores
alternatives to cinematic montage, in her case replacing its
traditional sequential mode with a spatial one. Ford's assembly line
relied on the separation of the production process into a set of
repetitive, sequential, and simple activities. The same principle made
computer programming possible: a computer program breaks a tasks into a
series of elemental operations to be executed one at a time. Cinema
followed this principle as well: it replaced all other modes of
narration with a sequential narrative, an assembly line of shots which
appear on the screen one at a time. A sequantial narrative turned out
to be particularly incompatible with a spatialized narrative which
played a prominent role in European visual culture for centuries. From
Giotto's fresco cycle at Capella degli Scrovegni in Padua to Courbet's A Burial at Ornans,
artists presented a multitude of separate events (which sometimes were
even separated by time) within a single composition. In contrast to
cinema's narrative, here all the "shots" were accessible to a viewer at
one.
Cinema has elaborated complex techniques of montage
between different images replacing each other in time; but the
possibility of what can be called "spatial montage" between
simultaneously co-exiting images were not explored. The Databank of the Everyday
begins to explore this direction, thus opening up again the tradition
of spatialized narrative suppressed by cinema. In one section we are
presented with a sequence of pairs of short clips of everyday actions
which function as antonyms, for instance, opening and closing a door,
or pressing up and down buttons in an elevator. In another section the
user can choreograph a number of miniature actions appearing in small
windows positioned throughout the screen.
From Kino-Eye to Kino-Brush
In the twentieth century, cinema has played two roles at once. As a
media technology, cinema's role was to capture and to store visible
reality. The difficulty of modifying images once they were recorded was
exactly what gave cinema its value as a document, assuring its
authenticity. The same rigidity of the film image has defined the
limits of cinema as I defined it earlier, i.e. the super-genre of live
action narrative. Although it includes within itself a variety of
styles - the result of the efforts of many directors, designers and
cinematographers -- these styles share a strong family resemblance.
They are all children of the recording process which uses lens, regular
sampling of time and photographic media. They are all children of a
machine vision.
The mutability of digital data impairs the value of
cinema recordings as a documents of reality. In retrospect, we can see
that twentieth century cinema's regime of visual realism, the result of
automatically recording visual reality, was only an exception, an
isolated accident in the history of visual representation which has
always involved, and now again involves the manual construction of
images. Cinema becomes a particular branch of painting - painting in
time. No longer a kino-eye, but a kino-brush.
The privileged role played by the manual
construction of images in digital cinema is one example of a larger
trend: the return of pre-cinematic moving images techniques.
Marginalized by the twentieth century institution of live action
narrative cinema which relegated them to the realms of animation and
special effects, these techniques reemerge as the foundation of digital
filmmaking. What was supplemental to cinema becomes its norm; what was
at its boundaries comes into the center. Digital media returns to us
the repressed of the cinema.
As the examples discussed in this essay suggest, the
directions which were closed off at the turn of the century when cinema
came to dominate the modern moving image culture are now again
beginning to be explored. Moving image culture is being redefined once
again; the cinematic realism is being displaced from being its dominant
mode to become only one option among many.
뉴미디어의 영상미학에 대한 상세하고 포괄적인 최초의 분석서. 뉴미디어 미학의 근원을 회화, 사진, 영화 그리고 텔레비전에서 찾아내면서 디지털 이미징, 인간-컴퓨터 인터페이스(HCI), 하이퍼미디어, 컴퓨터게임, 합성, 애니메이션, 그리고 가상세계를 살펴보는 책이다. 책의 각 부분은 복합적이지만 접근 가능한 입구를 만들어 우리가 뉴미디어 형식의 역사 안으로 들어가게 해주고, 그러한 형식이 그 자체로만 고립되지 않고
8쪽 - 한국어판 저자 서문
뉴미디어의 언어, 보다 정확히 말하자면 여러 개의 별개 언어들은 네트워크에 연결된 디지털 컴퓨터라는, 전세계적 정보사회의 새로운 기계가 가져온 보다 새로운 기술만이 아니라 영화, 연극, 활자도서 등 이미 잘 자리잡은 문화형식의 기술과 기억, 전문성을 통합하고 있는 일종의 혼합종이기 마련이다.
원천자료의 개방 하이퍼텍스트 1990년대 사이버 예언가들의 미래주의 문화적 상위구조 산업적 근대주의 절충주의 아방가르드 예술가, 미래파
정보미학 타불라 라사 Tabula Rasa 백지상태 이데올로기의 해이 현상 포스트모던
로버트 벤츄리, 스코트 브라운, 이제 나우와 공저 <라스베가스의 교훈 Learning From Las Vegas> 1972
세계화된 국제성
10-11쪽
정보미학(즉, 과거 산업사회의 문화와는 구별되는 정보사회의 새로운 문화)는 이미, 아니면 앞으로 산업적 근대주의와는 판이한 논리를 갖고 있거나 갖게 되리라 예상한다. 이러한 논리는 다양한 조합을 통해, 과거의 것과 새로운 것을 창조적으로 병치하려는 욕구이다. 본서는 이러한 혼합성의 미학이 추진시키고 있는 현대문화의 한 단면, 즉 네트워크로 연결된 디지털 컴퓨터와 이미 자리를 잡고 있는 문화 형식이 교차되는 단면을 체계적으로 검토하는 것이다.
재혼합 remix 현대문화는 세 개의 핵심적 과정, 즉 세 가지 종류의 재혼합에서 바라볼 수 있다. 첫번째 재혼합은 포스트모더니즘으로, 주어진 미디어 안이나 문화 형식(음악, 건축, 패션 등) 안에 과거 문화의 내용과 형식을 재혼합하는 것이다. 두번째 재혼합은 세계화로, 한 나라의 문화 전통, 특성, 그리고 감수성을 그 안에서 뿐만이 아니라, 새로운 세계화된 국제성의 스타일과 상호작용하도록 섞어내는 것이다. 세번째 재혼합은 문화와 컴퓨터의 재혼합이다. 다양한 문화 형식의 인터페이스와 새로운 소프트웨어 기술의 재혼합이다. 이 문화 논리가 새로운 이유는 과거를 지워버리려 했던 근대주의적 새로움 때문이 아니라 그와 반대로 진행되고 있는 재혼합 과정의 광범위함, 속도, 연관된 요소들 자체의 새로움 때문이다.
디지털이라는 새로운 미디어는 몰입을 유도하는 영화적 인터페이스와 함께 데이터베이스의 하이퍼텍스트적 구조를 갖고 있는 새로운 문화의 내용을 만들어냈다. 또 그 문화의 내용은 사용자가 쉽게 조작할 수 있는 유연한 구조를 가지고 있다.
14쪽 - 추천서 '뉴미디어 영상미학에 대한 최초의 분석서' 마크 트라이브 Mark Tribe (Rhizome.org 창시자)
예술은 항상 기술과 연관되어 왔고, 예술가는 새로운 기술이 나타나면 그것을 최초로 수용하는 사람이었다. 우리는 새로운 기술이 어떤 일을 할 수 있는지를 보고, 그 기술이 기술자들이 의도했던 영역을 넘어서도록 하고, 기술이 의미하는 바가 무엇인지를 이해하며, 그 기술의 효과를 되새겨 보고, 또 그 기슬이 그것의 한계를 넘어서도록 밀고 나가며, 그 기술에 익숙해지기 위해 만지작거린다. (중략) 인터넷은 협동 작업, 민주적 배포, 그리고 참여적 경험 등의 새 유형을 가능하게 해주는 잠재력이 특히 잘 여물어 있다.
In this book Lev Manovich offers the first
systematic and rigorous theory of new media. He places new media within
the histories of visual and media cultures of the last few centuries.
He discusses new media's reliance on conventions of old media, such as
the rectangular frame and mobile camera, and shows how new media works
create the illusion of reality, address the viewer, and represent
space. He also analyzes categories and forms unique to new media, such
as interface and database.
Manovich uses concepts from film theory, art history, literary theory,
and computer science and also develops new theoretical constructs, such
as cultural interface, spatial montage, and cinegratography. The theory
and history of cinema play a particularly important role in the book.
Among other topics, Manovich discusses parallels between the histories
of cinema and of new media, digital cinema, screen and montage in
cinema and in new media, and historical ties between avant-garde film
and new media.
Lev Manovich is Professor of Visual Arts, University of California, San Diego. His book The Language of New Media (MIT Press, 2001) has been hailed as "the most suggestive and broad ranging media history since Marshall McLuhan."