Set Design for Improvisational Multimodal Theater: Photo Album
Undergraduate Students: Corey Chandler
Graduate student: Anoop Sinha
Professor: James Landay
|
| The photo
album is an application involving...
|
|
Photo Wall
Provides an area to store
all photos, as well as
|
|
 |
| Digital Desk
Provides a workspace for photo album
creation, allowing
-
Page creation and removal
-
Movement of photos back to the
Digital Wall
-
Photo resizing
-
A choice of 3 frame styles to place
around photos
-
Textual and Audio photo annotations
-
Minimizing and maximizing of pages to
avoid clutter
-
Album page ordering
|
|
 |
|
Peripheral Board
Gives the user a constant view of minimized
pages.
|
|
 |
| Computer Chair
Provides viewing of the finished photo album.
|
|

|
| 1: As this is a multimodal system, a combination
of gestures and speech can be used at any time for
input. A cheat sheet for speech commands and gestures
was made for the user:

|
2: Photos can be taken from the Photo Wall and
moved to the Digital Desk by placing a photo on the bottom
area marked "Digital Desk." Photos can be
erased by being dragged to the trash on the lower right hand
corner of the wall.

|
| 3: From the Digital Desk, the user can create a
new album page by gesturing or speaking.

|
4: Here the user has made a photo album page
with a title and two photos. The first photo has been
enlarged as well as annotated with textual and audio
annotations. The second photo also has both kinds of
annotations, as well as a wood frame.

|
| 5: Minimized pages are shown on the left side of
the Digital Desk. Their order reflects the final order
of the photo album.

|
6: The minimized pages are displayed on the
Peripheral Board for the user's viewing convenience.

|
| 7: The finished product can be viewed from the
Browsing Chair.

|
|
Some shots of the overall system at work:
Behind the curtain (what the Wizard had to do):
| We found that the Wizard's job was made easier
of they carried around a kind of "easel" that had
many components that were often used during the simulation,
such as frames, written annotations, and audio
annotations. These are all Post-its stuck to a plastic
board. |
 |
Audio annotations were done using a Compaq PDA. After an
audio annotation Post-it was attached, the Wizard would be ready
with the PDA. As soon as the user hit record on the Post-It,
the Wizard would press the record button on the PDA. Each
recording was kept as a separate file in the PDA, with each
recording incrementing by 1 in number (Photo Album1, Photo Album2,
and so forth). The Wizard just keeps recording files until the
user seems happy and moves on. The Wizard then writes down the
number of the recording (7, for Photo Album 7, etc), and (if they
have time), erases the unused recordings on the PDA.
Minimized photos were kept on the wall with magnetized clamps
that used little balls to hold pages - simply slip the page under
the ball, and it holds it firmly. Release the page by lifting
the ball.
Feedback:
From Ken Goldberg
- if no page on digital desk. should pop up automatically
- After user chooses frame style, that should become the default
(so no need to keep asking, but default can be changed)
- For this task - photo albums - I'd want to group, organize,
maybe by time, before putting into pages, then arrange in pages
and only after all of that add frames + titles
From Leila Takayama:
- pull on trash? click? touch?
- where do captions go? over or on the side?
- handwriting changed to text? font selection? size?
- "Peripheral Board" "Photo Wall" title
actually on the board?
- "Do I want to add caption?" will that be recognized?
- frames in a photo album? too large?
- trash file shared between Photo Wall and digital desk?
- possible additional options:
cropping
morphing photos
music
collage
yearbook
print
index
slideshow
name pictures?
For additional questions or comments:
|