THE OTHERS

(EYE TRACKING INSTALLATION)
This project explores the theme of gaze—the act of looking and being looked at—and its tangible representation. Usually the male gaze has been viewed as a source of objectification, but gaze itself can carry a range of meanings: it can be powerful, harmful, or even kind. This project aims to make the intangible concept of gaze perceptible through physical means, by offering the dual identity of seen and being seen.


Unfortunately I lost all documentation for the exhibition, but found some snippets during the built-up.







Please kindly click on the image for the demo video




Code & Schematics





Initial Idea


  1. Webcam captures the gaze.
  2. P5.js maps the zones based on the gaze.
  3. Arduino sends the data to control the NeoPixels.
Develop a human body figure in p5.js and use p5 to detect and record gaze (eyeball) movements as the user observes the figure. Then, create a physical representation of the body figure and embed LED pins in different sections. p5.js would send gaze data to an Arduino, causing the LEDs to blink in the areas the user’s gaze travels to. Simultaneously, a speaker could play audio, creating an interactive experience that visualizes and vocalizes the gaze.



Challenges


Physical Challenges

    • Cutting and Soldering NeoPixel Strips: To achieve specific shapes, the NeoPixel strips had to be cut and soldered back together. The small connection points made soldering difficult, as wires often disconnected or the solder failed to hold. Using a glue gun improved the stability of the connections.
    • Attaching to the Dummy: The dummy’s soft fabric surface posed challenges in attaching the NeoPixels. Taping the dummy first created a sturdier surface for application.

Technical Challenges

    • P5.js:
      • Managing sound (loadSound issues): Ensuring the sound file was correctly placed and loaded at the right stage of the code.
      • Resolving unexpected errors (no readSerial(), unexpected token, etc.).
      • Wrapping text within certain areas of the canvas.
    • Arduino:
      • Voltage insufficiency: The NeoPixels required more power than the current setup provided.
      • Addressing only one LED lighting up by ensuring proper data propagation across the strips.
    • General Issues:
      • Balancing power requirements and ensuring stable performance without burning out components







Exhibited at NYUAD Interactive Media Final Showcase 2024