Skip to content
All work
Founder track record

Mixed Reality Desktop App

Real-time object detection and three-dimensional tracking for a government mixed-reality experience

Delivered in partnership with Live Pixel and Mizzle Codes.

Type
Desktop app
When
42 days
The mixed-reality desktop application running on a tablet: a subject tracked inside a three-dimensional wireframe bounding box, with selectable subject thumbnails below
Detection and 3D tracking in the delivered app
From start to government demonstration
42 daysFrom start to government demonstrationFounder track record
Detection and compositing, on local hardware
Real timeDetection and compositing, on local hardwareNo cloud round-trips
Public installation at the State Legislative Assembly
LivePublic installation at the State Legislative AssemblyLucknow Vidhan Sabha

Overview

A mixed-reality "Selfie Point" desktop application for the Lucknow Vidhan Sabha: live camera feed, real-time object detection and positional tracking compositing visitors into mixed-reality content, delivered in 42 days.

A public mixed-reality installation for the Uttar Pradesh Legislative Assembly, operated as a desktop application in a live government environment.

The challenge

  • Real-time detection and compositing on local hardware, no cloud round-trips
  • A fixed 42-day window ending in a live public demonstration
  • Operating reliably in an uncontrolled, high-footfall environment

What we built

  1. Live camera feed captured and processed in real time
  2. YOLO-based object detection on every frame
  3. Spatial and positional tracking of detected subjects
  4. Mixed-reality composition of live subjects with rendered content
  5. Desktop application packaging for on-site operation

Our role

Computer-vision and application engineering

  • Detection and tracking pipeline
  • Mixed-reality composition
  • On-site delivery

Delivered in partnership with Live Pixel and Mizzle Codes.

Platform and stack

  • Python
  • OpenCV
  • YOLO object detection
  • Real-time image processing
  • Three-dimensional tracking

From the delivered product

The mixed-reality application in a window, showing the Uttar Pradesh Legislative Assembly header, an environments panel and three selectable environment tiles over a live camera background
Environment selection over the live camera feed
Mixed reality desktop application demonstrated at the Uttar Pradesh State Legislative Assembly
Demonstration at the State Legislative Assembly
Next projectNational People's PartyWebsite

Build a system with similar complexity

Book a free 30-minute consultation, or write to us, you will always talk directly to the person who builds your product.

Techon Pixel · info@techonpixel.com