Before a captive audience, a sleek animation is played in synchronicity across a trio of iPads, introducing some of the successful case studies of Allen & Gerritsenย โ€” a creative agency based here and in Boston.
But hereโ€™s the plot twist: no one pressed a play button.
https://www.youtube.com/watch?v=mRhAb5RduRk&feature=youtu.be
Attendees at the Ad Age Digital Conference held last monthย in New York had a chance to tinker with A&G Labsโ€™ latest creation, which uses computer-vision technologies to create an interactive portfolio piece.
Instead of tapping a screen or clicking a mouse, users simply placed cards on top of a mystery box as a way to select which kind of content they were interested in.
โ€œBasically, these cards are the play button that starts the whole experience,โ€ saidย A&Gย Innovation Leadย Mike Bodenberger, who manned the booth at Ad Age Digital. โ€œThey’re also a piece of marketing collateral that users can take with them and keep our contact information.โ€
Nicknamed the “magic box” by the agency’s development staff, the magic in this exhibit is performed by a camera, encased in a sleek woodenย box, that is linked to a piece of software capable of identifying three different cards. Your options: โ€œThe Future of Innovation,โ€ โ€œThe Future of Retailโ€ and โ€œThe Future of Fun.โ€
According to the card chosen, the system then plays the appropriate case study content through the tablets.

Allen & Gerritsen's Mike Bodenberger at the Ad Age conference. (Courtesy photo)
Allen & Gerritsen’s Mike Bodenberger at the Ad Age conference. (Courtesy photo)

OpenCV, an open-source computer vision software, was used to perform the image recognition behind A&Gโ€™s latest experience. An iOS app built in-house plays the video across the screens.
Bodenberger said the booth proved to be a good conversation starter at the Ad Age event. The experience was ideal to set apart A&Gโ€™s particular spin on advertising from the work done at other agencies. A&G’s Labs team has all the fun.
People are already familiar with computer vision and image recognition technologies, as evidenced by the facial recognition capabilities used by Facebook and Snapchat. Itโ€™s how Snapchat puts bunny ears on your head or how Facebook identifies your uncle in a picture from last Thanksgiving.
Bodenberger finds this to be a great competitive edge for marketing opportunities. โ€œThe possibilities are endless,โ€ he said.