Before a captive audience, a sleek animation is played in synchronicity across a trio of iPads, introducing some of the successful case studies of Allen & Gerritsenย โ a creative agency based here and in Boston.
But hereโs the plot twist: no one pressed a play button.
https://www.youtube.com/watch?v=mRhAb5RduRk&feature=youtu.be
Attendees at the Ad Age Digital Conference held last monthย in New York had a chance to tinker with A&G Labsโ latest creation, which uses computer-vision technologies to create an interactive portfolio piece.
Instead of tapping a screen or clicking a mouse, users simply placed cards on top of a mystery box as a way to select which kind of content they were interested in.
โBasically, these cards are the play button that starts the whole experience,โ saidย A&Gย Innovation Leadย Mike Bodenberger, who manned the booth at Ad Age Digital. โThey’re also a piece of marketing collateral that users can take with them and keep our contact information.โ
Nicknamed the “magic box” by the agency’s development staff, the magic in this exhibit is performed by a camera, encased in a sleek woodenย box, that is linked to a piece of software capable of identifying three different cards. Your options: โThe Future of Innovation,โ โThe Future of Retailโ and โThe Future of Fun.โ
According to the card chosen, the system then plays the appropriate case study content through the tablets.

OpenCV, an open-source computer vision software, was used to perform the image recognition behind A&Gโs latest experience. An iOS app built in-house plays the video across the screens.
Bodenberger said the booth proved to be a good conversation starter at the Ad Age event. The experience was ideal to set apart A&Gโs particular spin on advertising from the work done at other agencies. A&G’s Labs team has all the fun.
People are already familiar with computer vision and image recognition technologies, as evidenced by the facial recognition capabilities used by Facebook and Snapchat. Itโs how Snapchat puts bunny ears on your head or how Facebook identifies your uncle in a picture from last Thanksgiving.
Bodenberger finds this to be a great competitive edge for marketing opportunities. โThe possibilities are endless,โ he said.
Allen & Gerritsen’s latest invention is powered by computer vision