Virtual Photography

Back in 2001, CBS introduced EyeVision for their Superbowl telecast. EyeVision allowed the broadcasters to combine images from several dozen cameras, positioned and 7° intervals around the stadium, into a seamless playback that could be rotated on the fly, creating an effect much like the famous “Bullet Time” sequence in The Matrix. The technology, while not perfect, was really neat, and offered unparalleled insight into the on-field action. Unfortunately, it hasn’t made a reappearance at a Superbowl since then, and the technology doesn’t appear to have been pushed forward much.

Fast forward to 2011. The Kinect has been released for the XBox 360 and has been enthusiastically embraced by hackers. Microsoft, while initially reluctant to let people fool around with the sensor, quickly realized that they were fighting a losing battle, reversed their position, and now even provides some official support for people doing new and interesting things with it.

The Kinect works much like a WebCam: you point it at something, and it gives you a video feed of what you’re pointing at. The interesting thing, however, is that in addition to the image, it also tells you how far away each element in the image is. Using a couple of Kinects in tandem allows one to actually reconstruct a texture-mapped scene in three dimensions. Once you’ve done this, it’s a simple matter to move around and through the space, much like you would in a video game. Here’s the first proof-of-concept I saw:

And here’s another demonstration that uses a single Kinect panning around a scene to capture the data:

As you can see, once the data is assembled, one can move a virtual camera through the scene, viewing it from angles where there was no camera to begin with. Though these first efforts are still a bit rough, think what one could do with this sort of technology if it were refined and made more sensitive: the Superbowl’s EyeVision technology could be expanded: instead of 33 possible vantage points, you could see a playback from an infinite number of angles, even swooping in among the players. Movies could be filmed with full 3D data sets, allowing one to move through a scene and see it from whatever angles one wished. Professional photographers could not only adjust exposure, contrast, saturation and that sort of thing, but also the apparent angle from which a photo was taken.

I expect this sort of thing to blossom over the next few years, and am anxious to see what happens with it once it gets from the hands of hobbyist technologists to those of artists and producers. It should be a fun ride.

Time for a New Adventure: Magnolia

Last Thursday, I gave my one month notice at the University.

The reason for that was not any particular discontent. While the University has its share of bureaucracy and silly decisions, the management above us has generally shielded us from much of it. And being able to walk to my office, have the freedom to explore lots of crazy stuff as the mood strikes, hone my management skills, have a stable job, and work with some terrific people on a beautiful campus has been great. I’m proud of the work we’ve done, and proud of my team, which has accomplished an amazing amount with minimal resources.

But now I’m going to work for Magnolia, the Swiss company that makes the CMS software that we’ve been using at the University with great success for a number of years. I’m excited about the change for a number of reasons:

  • They are a great team. I’ve worked with Magnolia as a customer for about four years now, and have been really impressed with both the technical excellence of their work and the professional excellence with which they run the business. I also got to meet many of them at the 2009 Magnolia Conference, and was delighted to find that every single Magnolian I met was genuinely kind and pleasant as well. What a great combination!
  • I’ll get to focus in on programming again. While I’ve enjoyed stretching myself into the role of a manager over the past several years, and think I’ve done some interesting and positive things in that position, I do find myself enjoying work the most when I’m able to focus on technical disciplines. While I don’t see a ton of opportunity to exercise the Objective C and Rails skills I’ve built up at the University, I expect there to be plenty of space to go as deep as I’d like with Java.
  • I’ll have the opportunity to do some traveling, both to Basel, Switzerland, where the company is based, and around the United States to get together with other members of the U.S. team, visit customers, and present at conferences. I hope to be able to bring Kathy and the kids along at times too, so that we all are able to benefit from the travel and see a bit more of the world.
  • I’ll be working from home. I’ve done a fair bit of this is previous jobs, and have always found it to be a really nice arrangement. Kathy is great at running interference so that I can really focus when I’m “at work.” But when I’m ready for a break, the family is right there, so it’s easy to have lunch with them, take them down to the park for a bit, or mount a quick trip to the river for a swim.

The new job will include technical pre-sales (talking nerdspeak with prospective customers and building prototypes for them), working on internal projects, raising awareness of Magnolia in the US by participating in community discussion and presenting at conferences, and providing support to existing customers while the team in Switzerland sleeps.

My last day at the University will be Thursday, March 3. I’ll take that Friday off to go blow some things up with Jason Young (we’re planning on building a jam jar jet engine), and will then dive in at Magnolia on Monday, March 7.

Little Shop of Horrors

This past January, Abigail had her first experience with the theater. Her high school was staging a production of Little Shop of Horrors, for which she auditioned and got several parts. Given her expressive and dramatic nature, I fully expected her to really cotton to the experience, and was not disappointed. I have a bit of a soft spot for that show, as friends of mine have been in it and I played in the pit band for it at Texas State a couple of years back, so was particularly pleased that would be her inaugural theater experience.

She came back from each rehearsal thrilled with the chance to be part of the show, overflowing with stories about the various things she had worked on that day. All the while, she was accreting a new collection of friends involved with the show whom she seemed to quite enjoy. Rehearsals went on for a long while, with the director eventually pushing the performances back a month or two from their original schedule.

Finally the show started in mid-January, with a scheduled run of three weekends. We had been planning to go on opening night, but Abigail was nervous, and asked that we hold off until the next weekend. We were a bit indignant that some of our friends were getting to see her before we did, but were OK with giving her a little more time to prepare.

Finally, we ventured forth to the 80 seat Black Box theater at the high school, a tiny venue that sold out regularly, but which the director hoped would help the actors better connect to the audience — a good strategy, given that we nearly had actors in our laps at several points. Abigail got to be a member of a crowd scene during Downtown, a TV reporter, a guest on the radio show Seymour was a part of, and a tortured dental patient — a role in which she was able to exercise her considerable talent for ear-splitting screaming. She did a terrific job all around, and it was great fun to see all her work pay off at last.

In addition to Abigail’s thespian talents, we got to see some of Emily’s work: she and the other members of the Art Club had worked together on the various puppets for Audrey II, and did a great job with them. (The smallest of the puppets was entirely Emily’s doing, and looked terrific.)

“Well, what did you think?” I asked Abigail after the run was complete. “Would you do it again?”

thought for a moment about all the hard work, the funky hours, the blisters on her feet, and the stress of trying to keep up with schoolwork, responsibilities at home, and the theater. Then she smiled.

“Yes, definitely.”