The MEMS Executive Congress last November had it own share of eye candy. It wasn’t just the Monterey Bay (and dinner in the Aquarium) that tantalized the 280-odd attendees. Rather, it was the MEMS Technology Showcase, featuring some dramatic applications of micro-machines themselves:
- MOD Live from Recon Instruments is an interactive display for GPS-enabled ski goggles. It’ll map your route on the slopes, tell you where you’ll hit bumps and crevices in the snow, and monitor your performance.
- The Sunrex Air Mini Keyboard is a remote control with integrated keyboard which supports PayTV, PC-connected home theater and other interactive media applications.
- Sys-Evo is an electronic surfboard attachment that monitors wave height, wave direction, distance traveled, and the duration of the wave — as well as the surfer’s actions (including waiting time, paddling, riding and time waiting to catch a wave.)
- R0R3 Devices' latest contraption is a MEMS-based heart rate monitor which correlates chest strap electrocardiograms (ECG), with periodic motions such as running, push-ups or jumping jacks. (These are the folks, remember, who engineered “Guitar Hero.”)
- The Raisin System from Proteus Biomedical combines medical monitoring, and daily pharmaceutical administration with social networking. It doesn’t threaten to tell your Facebook friends if you’ve missed a pill — but something close. The Raisin System is based on a chemical sensor called the “Proteus Ingestible Event Marker (IEM)” and the HealthTiles application environment.
- And MicroVision is back with the “ShowWX+ HDMI,” a handheld pico projector that lets users project images, presentations and videos as large as 100 inches across from an iPhone, iPad or laptop onto a screen, a wall or any other available surface.
The market research services will have field day tabulating the market potential for these eye-catching but somewhat niche devices. Gartner’s own revenue projections focus tightly on semiconductor MEMS, and are much more conservative than those counting digital light projectors (DLP) and/or inkjet nozzles. Still, revenue projections for micro electromechanical systems (MEMS) devices in cell phones, it should surprise no one, resemble the proverbial hockey stick. In a dismal 2011, it was among the only semiconductor devices that exhibited 16% growth. And all projections suggest MEMS sensor revenue will continue to grow in the foreseeable future.
Where’s Elmo?
There are two glamor applications supporting the use of MEMS devices in mobile handsets and tablets. One is the support for the location-based services some people are starting to call “augmented reality.” Global positioning systems (GPS) depend on a clean “line of sight” between your portable navigation device (PND) and the position-detecting satellites. You lose this line of sight inside a department store or a shopping mall. MEMS motion sensors can serve as footstep counters, keeping track of where you are inside this canopy. A magnetic sensing element (like a magnetometer) adds a digital compass to this tracking technology.
Robert Bosch, the ostensible leader in MEMS accelerometers (particularly airbag triggers) used the MEMS Executive Congress to show the parts it was developing for cell phones with location-based service apps. Bosch is packaging three devices — a MEMS accelerometer, gyros and magnetometer — in the same integrated circuit package. Augmented reality adds an application layer to the dead reckoning provided by this combination: The shopper entering a food court for the first time, believing there was a Starbucks close by, but unable to spot it, need only snap a picture of the court with the camera portion of his smartphone. An overlay, perhaps with an arrow, superimposed on the picture you’ve taken will point out the Starbucks in that scene.
Some application developers, like Qualcomm, regard this “where’s Elmo?”scenario as a fairly primitive application of augmented reality. A more developed AR application might take a picture of a Chinese restaurant menu in Shanghai, and the overlay will give you the English translation. In the demos we’ve seen, Qualcomm’s applications processors can place an avatar within the Starbucks scene you’ve captured, and guide you step-by-step through the purchase of a latte (or challenge an imaginary barista to a stick fight).
MEMS will also be the enabler of a technology we’ve come to call “gesture recognition.” Thanks to iPhones and other screens equipped with capacitive touch sensors, we’ve begun to learn a new language — the language of fingers. Think of this: You hold your thumb and index finger together, place them on image on your touch screen, and spread your thumb and index finger apart. The applications processor understands that as intent to zoom-in on your picture image. Conversely, touch the image with your thumb and forefinger, and squeeze them together. The applications processor understands this as intent to zoom-out of the picture by decreasing the size of the image. Or, do something else: swipe a finger across the image, right to left, and watch the image (or icon) leave the screen, quickly replaced by another… I don’t want to do a thing on the genius of Apple, Steve Jobs, blah blah blah, but it IS something to think about: Did this language of fingers exist prior to the introduction of the iPhone?
This is really just a beginning.
Thanks to a proliferation of cameras pointed at us (on our laptops, tablets and cell phones), and the increasing sophistication of visual pattern recognition — as well as a proliferation of MEMS sensors — we’ll have entirely new ways of interacting with our computing equipment. We’ll have to think twice before we grimace, shrug, wave our hands, clench our fists, or use our middle finger.
The MEMS devices in cell phones and tablets are the early enablers of gesture recognition. Already, the embedded gyros and accelerometers in our mobile handsets allow them to be used as gaming attachments. We can swing our smartphones as if they were the handles of tennis rackets, while a pico projector with the gaming software will project the trajectory of the imaginary tennis ball we’ve hit over the net into our opponent’s court. Incorporated into tablet computers, the MEMS motion sensors convert your tablets — the entire slate — into a steering wheel for a projected racetrack game, or an assault weapon for a first person shooter.
Careful what you wish for
The rotational sensors in the Amazon Kindle Fire work pretty well, but the touch screen is half asleep. You can turn the pages of your eBook fairly easily with a finger swipe, but moving from an eBook app to (say) web browsing requires several finger taps before the machine registers that it’s supposed to do something. .
I had obtained my first Kindle with the help of Freescale, who makes the iMX processor used in most of the Kindles (and several other eBook readers). As a long-term book lover, I was surprised and amazed by how easy it was to get used to Kindle… No more sore shoulders from the hardbound books in my briefcase… The Kindle gives me access to hundreds on slate as small and as easy to carry as the steno pads I use for note taking… and, as a consequence, I feel I’m reading quite a bit more.
I couldn’t resist the Kindle Fire, which is reputed to do almost as much as the Apple iPad — and costs $300 less. While I really like this Kindle as well, I’m more aware of its short comings. Unlike the original Kindle, which has universal WiFi, the Fire depends on a “hot spot” connection… a problem since most of your content (including the book you’re reading) is in “the cloud,” which means you’ll wind up paying a fee at many airports. This is not a problem inside my house where everything is connected to my personal encrypted wireless network, but a problem everywhere else.
The Kindle Fire is surprisingly heavy, and the width of the touch screen doesn’t give a convenient place to grip it. A problem if you want to hold the thing with one hand on a crowded bus, since the pressure of your thumb on the screen will be interpreted as an attempt to turn the page. And the screen's frame is otherwise too narrow to grip it firmly without touching the screen.
And the battery life isn't great. You can get about a week with intermittent eBook use; much less, not even a full day if you use the Internet for streaming media. But the machine does excel as a media player. Powered by one of Texas Instruments’ OMAP processors, the 4430, the Fire does a terrific job with MP3 music playback, JPEG picture display, or movie viewing. The sound is vivid and the screen is as enticing as any portable media player I’ve seen. Using the finger language I talked about — thumb and forefinger — I can expand or collapse images with fairly high screen resolution… which is ideal for (say) showing pictures from Europe.
Can’t rub two dimes together…
I apologize to readers for my long absence from this space. I had spent a good part of the fall — four weeks in fact — two weeks in Europe (Berlin, Prague and Paris) and another two on the east coast (the Lake Country of New Hampshire, first, and the suburbs of New York). I was pursuing a writer’s obsession that I could neither quench with overseas travel nor put to rest with isolation in rural New England. All I can say now, if I ever have the time to finish this novel, it will be at once as steamy and philosophical as anything Philip Roth turns out these days.
As it turned out, a colleague was interested in hearing about my time in Berlin, the scene of so many John le Carre spy thrillers. “Glad you have the resources to travel,” she said, a reference to the economic downturn so many people were feeling.
“I did cash in on some airline mileage I had accumulated,” I explained, almost apologetic. “I’m not rolling in dough.”
“You know what this is?” she said, showing me her hand, her thumb working back and forth against index and second finger.
I thought her hand gesture pre-dated the iPhone by several centuries, a reference to what some cultures would call “baksheesh.” But I played dumb in case a different story emerged. “No, what is it?” I asked.
She beamed at me as if the answer were entirely obvious: “The world’s smallest violin!” []