The Misadventures of Quinxy truths, lies, and everything in between!

30Mar/125

Cell Phones as R/C Quadcopter FPV TX/RX and Homing Beacon

Flying multi-rotor (particularly quadcopter) radio-controlled vehicles is a lot of fun and you can do amazing things with them, in particular some beautiful aerial photography.  While most r/c pilots do this by looking up at their craft from whatever their distance happens to be at the moment, a growing number of r/c enthusiasts are using FPV (first person view) to remotely control their vehicles.  By using a tiny video camera with an attached transmitter the pilot can virtually fly their quadcopter as though they were a miniature pilot located inside it.  Aside from just being a lot of fun, this perspective makes it possible to fly over far longer distances than one could by merely looking at the craft from the ground.  The equipment to do FPV is not cheap, however, with decent entry-level setups of camera, transmitter, and receiver costing $1,000.  And so I couldn't help but wonder why no one talks about using the ubiquitous smart cell phone with its included cameras as an alternative solution.  The cell phone has a number of advantages over a typical FPV setup, namely that with the right apps running it can record its own video, it can operate over almost infinite distance with its use of cellular networks for data transmission, it can operate with very high bandwidth over 4G or wifi (though very limited distance with wifi), it can log its own flight path by recording its GPS positions, and if it crashes it can transmit its location to make recovery easy.  With all these advantages in a package that can cost just $100 it's hard to imagine it not used by everyone!

From what I understand in talking to a few people, the issue comes down to video quality, latency, and the possibility that the connection just drops out.  Few people want to risk their $1,500 and up r/c darling on Sprint's or AT&T's potentially spotty and variably efficient cell coverage.  And the current video streaming software available as apps for the key FPV feature are not intended for mission critical, near real time transmission.  Imagine trying to drive a car or pilot a plane with Skype.  You might do just fine for a while, as long as sender and receiver have good signals but if either gets into trouble the video suddenly becomes erratic, delayed, and pictured objects become indistinct and it would be impossible to make critical operating decisions based on that.

Given the enormous complexities being overcome daily by dedicated enthusiasts of r/c flying this seems like a challenge that can fairly easily be overcome.  One of the key pieces of software this community has developed and continually refined is the "flight controller", or the software which takes signals from the pilot's transmitter (the device with the joysticks that he uses to control the vehicle) and turns those into adjustments to motors and control surfaces.  Many flight controllers now even come with amazingly sophisticated auto pilot features, like the ability to hover motionless in one spot (despite winds, etc.), to fly home in the event that signal is lost or a fault develops, to automatically land if batteries are low, and even to navigate on its own, flying between coordinates previously supplied to it.  If all that can be achieved surely the FPV via cell phone problem can be overcome!

There are three problems that need to be addressed: loss of signal, degradation of signal, and overall quality of video.

Loss of video signal is clearly a very real problem and no amount of clever software can make up for a lack of inputs from the pilot, but such situations can be appropriately handled to minimize negative impact.  As I mentioned above, many flight controllers now include safety modes such as hover,  automatic return home, and automatic landing.  The pilot with such an onboard autopilot can at the flick of a switch tell his craft to do the appropriate thing, presumably either hovering to wait and see if signal is restored or begin to return home at least enough to regain the signal.  Also, the FPV app in the cell phone can be optimized to recover quickly from any network failure (once the underlying data connection is restored).  And if this was to all develop and become more sophisticated clearly an integration of the FPV app and the onboard flight controller would be ideal, allowing the FPV app to command auto pilot features directly in the event of network loss as well as be the means of transmitting flight controller telemetry to the ground during routine flight (and perhaps controlling other features of the flight controller as well).

Degradation of signal and overall quality of video are related problems.  The key here is, I believe, to develop a video codec or perhaps just an application of existing codecs that focuses on the critical visual data FPV pilots need.  While users of video streaming applications like Skype want overall picture quality to be good, an FPV pilot is primarily focused on visual information related to the orientation of their craft relative to ground, potential physical obstacles in their path, and anything necessary to continue whatever flight motion they were executing.  If the signal degrades and there is less bandwidth over which to send video it's most important that the critical parts of the pilot's picture continue to appear in near real time!  How exactly one extracts or prioritizes those features I am not sure at this point, but I am fairly certain it's an achievable goal.  One need only think of situations they have been in when their own vision has degraded due to environmental factors like darkness, fog, smoke, etc. to realize that our brains can seize upon very small and sometimes indistinct cues to maintain orientation.  An algorithm could be developed to prioritize the sending of lesser quality video data related to horizon and to nearby obstacles (elements of the frame which the algorithm have noted move more relative to the overall background).  And with the ongoing development in the areas of computers interpreting images to extract features like faces, eye positions, smiles, body positions, etc. it should present little challenge to have the FPV app be able to maintain an awareness of very crude items like the horizon and those objects most likely to represent near obstacles.  This specific data could even be transmitted using ultra-low bandwidth as mere vector data rather than actual color images, in other words allowing the second receiving cell phone app to reconstruct the approximate figures overlapping whatever video may or may not be coming in.

Hopefully these things will see development in the near future because it can hardly be argued that the potential here is huge.

^ Quinxy

18Jul/100

Me, The Quasi-Statistical Serial Killer

As part of my year of mischief, perhaps soon to become an age of mischievousness,  I've adopted a policy of engaging in quasi-statistical serial murder.

If second hand smoking kills, then the first hand smoker must be the killer.  To be fair it'd be more accurate to say the smoker is an attempted murderer.  It's entirely possible their smoke has killed someone, but proving it was their particular puff that pushed another specific person into cancer or heart failure would be nigh impossible.     One could extend the argument to say that since smokers indulge around more than one person on more than one occasion, and they are aware of the risk they are pushing onto others, smokers qualify as serial killers, albeit again of an attempted variety.  A mortality statistician might be able to accurately guesstimate a lifetime average death toll, perhaps it'd be on the order of 0.04 victims per smoker, with any individual smoker perhaps being responsible for no deaths or dozens.

It has widely been suggested that cell phones may be the hidden health crisis looming in the future, the equivalent crisis for the next generation as cigarettes were for the last.   The as yet unconfirmed but suspected carcinogenic nature of radio waves we all routinely ignore because the benefits they bring are just too delicious to deny.   Smokers believed the doctors and the cigarette companies well through the first half of the last century, perhaps we'll do the same through this one with cell phones.

I don't smoke.  But I like to play god with the best of them.  I've decided that I will seek to expose others to second hand cell phone radiation, and the murdering that may or may not statistically follow.  I won't do so freakishly, needlessly creating signals just to expose people, but if I'm tethering my computer to my cell phone or making a call, maybe I'll choose to be 3 feet away rather than 10 feet away from my potential victims.  And come what may, I am apparently free to do it.

Now obviously I'm kidding, mostly, but I think it makes an important point.  We all impact each other in potentially grave ways, ways we don't even completely understand.  So as horribly odd as it might sound to intentionally gravitate towards others in an effort to expose them to greater levels of arguably statistically significant electromagnetic radiation, and therein attempt their murder, we're all doing the same thing in some form or other.  It may be you driving a hybrid car which requires lithium dragged from the earth by inadequately protected miners under the boot of a corrupt government.  It may be you tossing out coffee cups that leach chemicals into the Earth that end up in people's drinking water.  We're all killing some part of somebody, and collectively it adds up to a grand conspiracy of serial murder.  As long as we're doing it, we should at least be honest about it.   I am.

^Quinxy