The U.S. Air Force has, for the first time, live-streamed data directly from the F-35A stealth fighter and onto a commercial computer tablet in the cockpit, during ground tests at Nellis Air Force Base in Nevada. The March 31 trial, part of the Fighter Optimization eXperiment, or FoX, demonstrated that data from the jet could be used to communicate with mobile apps running on the tablet and there are hopes that the same concept could be used in the future on other manned fighters, as well as drones.
In the initial trial, the flight test instrumentation system was streamed from the F-35’s onboard systems and onto the tablet, on which apps were running. The first two such apps, developed under Project FoX, are designed to help the pilot of the stealth jet negotiate hostile air defense systems, and to use artificial intelligence (AI) to combat the same types of threat.
U.S. Marine Corps
A pilot at Eglin Air Force Base, Florida, using an F-35 Full Mission Simulator.
Until now, although F-35 pilots regularly fly with a tablet on their knee, these haven’t been fully integrated with the cockpit and were not able to be physically plugged into the jet and receive real-time data from its own mission computers and its hugely powerful sensor suite. Now, as well as at Nellis, F-35s at Edwards Air Force Base and at Naval Air Weapons Station China Lake, both in California, are also trialing the FoX Tablet interface. So far, the work had only been conducted with the jets on the ground but, once safety and security aspects are addressed, they will be used in the air, too.
[…]
Previously, this type of information would be presented to the F-35 pilot on the all-glass touchscreen display, which can be customized to present different data, and via the helmet-mounted sight. Both have been the subject of various criticisms in the past, with pilots, for example, pointing to the apparent high degree of latency in information reaching the helmet, which has also been compared unfavorably to a traditional head-up display. The touchscreen doesn’t have any tactile feel or feedback, which can make tapping-in commands a bit challenging during certain environmental and combat conditions.
Even with these existing cockpit interfaces working seamlessly, there is still an argument to be made for having an additional source of situational awareness (SA), especially for the demanding SEAD mission, or other highly complex roles that the F-35 is increasingly finding itself used for, in the form of a tablet. A tablet is portable and, thanks to apps, can present a different tactical picture, or data set, than the other displays. Indeed, tablets are now a frequent fixture in the cockpits of — typically older-generation aircraft — to provide, for example, a means of displaying targeting pod data, or datalink-provided tactical and SA information, as well as flight manual and procedural info.
[…]
“There is no reason why I can’t test the same capability and app on F-18 before F-35 or risk reduce software on F-35 for use by unpiloted aircraft,” LeClair explained. “By connecting a tablet to an aircraft’s data bus, the warfighter and tester will be able to utilize an entire DoD Combat App store of tools, customized to help solve tactical problems in real time.”
[…]
As to how pilots will adapt to the FoX Tablet, LeClair said that “They want this, and they want it yesterday,” noting the “tremendous support from combat aviators.” LeClair likened the tablet concept to an electronic flight bag, the electronic information management device that has replaced the paperwork previously used for flight management tasks. In this way, the FoX Tablet would likely include flight maps, operating manuals, and perhaps even aircraft diagnostic data, as well as a range of apps optimized for different missions or test programs.
The tablet could also allow data to be displayed differently than what an aircraft’s cockpit displays will allow. For instance, 3D situational awareness display rendering, where threats and other situational and navigational information are displayed in a spatially volumetric form, can provide a huge advantage for aircrews trying to survive in a very dynamic and hostile environment. Some of the latest aircraft have wide area displays and graphics capabilities to do this. As far as we know, the F-35, whose systems are based on nearly 20-year-old tech today, is not capable of being able to generate this type of visual interface. But a tablet could be able to without upgrading the entire cockpit and its backend computing systems that drive its visual interfaces.
Boeing
The Super Hornet Block III’s wide-area display and powerful display processing technology can show a 3D instead of a 2D render of the situation around the aircraft at any given time.
After the FoX Tablet comes the FoX BoX, which should optimize its utility in the cockpit. This is being developed at NAWS China Lake, home to ongoing F/A-18E/F Super Hornet mission systems test work. It aims to use a cyber-secure chipset to run “high-level, AI-capable computer processors that will serve as an operating system to communicate to aircraft, allowing the FoX Tablet to function mainly as a visual interface for aircrew.“
Meanwhile, ground tests of the tablet will continue on the F-35, before moving to the F/A-18, F-16, and the F-22. A first test flight — aboard an as yet unconfirmed platform — should take place later this year.
U.S. Marine Corps
Boeing