Featured Post

This is the Kodak Moment for the Auto Industry

Plug-In Drivers Not Missin' the Piston Electric vehicles are here to stay. Their market acceptance is currently small but growing...

Sunday, June 1, 2025

Lidar or Camera, Which Sensor Will Win for Autonomous Vehicles?

 Autonomous Driving: A Revolution in Motion

Imagine a world where getting around is as easy as tapping an app, no matter who you are. When autonomous vehicles hit the mainstream, they’ll rewrite the rules of personal mobility. For the blind or elderly, who often face the isolation of being homebound, self-driving cars promise freedom. No longer will a lack of driving ability mean missing doctor’s appointments, social gatherings, or simple errands. These vehicles will be like loyal chauffeurs, ready to whisk anyone, anywhere, safely and reliably. This isn’t just convenience; it’s a lifeline to independence.

Tesla wants to be a primary transportation provider with their Robotaxi service, launching in June of this year. What's different about Tesla's implementation is that it is camera-based and could scale very quickly. Unlike competitors leaning on pricey, specialized sensors like LiDAR, Tesla bets on common cameras as its primary eyes. Vehicles with LiDAR and trunk-sized datacenters might work in select test zones, but they’re like gourmet dishes only available at a few elite restaurants. Tesla’s approach is the food truck of autonomy: affordable, adaptable, and ready to serve the masses. Scalability matters if we want self-driving cars everywhere, not just in elite regions.

I received some feedback on the last article saying that LiDAR was a must-have for safe autonomous driving, but let’s debunk that. LiDAR (LIght Detection And Ranging) uses laser pulses to map surroundings. It is very useful in many applications, but it also has serious blind spots. LiDAR cannot see the color of traffic lights or detect when another car’s brake lights are on, both of which are critical for safe driving. LiDAR struggles in bad weather, as rain, snow, or fog scatter the laser pulses, clouding its view. Plus, LiDAR is expensive, driving up costs for vehicles; affordability is required for a mass-scale solution.

LiDAR-based systems use cameras to catch what the lasers miss, like traffic light colors. That's right, all autonomous vehicles (LiDAR or not) use cameras. However, having both LiDAR and camera input leads to the sensor fusion problem. Sensor fusion is the artful science of blending data from multiple sensors. Combining these different sensor streams creates a problem: What happens when sensors disagree? If one sensor claims it’s raining while another warns that you're heading towards a brick wall at 70 MPH, which do you trust? This clash can confuse the driving AI, causing the AI to make poor or dangerous decisions. Tesla’s camera-only approach sidesteps this by providing one consistent data stream to the AI’s path planning and decision-making processes.

Autonomous vehicle (AV) cameras often sense beyond the human-visible light spectrum, which spans ~400 to 700 nanometers. Many AV cameras also detect shortwave length infrared light, from 700 up to 1100 nanometers, allowing them to see in the dark for improved night vision. This gives AV cameras an edge over human eyes. At night, these cameras excel, capturing clear images in near darkness.

Because AV cameras cover a spectrum of light frequencies, including visible and shortwave infrared, they have an advantage over LiDAR's single laser frequency. The broader spectrum of the cameras allows them to capture diverse visual data. In a way, cameras are already receiving multispectrum data that's "pre-fused" to a single video stream. LiDAR, on the other hand, operates at a fixed frequency (typically 905 nm or 1550 nm). LiDAR excels at depth mapping but misses color and texture details.

The question is, will Tesla's camera-based FSD be safe enough? Crashes will happen at some point. Every AV program of note has had incidents. A fatal crash ended Uber's self-driving program. We'll see if Tesla can navigate this rubric.

Autonomous driving is poised to transform lives, especially for those sidelined by mobility challenges. Tesla’s scalable, camera-driven solution is like that trusty food truck, bringing freedom to every corner, not just the fancy neighborhoods. By avoiding LiDAR’s limitations and the ambiguity of sensor fusion, Tesla is cooking up a future where self-driving cars will be as common as smartphones. This isn’t just about getting from A to B; it’s about giving everyone a ticket to ride, no matter their circumstances.

Disclosure: I am long Tesla