Ottawa company Sensor Cortek training autonomous vehicles to navigate through snow and storms
Snow can be hard to distinguish for sensors, which are often obscured and confused by bad weather, to detect, making it even more difficult to train self-driving vehicle software and algorithms.
When a major snowstorm hits Ottawa, most residents retreat indoors, griping about the weather and the heaping piles of snow they’ll soon have to shovel.
But for Fahed Hassanat and his team at Sensor Cortek, a big dumping of snow is cause for excitement.
“The badder, the better,” said the Ottawa-based software company’s chief operating officer and head of engineering.
“Nowadays you don’t get those heavy snowfalls as frequently as before, so whenever they happen, we just rush rush, rush.”
Drivers for Sensor Cortek get behind the wheel of a car covered in sensors from bumper to rooftop and hit the road in order to solve one of Canada’s biggest roadblocks to autonomous vehicle adoption: snow.
Snow can be hard to distinguish for sensors, which are often obscured and confused by bad weather, to detect, making it even more difficult to train self-driving vehicle software and algorithms.
And it’s not just snow that poses a problem.
“You have the snow, you have the rain, you have the fog, you have the dust,” said Hassanat.
To teach a car to cope with whatever Mother Nature throws its way, Sensor Cortek outfits vehicles with laser imaging, detection and ranging (Lidar) sensors, radar, cameras and advanced GPS systems.
Lidar sensors emit laser beams and capture the reflections of these beams from the environment to create clouds of points in 3D space that provide information about location of objects in that space. Radar relies on electromagnetic waves to capture information about surroundings.
“(Radar) is a very complex sensor but what’s so good about the sensor is that it can be covered in mud,” Hassanat said. “You can put it any weather condition and they will still operate.”
Lidar and cameras are based on having line of sight, making them vulnerable to any obstruction between the sensor and the object it needs to detect, whereas radar doesn’t need to “see” an object to detect it.
They generate about 10 gigabytes of data for every minute Sensor Cortek uses them, often at Area X.O, a private, 1,850-acre site in Ottawa with a 16-kilometre track, where equipment ranging from farming machinery and military tanks to emergency vehicles can be tested.
The work to get driverless cars ready to handle any weather is crucial because even the simplest car manoeuvers can be complicated by bad driving conditions and make for “terrible, dangerous scenarios,” said William Melek, director of the University of Waterloo’s RoboHub, a robotics and automation research hub.
After a drive, Sensor Cortek uses the captured data to train artificial neural network models, which later can be paired with the sensors to detect road users in all weather conditions and enable vehicles to make safer decisions.
The end goal for Sensor Cortek is creating a deep neural network and AI-based perception systems that can make autonomous vehicles — and anything else needing sensors of the same nature — “see” better in all visibility conditions and ultimately, operate safety.
Auto and tech companies developing autonomous cars have encountered difficulty in extreme weather conditions, Google owner Alphabet Inc. admitting its own driverless vehicle project had found snow a struggle as far back as 2015.
