New technology gives smart cars 'x-ray'-like vision

The autonomous vehicle uses game changing tools that allows it to ‘’see the world around it using x-ray style vision that penetrates through to pedestrian blind spots.

The technology has been developed as part of a project funded by the iMOVE Cooperative Research Centre in collaboration with the University of Sydney’s Australian Centre for Field Robotics and Australian connected vehicle company Cohda Wireless. iMove has today released its new findings in a final report following three years of research and development.

The technology’s applications, which are being commercialised by Cohda, involve an emerging and promising technology for intelligent transportation systems (ITS) called cooperative or collective perception (CP).

Using roadside ITS information sharing units (‘ITS stations’), vehicles can share what they ‘see' with others using vehicle-to-X (V2X) communication.

This system significantly increases the vehicles’ range of perception by allowing them to tap into various viewpoints.

The engineers and scientists developing the technology said it could benefit all vehicles, not just those connected to such a system.

"This is a game changer for both human-operated and autonomous vehicles which we hope will substantially improve the efficiency and safety of road transportation," said Professor Eduardo Nebot from the Australian Centre for Field Robotics.

“Using collective perception, the connected vehicle was able to track a pedestrian visually obstructed by a building. This was achieved seconds before its local perception sensors or the driver could possibly have seen the same pedestrian around the corner, providing extra time for the driver or the navigation stack to react to this safety hazard," he revealed. 

Another experiment demonstrated how collective perception could allow vehicles to safely interact with walking pedestrians, with the vehicle’s response based on the perception information provided by the roadside ITS station.

The three-year project also demonstrated the expected behaviour of a connected vehicle when interacting with a pedestrian rushing towards a designated crossing area. 

“Using the ITS system, the connected autonomous vehicle managed to take preemptive action: braking and stopping before the pedestrian crossing area based on the predicted movement of the pedestrian," Professor Nebot said. 

“The pedestrian tracking, prediction, path planning and decision making were based on the perception information received from the ITS roadside stations. 

"Collective perception enables the smart vehicles to break the physical and practical limitations of onboard perception sensors.”

The project’s lead researcher Dr Mao Shan said the research confirmed using CP could improve awareness of vulnerable road users and safety in many traffic scenarios. 

“Our research has demonstrated that a connected vehicle can ‘see’ a pedestrian around corners. More importantly, we demonstrate how connected autonomous vehicles can safely interact with walking and running pedestrians, relying only on information from the ITS roadside station," he said.

Cohda Wireless Chief Technical Officer Professor Paul Alexander said the new technology could be a game changer for both human operated and autonomous vehicles. 

“Collective perception enables the smart vehicles to break the physical and practical limitations of onboard perception sensors, and embrace improved perception quality and robustness,” Professor Alexander said. 

iMOVE Managing Director Ian Christensen said the project was a great example of industry collaborating with scientists to develop new innovations for commercial and public good, not only for the benefit of Australians, but road users all over the world, including pedestrians and cyclists.

"When we bring industry and scientists together, we can achieve many great things as a nation. iMOVE CRC is proud to have initiated this exciting project and many others like it - which are all about getting our best and brightest minds working together to develop new technologies and innovations for real-world problems and needs," said Mr Christensen.

ABOUT iMOVE

iMOVE is the national centre for collaborative R&D in transport and mobility. It facilitates, supports and co-funds research projects that improve the way people and goods move in Australia. It has 44 industry, government and academic partners and has over 50 projects completed or currently underway in a broad range of transport areas.  

ABOUT COHDA WIRELESS

Cohda Wireless is a global leader in the development of Connected Vehicles and Connected Autonomous Vehicle software with proven applications for Smart City, Mining, and other environments. Cohda’s technology connects vehicles with infrastructure and pedestrians to make streets, cities and working environments safer, smarter, and greener. Cohda is headquartered in Australia and has offices in Europe, China, and the USA. 

DECLARATION

In 2017, the federal government granted a group of leading industry and research organisations known as the iMOVE Co-operative Research Centre (CRC), $55 million over ten years to explore intelligent transport systems.