• 18-OCT-2018

#TestingAutomation - For the first time, Euro NCAP puts automated driving technology to the test

#TestingAutomation
More than 70% of car drivers believe that it is already possible to purchase a car that can drive itself, according to a new #TestingAutomation consumer survey commissioned by Euro NCAP, Global NCAP and Thatcham Research[*].
 
Published to coincide with Euro NCAP’s first assessment of automated driving technology, the survey findings are in stark contrast to the current capabilities of such systems and highlight the significant confusion that exists amongst motoring consumers when it comes to the reality of automated or autonomous driving.
 
As part of its ongoing commitment to independently assess the benefits of new vehicle safety technologies, Euro NCAP has tested the comparative performance of so-called Highway Assist systems in ten cars: the Audi A6, BMW 5 Series, DS 7 Crossback, Ford Focus, Hyundai NEXO, Mercedes-Benz C Class, Nissan LEAF, Tesla Model S, Toyota Corolla and the Volvo V60.  Highway Assist systems combine Adaptive Cruise Control, Lane Centering and Speed Assist Systems to support the driver in driving situations on motorways.
 
Euro NCAP’s key conclusions from these tests include:
  • No car on the market today offers full automation or autonomy.
  • Cars on the market today can provide driver assistance but this should not be confused with automated driving.  The driver remains fully responsible for safe driving.
  • Used correctly, this technology can help the driver to maintain a safe distance, speed and to stay within the lane.
  • These systems should not be used in situations they are not designed for and should not be relied upon as an alternative to safe and controlled driving.
  • Different manufacturers have implemented different approaches to the application of driver assistance technologies in terms of the level of assistance given to the driver.
  • Euro NCAP’s tests assess and highlight these differences and the varying degree of driver support each manufacturer provides.
 
Michiel van Ratingen, Euro NCAP Secretary General said,
“Euro NCAP’s message from these tests is clear - cars, even those with advanced driver assistance systems, need a vigilant, attentive driver behind the wheel at all times.  It is imperative that state-of-the-art passive and active safety systems remain available in the background as a vital safety backup.”
 
The Tests
 
To give consumers a realistic insight into the capabilities of current Driver Assistance Systems on the market, Euro NCAP has developed a series of tests to assess their performance in critical traffic scenarios simulated on a test track.
 
Adaptive Cruise Control (ACC) is a system that automatically adjusts a car’s cruising speed in response to a slower-moving vehicle ahead, maintaining a safe distance.  ACC operates independently of and in addition to other driver assistance systems, already assessed by Euro NCAP, such as AEB and lane assistance which continue to function in the background.
 
The ACC element of Highway Assist is tested in an extended version of Euro NCAP's AEB test, with approach speeds that match those typically seen on European motorways.  These systems are designed to adapt the speed when approaching a slower moving vehicle or one that is braking and, in general, they perform very well in such tests.  However, not all systems perform equally well in tests where the vehicle is approaching a vehicle which has stopped.
 
The most challenging tests for these driver assist systems are the ‘cut-in’ and ‘cut-out’ scenarios.  In the cut-in test, a car from the adjacent lane merges into the lane just in front of the test car.  This is something that happens in everyday traffic and an alert driver will typically anticipate the manoeuvre early and reduce speed accordingly.  For the cut-out scenario, a car in front leaves the lane abruptly to avoid a stopped vehicle ahead, leaving the system only a short time to identify and respond to the situation.
 
A second set of tests has been developed to evaluate the Lane Centering function that continuously supports the driver to keep the car in the middle of the lane.  The amount of steering support provided by each system is determined in a so-called S-bend test at various speeds.  Another test measures the amount of steering effort needed by the driver to swerve around a small obstacle on the road such as a pot hole.  A good driver support system will continue to support the driver during the manoeuvre and will not resist the driver or deactivate.
 
All automated driving tests are performed on a test track with well-marked lanes and, for the cut-in and cut-out tests, make use of a robot-controlled ‘dummy’ vehicle for safe testing.
 
Speed assist is another function that will be required if cars are to become self-driving.  Current systems range from the very simple, in which the driver sets the speed to which the car should be limited, to the sophisticated.  Intelligent Adaptive Cruise Control (iACC) uses digital map data and/or visual data from a camera to identify the ‘local’ speed limit and, at the driver’s discretion, can limit the speed accordingly.  Speed Assist Systems are currently included in Euro NCAP’s regular vehicle assessments and no further tests have been done here.  Only some of the cars tested were equipped with iACC.
 
Besides testing the system’s main functions, Euro NCAP also verifies the information provided by the manufacturer in media, commercials or in the user’s manual to check that no false or exaggerated claims are being made, and that the information on the system and its limitations is sufficiently clear and complete.
 
 
The Results
 
Adaptive Cruise Control:
Both the DS and BMW offered a low level of assistance, with the driver being primarily in control.
The Audi, Ford, Hyundai, Mercedes, Toyota, Nissan, Volvo offered a balance between driver and system assistance.
The Tesla risks an over reliance on the assistance system with the vehicle being primarily in control.
 
Steering:
In the S-bend test, a range of different driver assistance levels was encountered but the Tesla system created the potential for over reliance.
In the small obstacle ‘pot hole’ scenario, all the cars tested allowed the driver to cooperatively steer and manage the situation apart from the Tesla.  The Tesla system does not allow the driver to deviate from the lane centering path and will disengage when a driver inputs steering torque.  Again, this risks over reliance on the system by the driver.
 
Cut in and Cut Out:
Cut-in and cut-out scenarios are the most challenging of Euro NCAP’s tests and all of the cars were found to be seriously lacking.  None of the systems were able to help and crashes could only be avoided if an alert driver braked or steered away from trouble.
These challenging scenarios highlight how important it is that the driver remains attentive and does not over rely on the system.
 
User manual and marketing information:
User manuals generally state clearly what the system limitations are and where they should be used.  None of the systems restrict use by geofencing.
Generally, official marketing content is clear in what the role of the driver is, but in the case of BMW a promotional video for the 5 series is misleading as the driver takes their hands off the wheel where it is assumed that the vehicle can drive autonomously.

Tesla uses a number of promotional videos which also suggest vehicle autonomy.  This creates a mismatch between more accurate information included in the user manual and more misleading information in marketing materials.
 
For a full set of results and individual model data sheets visit the
Euro NCAP Safety Campaign website on 2018 Automated Driving Tests.
 
Editor’s note
 
For full results, visit www.euroncap.com
For media information, please contact Richard Woods at media@euroncap.com.
 
Follow us online and on social media:
 
Twitter:         @euroncap
Facebook:    forsafercars
Instagram:    @euroncap_forsafercars
YouTube:      EuroncapCom
 
[*] Commissioned by Euro NCAP, Global NCAP and Thatcham Research, the #TestingAutomation consumer survey was carried out online by the independent market research company Opinion Matters.  The research was conducted throughout October 2018 and included 1567 car owners from China, France, Germany, Italy, Spain, the UK and US.
All research findings adhere to the Market Research Society Code of Conduct (2010) in the UK and ICC/ESOMAR World Research Guidelines.  Opinion Matters is registered with the Information Commissioner’s Office and is fully compliant with the Data Protection Act (1998).