Uber Releases VSSA Including Need for “Tractable, Credible” Safety Metrics
November 9, 2018|
November 8. 2018
Uber has released its Voluntary Safety Self-Assessment (VSSA). The United States DOT introduced VSSAs in their federal automated vehicle policy 2.0, A Vision for Safety, and in 3.0 Preparing for the Future of Transportation, USDOT emphasized the option for entities to publish documents that demonstrate the safety aspects of automated driving systems to the public.
Five other AV companies have previously released VSSA’s, but Uber’s VSSA release included two major elements that the othersdo not. The document, entitled A Principled Approach to Safety, discusses performance measurement (though Ford does mention performance measurement once in their VSSA), and Uber released it in parallel with an external review of the safety culture at Uber.
The law firm LeClair Ryan conducted the independent review, authored by qualified lawyers with experience on the National Transportation Safety Board, at DOT and with the FAA. Similar to recent rhetoric from DOT, the report draws heavy parallels to safety programs in the aviation industry. It focuses on the importance of safety culture within a company and an industry, using aviation and energy examples, as well as examples in current vehicle manufacturing. The report provides multiple specific recommendations relating to:
- Establishing and implementing a safety management system
- Bolstering leadership, communication, and programming around safety culture
- Extending and enhancing safety training
- Evaluating current and implement future safety policies processes and procedures
Though tailored to observations of culture and procedures at Uber, many of these recommendations can be applied to other AV manufacturers and to the industry as a collective.
The Independent Review of Safety Culture isn’t the only external evaluation Uber recently sought. In 2017 (before the death of Elaine Herzberg in an Uber AV collision in Tempe, AZ), Uber Advanced Technologies Group approached Rand Corporation with support for research in regards to developing a framework for AV safety. The resulting report recommends safety measures for development, demonstration, and deployment of highly automated vehicles (SAE levels 4 and 5). Rand identifies “leading” and “lagging” measures, to assess variables correlated with safety, such as compliance with traffic laws, and actual safety outcomes, such as collisions.
Uber acknowledges in their VSSA that standard, measurable metrics are necessary to quantify the safety of AVs. They state that, “We anticipate that demonstrating safer performance than human drivers will require that we quantify safe driving with tractable, credible metrics.” They cite the Rand report, noting examples, but do not fully develop or explain their own performance measurement or assessment framework.
The closest any of the other submitted VSSAs get to acknowledging the need for performance measures is Ford’s mention that historically, the company tests performance, and Nuro’s identification of the need to measure success. Nuro’s VSSA says, “We measure our success by how many people’s lives are substantially improved by our products,” but they also do not identify measurable metrics to define success, particularly in terms of safety.
As more companies submit VSSAs, public awareness of AV manufacturers’ safety considerations also increases. However, these documents are not all-encompassing assessments of AV safety, and the independent evaluations such as those commissioned by Uber, as well as academic and industry research on safety performance measures associated with automated technologies helps provide external perspective and accountability along the road to enhancing public safety.
September 29, 2023 | Kirbie Ferrell
September 29, 2023 - On September 26 and 27, the fourth annual MOVE America Conference was held in Austin, Texas.
August 31, 2023 | Glendedora Dolce
August 31, 2023 - Amidst a sobering backdrop, the article "Motor Vehicle Crash Deaths Among Children" delves into the distressing...
August 18, 2023 | Anusha Chitturi, Glendedora Dolce
August 18, 2023 - Road traffic fatalities in the United States increased at the rate of 3 percent annually between...
July 28, 2023 | Anusha Chitturi, Glendedora Dolce
July 28, 2023 - The United States has a notoriously high traffic death rate per capita among the OECD countries....
July 28, 2023 | Garett Shrode
July 28, 2023 - Over four years after the last efforts to enact legal authorization for self-driving cars went up...
June 10, 2022 | Ethan McLeod
June 10, 2022 - The House Transportation and Infrastructure Committee’s Subcommittee on Highways and Transit held a hearing this week...
May 20, 2022 | Paul Lewis
May 20, 2022 - We evaluate LA Metro's pilot program for a first-mile, last-mile mobility on demand (MOD) service with...
May 20, 2022 | Jeff Davis
May 20, 2022 - On May 16, the U.S. Department of Transportation solicited applications for $1 billion in grants for...
April 22, 2022 | Jonathan Hammond
April 22, 2022 - Wearing a mask and getting a vaccination can be as easy as buckling a seatbelt. However,...
April 8, 2022 | Jonathan Hammond
April 8, 2022 - It’s past time we center the voices of those who stand to benefit the most from...
March 29, 2022 | Jonathan Hammond
March 25, 2022 - Road user education in the United States is most commonly thought of as driver education, but...
March 11, 2022 | Jonathan Hammond
March 11, 2022 - Altogether, the COVID-19 pandemic increased the prominence of a new breed of on-demand delivery called Delivery...