SafeML based reliability assessment
Coordinated by
IESE
In earlier work, a statistical distance-based measure (SafeML) is proposed for machine learning components. In BIECO project, we propose extension of it with the use of Statistical Distance Dissimilarity across time series to obtain SDD based reliability and robustness estimate (StadRE and StadRO).
Description
Describe the innovation content of the result:
Obtain the statistical distance dissimilarity based reliability assessment which takes into account the distance between the data distributions and the performance.
Who will be the customer?
The customers are researchers, industry that want to assess the reliability of their ML component.
What benefit will it bring to the customers?
Runtime prediction of the ML component reliability.
When is the expected date of achievement in the project (Mth/yr)?
Methodology concept in 09/2022, SafeML based reliability 08/2024
When is the time to market (Mth/yr)?
May need some more maturity after the end of Project
What are the costs to be incurred after the project and before exploitation?
SafeML based reliability assessment will be ready for certain use cases without further investment after finishing BIECO but further generalization and research based on it will need.
What is the approximate price range of this result/price of licences?
Still in discussion-
What are the market size in Millions € for this result and relevant trend?
ML market size was estimated to be ~4 Billion in 2021. Expected to grow upto 120 billion by 2030.
How will this result rank against competing products in terms of price/performance?
The addresses the use of ML in safety/financial critical system where a runtime reliability estimate is needed..
Who are the competitors for this result?
National and international public and proprietary evaluators that implement a runtime simulation-based approach for assuring the safety of self-adaptive systems..
How fast and in what ways will the competition respond to this result?
Creation of a similar solution will take at least three years..
Who are the partners involved in the result?
The concept was evaluated on the use case by 7Bulls
Who are the industrial partners interested in the result (partners, sponsors, etc.)?
7Bulls is interested in the results.
Have you protected or will you protect this result? How? When?
Research publications are provided along the way of the concept development and its validation.
Other results
ResilBlockly
This exploitation result consists in cybersecurity consultancy services supported by ResilBlockly (former Blockly4SoS), a Model-Driven Engineering tool that has been developed in the context of BIECO.
Security tools for AI Investments platform
Secured AI Investments platform using the outcome of the BIECO project.
Log Forgery Blocker
Log Forgery Blocker – a brand new product on the market.
Security evaluation methodology
Security evaluation methodology to evaluate the security of an ICT system. The methodology is based on standards such as ISO 31000 standard for Risk Management, the ISO 29119 standard for Security Testing or the MUD standard…
Monitoring Tool
The monitoring tool is an infrastructure in charge of setting up and managing a monitoring component. It is based on event messages and enables the collection of complex events.
Extended MUD file
The extended Manufacturer Usage Description (MUD) file is an extension of the MUD Internet Engineering Task Force (IETF) standard…
