Skip to Content
← Back to services

Testing and evaluation of AI algorithms

Virtual
Pricing/Discount Options: Call #2
Unique Identifier: 0cfd6203-8615-41e7-982a-15c8b75f3e88

Service Description

This service assesses algorithm performance, development progress, and adherence to AI Act regulations for implementation in clinical practice. The AI validation includes several aspects, aligned with TEF guidelines, and EU regulation: 1) Bias evaluation 2) Accuracy evaluation 3) Trustworthiness evaluation 4) Uncertainty evaluation.
The validation will be offered on three levels, based on the source of the validation dataset: 1) End-user provides the data for validation (input features) 2) End-user provides data for validation at the start from raw data of the initial dataset (data curation and feature extraction on the validation set will be extracted by the Lab within the process of validation) 3) The POLIMI Lab provides a tailored external validation set acquired from other clinical centers.

Keywords: Validation; Bias; Accuracy, Trustworthiness, Uncertainty, AI algorighm AI validation

Offerings: Model & Algorithm (Development, Optimization & Evaluation, etc.) Data Processing (curation, preprocessing & standardization, mining, visualization, anonymization, FAIR, etc.) Data Provisioning (real world and synthetic) Scientific & Medical Communication Testing Conformity & Compliance Software (security, privacy, usability, accountability, fairness, reliability, etc.) Testing Conformity & Compliance Algorithms/Models (transparency, accountability, privacy, fairness, reliability, etc.) Testing Conformity & Compliance Data (transparency, privacy, fairness, accountability, etc.)
Provider Logo

Provider & Contact

Provider Organisation Politecnico Di Milano (POLIMI)
Provider Country Italy
Published Email tef-health@polimi.it
Billing: for validation
Full Price €27.300EUR - 50.800EUR
Reduced Price €20.000EUR - 40.500EUR
Pricing Detail

The price differs based on the need of external dataset for validation. The prices are only tentative and will be further discussed with the SME or startup depending on their needs and the scope of the evaluation.

Operational Details

Service Standards AI Act
  • AI Act

Related services

  • AI cybersecurity evaluation

    Laboratoire National De Metrologie Et D'Essais (LNE)

    Evaluation of the AI system regarding its robustness against cybersecurity issues ( risk assessment, secure Data, access Control and Authentication, etc …) This will include the design of test protocols, the realization of tests, the analysis of results and production of a test reports.

    View service →
  • AI model evaluation/assessment: Clinical model validation

    Unidade Local De Saúde De Coimbra EPE (ULS Coimbra EPE)

    The service offers SMEs expert evaluation and validation of their AI models intended for clinical use. Leveraging the hospital's domain expertise in healthcare and data analytics, this service assesses the accuracy and clinical suitability of AI models in real-world clinical scenarios by assessing models against clinically relevant metrics, benchmarks, and regulatory standards, it ensures their safety, reliability, and effectiveness in real-world healthcare settings.

    View service →
  • AI model evaluation/assessment: Clinical model validation

    Centro Hospitalar De Sao Joao Epe (CHSJ)

    The service offers SMEs expert evaluation and validation of their AI models intended for clinical use. Leveraging the hospital's domain expertise in healthcare and data analytics, this service assesses the accuracy and clinical suitability of AI models in real-world clinical scenarios by assessing models against clinically relevant metrics, benchmarks, and regulatory standards, it ensures their safety, reliability, and effectiveness in real-world healthcare settings.

    View service →
  • AI Model performance evaluation

    Multitel (MULTITEL)

    This service provides an independent and reproducible evaluation of AI model performance using well-established quantitative metrics. The evaluation is conducted in a controlled and documented execution environment to ensure traceability and repeatability of results. Performance is assessed on client-provided datasets and models, and associated measurement uncertainties are systematically analyzed and reported. The service delivers a detailed and interpretable evaluation report. All activities are performed under ISO 9001 certified processes.

    View service →
  • AI performance evaluation based on mixed testing environments

    Laboratoire National De Metrologie Et D'Essais (LNE)

    Based on the domain of the medical device or robot provided by the customer, the simulation will create a test environment relevant to the system to be evaluated using a video-projection system. The service will be provided using the LE.IA Immersion platform, a platform dedicated to the evaluation of AI. It consists of a video-projection system that makes it possible to reconstitute an "artificial nature" and to immerse the systems to be characterised (personal assistance robots, intelligent cameras, civil and military intervention robots, etc.) in a simulated dynamic reality. It allows the system (robot, camera, etc.) to be subjected to a multitude of test scenarios and to evaluate its reactions in a controlled environment.

    View service →
  • AI performance evaluation based on testing datasets

    Laboratoire National De Metrologie Et D'Essais (LNE)

    To ensure that their solution works accordingly regarding a task, AI provider have to evaluate their system using a specific dataset. The performance obtained on this dataset helps to prove the adequate performance of their AI solution. However, the evaluation process can be often quite hard for an AI provider to do properly: the evaluation dataset needs to be correctly qualified, and the creation of the evaluation protocol as well as the analysis of the results are not easy tasks. This service allows AI provider to benefit of the LNE expertise with a full evaluation of their AI system: using an evaluation dataset created for the test or provided by a partner of the TEF project, an assessment of the performance of the AI system is done, and an analysis of its behavior provided. This work also includes a quality assessment of the evaluation dataset. The scope of the analysis of the evaluation results can include robustness and resilience evaluation, depending of the needs of the SMEs. With this service, the customer will have a full assessment of its solution, allowing them to answer the accuracy requirements of the AI regulation, while also having a full report following all transparency and reproductibility requirements. This service generally takes around 2 months, depending of the needs of the customers.

    View service →