Skip to Content
← Back to services

Recommendations on testing and evaluating explainability, robustness, and performance

TEF-Health Service
Consulting Virtual
Unique Identifier: 926778ee-ffa9-444c-b43f-091297debaf9

Service Description

Overview

How can the service help you?

Deploying black-box or fragile AI models creates severe compliance risks, reduces stakeholder trust, and increases the likelihood of unpredictable model failure in clinical practice. This service helps overcome these hurdles by establishing clear testing methodologies.

  • Before: An opaque AI algorithm evaluated only on standard validation metrics, with unknown vulnerability to noise, distribution shifts, or interpretability bottlenecks.
  • After: A robust testing strategy equipped with actionable frameworks for evaluating model decision-making, adversarial resilience, and multi-metric performance.

It enables development teams to build trustworthy AI systems, streamline technical documentation, and align their validation workflows with emerging regulatory and evaluation standards.

How will the service be delivered?

The service is delivered remotely through expert evaluation sessions and technical consultations. Clients provide model architecture specifications, validation data protocols, and system documentation. Our experts assess the setup against established testing frameworks and present targeted recommendations in a technical report and review session.

Additional information

Provider description

Operating from the Department of Artificial Intelligence in Biomedical Engineering at Friedrich-Alexander-Universität Erlangen-Nürnberg, we are a service provider node within the TEF-Health consortium. The research group specializes in machine learning, biomedical signal processing, and multimodal sensor synchronization. Our team provides testing infrastructure and scientific support for evaluating medical devices, wearables, and contactless sensing systems.

Technical details

The advisory framework incorporates peer-reviewed methods for evaluating transparent, secure, and reliable machine learning architectures:

  • Input Data Requirements: AI model files, architecture descriptions, dataset specifications, and current validation documentation.
  • Core Tasks & Processing: Audit of model explainability methods (e.g., attribution maps, feature importance metrics), evaluation of robustness testing techniques (e.g., sensitivity to input noise, distribution shifts, adversarial perturbation analysis), and setup of multi-dimensional performance validation metrics.
  • Outputs: A comprehensive recommendation report detailing concrete protocols for testing explainability, stress-testing model robustness, and setting up rigorous performance benchmark pipelines.
  • Scientific Reference: Aligned with peer-reviewed methodologies for reliable AI evaluation (DOI: 10.1007/s10489-023-04532-5).

Service customization

Clients can tailor the advisory scope to focus on specific testing pillars based on project priority such as focusing exclusively on Explainable AI (XAI) validation to increase clinical transparency or prioritizing adversarial robustness testing for edge-case failure detection.

Offerings: Development of conformity evaluation standards, protocols & tools
Provider Logo

Provider & Contact

Provider Organisation Friedrich-Alexander-Universitaet Erlangen-Nuernberg (FAU)
Provider Country Germany
Ask about this service
Billing: per hour
Full Price 120 EUR
Reduced Price No discount can be provided
Pricing Detail

The price by hour is an estimate.

Operational Details

Service Inputs AI Model + Documentation
Service Outputs Recommendations on Explainability/Robustness/Performance
Certification Support None

Related services

  • 3T MRI Human imaging data acquisition (clinical)

    Centre Hospitalier Universitaire De Rennes (CHU RENNES)

    MRI 3 Tesla (Philips Ingenia Edition X), imaging, data acquisition, clinical

    View service →
  • 3T MRI Imaging data acquisition (Clinical)

    Karolinska Institutet (KI)

    Centre for Imaging Research (CIR) is a world-leading imaging centre at Karolinska Institutet in Sweden in collaboration with SciLIfeLab and RISE. It offers an exceptional and unique collection of core facilities for cutting-edge structural, functional, and metabolic in vivo multimodal imaging and endovascular/minimally invasive surgical techniques. The core facility, MRI Centre, aims to catalyse novel and translational research using MRI. We offer a state-of-the-art 3 Tesla GE SIGNA Premier system-wide bore gantry and high-performance XT gradients. We support all types of MRI studies in humans, ranging from small single-centre projects to large-scale international multi-centre studies. A special focus is on offering MRI suitable for multi-modal integration such as CT, PET, EEG and MEG. The KI MRI Centre also offers a full-service lab for drawing blood and investigating psychophysiology (EDA, PPG, Eye-tracking) along with standardised image post-processing and data storage facilities with cluster computing for data analysis. In this service, we offer full support in project consultation, ethical permits and module technical support. For more information, visit the website: https://imagingresearch.se/facilities/corefacilities/mrc

    View service →
  • 3T MRI Imaging data acquisition (Pre-clinical, Large animal)

    Karolinska Institutet (KI)

    Centre for Imaging Research (CIR) is a world-leading imaging centre at Karolinska Institutet in Sweden in collaboration with SciLIfeLab and RISE. It offers an exceptional and unique collection of core facilities for cutting-edge structural, functional, and metabolic in vivo multimodal imaging and endovascular/minimally invasive surgical techniques. The core facilities, Karolinska Experimental Research and Imaging Centre (KERIC) and the MRI Centre, aim to catalyse novel and translatory research using MRI. At KERIC, we offer a 9.4T MRI for animals such as rabbits and small piglets (see service for small animal 9.4T MRI). A state-of-the-art 3 Tesla GE SIGNA Premier system-wide bore gantry and high-performance XT gradients are available for large animal preclinical studies. We offer specialised services for large animal models as well as ex vivo imaging and support all types of MRI studies in humans, ranging from small single-centre projects to large-scale international multi-centre studies. A special focus is on offering MRI suitable for multi-modal integration such as CT, PET, EEG and MEG. The KI MRI Centre also offers a full-service lab for drawing blood and investigating psychophysiology (EDA, PPG, Eye-tracking) along with standardised image post-processing and data storage facilities with cluster computing for data analysis. In this service, we offer full support in project consultation, ethical permits, module technical support and animal technicians. For more information, visit the website: https://imagingresearch.se/facilities/corefacilities/mrc Or https://imagingresearch.se/facilities/corefacilities/keric

    View service →
  • 7T MRI Imaging data acquisition (Clinical)

    Karolinska Institutet (KI)

    Centre for Imaging Research (CIR) is a world-leading imaging centre at Karolinska Institutet in Sweden in collaboration with SciLIfeLab and RISE. It offers an exceptional and unique collection of core facilities for cutting-edge structural, functional, and metabolic in vivo multimodal imaging and endovascular/minimally invasive surgical techniques. The core facility, MRI Centre, aims to catalyse novel and translational research using MRI. A unique next-generation clinical 7 Tesla Siemens MAGNETOM Terra.X. equipped with an ultra-high field scanner also offers cutting-edge gradient performance (130 mT/m at 250 T/m/s), parallel transmission, as well as deep learning-based acceleration and denoising for improved image quality. Micrometre resolution in vivo for microstructural imaging and layered fMRI. We support all types of MRI studies in humans, ranging from small single-centre projects to large-scale international multi-centre studies. A special focus is on offering MRI suitable for multi-modal integration such as CT, PET, EEG and MEG. The KI MRI Centre also offers a full-service lab for drawing blood and investigating psychophysiology (EDA, PPG, Eye-tracking) along with standardised image post-processing and data storage facilities with cluster computing for data analysis. In this service, we offer full support in project consultation, ethical permits and module technical support. For more information, visit the website: https://imagingresearch.se/facilities/corefacilities/mrc

    View service →
  • 9.4T MRI Imaging data acquisition (Pre-clinical, Small animal )

    Karolinska Institutet (KI)

    Centre for Imaging Research (CIR) is a world-leading imaging centre at Karolinska Institutet in Sweden in collaboration with SciLIfeLab and RISE. It offers an exceptional and unique collection of core facilities for cutting-edge structural, functional, and metabolic in vivo multimodal imaging and endovascular/minimally invasive surgical techniques. The core facility Karolinska Experimental Research and Imaging Centre (KERIC), we have a preclinical 9.4T Bruker USR 94/30 MRI system. The state-of-the-art 9.4T MRI is equipped with single-mouse, single-rat, or double-mouse beds. It has three gradient bore sizes to arrange an effective inner diameter of 20cm (large animals), 12cm (medium animals) or 6cm (small animals). Methods in anatomical imaging, fMRI, Ex vivo, Pharmacological MRI and Cardiac imaging (CINE). For the mouse brain, a 4-channel phased array cry-coil drastically increased signal-to-noise. In this service, we offer full support in project consultation, ethical permits, module technical support, animal technicians and data analysis. We can host animals directly or indirectly through collaboration within KU (AKM) and other animal labs. For more information, visit the website: https://imagingresearch.se/facilities/corefacilities/keric

    View service →
  • Access to Compound Collection

    Karolinska Institutet (KI)

    The Unit: Chemical Biology Consortium Sweden (https://www.scilifelab.se/units/cbcs/) The infrastructure is part of Science for Life Laboratory (SciLifeLab) which is an academic collaboration between Swedish universities (including Karolinska Institutet) and a national research infrastructure with a focus on life science. Chemical Biology Consortium Sweden (CBCS) is a national research infrastructure offering an extensive portfolio of services - from computational and organic chemistry to phenotypic small molecule screens in cells and model organisms, cell painting and functional precision medicine. The mission of CBCS is to provide a state-of-the-art platform and expertise for the generation of high-quality bioactive chemical tools (small organic molecules) for applications within life science research in general and with the ultimate goal to explore complex biology. Our units comprise compound handling labs (hosting the SciLifeLab Compound Collection of ca 350,000 molecules), screening labs (microtiter format liquid handling robotics and a wide range of plate readers), and chemistry labs (equipment and instrumentation for organic chemistry synthesis and analysis). The service: Access to compound collection https://www.cbcs.se/the-compound-collection The Scilifelab Compound Collection is managed by the Compound Center at CBCS KI, and is based on donations of high-quality sets from the pharmaceutical industry (Biovitrum, Karobio, Orexo/Biolipox, KDev) and has been developed and expanded with compounds from various commercial compound vendors. The compounds can be readily available in assay-ready plates through acoustic nano-litre scale liquid dispensing or in 96-tube racks; compounds are stored at 10mM concentration in DMSO solution at - 20 °C under humidity control. We provide: o Management, storage, and processing of solids and liquids. o Compound delivery and interface with key customers. o Performance of instruments and automation that support these operations. o Analytical techniques used for quality assurance. o Sample informatics, including registration and compound quality data.

    View service →