Technical verification of AI systems for SMEs

Test, don't guess: AI systems backed by hard numbers

We measure the quality, cost, response time and incidents of your AI systems — and you get a signed test report for your records.

No general AI consulting. No software sales. We test and we sign.

Quality
92.4%
Cost per answer
0.031€
Response time
2.8s
Incidents
3count

Sample values · SAMPLE

What we measure

Four metrics every AI system in production must deliver — measured on your own tasks.

01

Quality

[%]

Share of factually correct answers on a test set agreed with you, scored against documented criteria.

02

Cost per answer

[€]

Actual provider costs (tokens, API calls, licences) divided by the number of cases handled during the measurement period.

03

Response time

[s, median]

Time from request to complete answer across all test runs; we report the median and 95th percentile.

04

Incidents

[count]

Recorded failures such as invented facts, data leakage, outages or impermissible statements, classified by severity.

How it works

  1. 01

    Call

    30 min

    We clarify which AI system is tested and what it should achieve.

  2. 02

    Self-check

    3 min

    12 questions give both of us a first picture of your evidence.

  3. 03

    Initial audit

    5 working days · €1,490

    Test cases, measurement, analysis. Result: a signed test report.

  4. 04

    Quarterly check

    from €590/month

    Repeated measurement so changes to model or provider don't go unnoticed.

Who it's for

Trades and local service providers

You use AI for quotes, scheduling or emails and want to know whether it works reliably.

Companies with customer-facing AI agents

Chatbots, phone assistants or email agents speak on your behalf. Mistakes cost customers.

Medical practices and law firms

Sensitive data and high duty of care require traceable evidence about the AI you use.

Relevant from 2027 due to documentation obligations.

Sample test report

This is what you get: one page with numbers, findings and a signature. All details below are fictional and for illustration only.

SAMPLE

KI-Prüfservice · Berlin

AI System Test Report

Test object
Customer service email assistant
Client
Example Company Ltd.
Measurement period
5 working days
Test cases
20 · 100 test runs
Report no.
SMP-0000
MetricResultTargetAssessment
Quality92.4 %≥ 90 %✓ met
Cost per answer€0.031≤ €0.05✓ met
Response time (median)2.8 s≤ 5 s✓ met
Response time (P95)9.1 s≤ 8 s✕ not met
Incidents (severe)10✕ not met

Findings

  1. For delivery-time questions, non-existent dates were given in 1 of 100 test runs.
  2. Long emails (> 2,000 characters) push response times above target.
  3. No disclosure of personal data observed in the test runs.

Tested and signed

Maciej Strzelecki

Technical verification, not legal advice and not a certification.

Pricing

All prices in euro. No VAT is charged under § 19 UStG. No hidden costs.

ServicePrice
Call30 minutes, online€0
AI self-check12 questions, 3 minutes€0
Initial audit5 working days, signed test report€1,490
Deep auditInitial audit + infrastructure security checkfrom €3,490
Quarterly checkRepeated measurement, cancel monthlyfrom €590/month

What you get

The scope in plain terms — so you know before deciding what is included and what is not.

Initial audit

€1,490

  • 1 AI system, 1 process
  • 20 test cases from your everyday work — 6 risk categories
  • 100 runs (each case in 5 variants)
  • 10 injection attempts
  • Four metrics: quality, cost, response time, incidents
  • Test report, 3 pages, signed
  • 30-minute result review
  • Remediation list for whoever implements

Not included: infrastructure security check (separate module), legal assessment, load tests, implementation, certification.

Deep audit

from €3,490

  • Everything from the initial audit
  • Plus: security and perimeter check of the infrastructure
  • TLS, security headers, certificates, DNS (SPF, DKIM, DMARC)
  • Services and admin interfaces reachable from the internet
  • Remote access: VPN/ZTNA, MFA, permissions, network segmentation
  • Leftovers in the frontend — API keys shipped by mistake

Not included: exploiting vulnerabilities (no pentest, no CVSS scores), remediation, legal advice, certification, security guarantee.

Quarterly check

from €590/month

  • Repeat of the identical 100 runs
  • Four metrics compared with the previous month
  • 10 injection attempts, repeated
  • Drift detection after model or provider changes
  • Comparison with the industry benchmark
  • Monthly short report, full report each quarter
  • Alert within 24 hours if quality drops by more than 5 points

Not included: infrastructure security check, implementation, new test cases, 24/7 availability. Cancel monthly.

About me

Maciej Strzelecki

Maciej Strzelecki

We test AI systems that are already running — where errors cost customers, money or evidence. Measurement uses documented test cases and criteria fixed beforehand: quality, cost per answer, response time, incidents.

The result is a signed report that is on file when someone asks.

Network and perimeter security
Mikołaj Górko
Legal partner
in discussion
Mikołaj Górko

Mikołaj Górko

Network and perimeter security

Specialist for network security and IT infrastructure. He plans, runs and secures corporate networks; certifications: Palo Alto Networks Certified NGFW Engineer and Juniper Networks Certified Associate (JNCIA-Junos). In the deep audit he is responsible for the security and perimeter check: TLS and security headers, DNS, publicly reachable services and admin interfaces, remote access and network segmentation. No exploitation of vulnerabilities, no remediation.

FAQ

Is this a certification?

No. It is a technical verification with measured values and a signed report. It is not a certification and not legal advice.

Do we have to share our data?

No. We work with test data or anonymised extracts that you choose yourself.

What if there is nothing to improve?

Then that is exactly what the report says. The result still counts as evidence, and there is no obligation to buy anything further.

How long does it take?

The call 30 minutes, the self-check 3 minutes, the initial audit 5 working days from when we get access to the system.

Can we cancel?

Yes. The quarterly check can be cancelled monthly with 14 days' notice.

Who sees our data?

Only the people involved in the audit. We sign a data processing agreement (DPA); processing takes place in the EU.

Request an initial audit

Briefly describe your AI system. I'll get back to you to schedule the 30-minute call.