Evaluating your provider

How to evaluate the managed IT provider you already have.

Start with the service you agreed and the needs you have now. Ask for relevant records, check what they establish and keep unanswered questions visible. Use the findings to decide what to retain, correct or investigate further.

In short

Evaluate your IT provider by comparing agreed services and current business needs with dated evidence. Record the scope of each document, what it establishes, what remains reported but unverified, and any missing information. Discuss unresolved issues before deciding whether to keep the arrangement, request changes or investigate a replacement.

Is my IT provider doing a good job? Start with specific commitments

Choose the concern or decision you want to resolve. Put the agreement and service schedule beside your current requirements. Identify the relevant systems, responsibilities and review period before asking whether delivery matches the commitment.

Include your team's experience of responsiveness and disruption, with dates and examples. Keep those observations separate from questions about controls or services the team has not checked. A positive experience with support does not, by itself, establish that a recovery test succeeded.

Request evidence matched to the question

The Canadian Centre for Cyber Security's Cyber security considerations for consumers of managed services (ITSM.50.030) covers provider assessments, access control, recovery and exit arrangements. Use those topics to frame questions relevant to your own agreement and systems.

Suggested evidence requests and the limits to record
QuestionAsk to inspectKeep this limit visible
What supports the reported security work?The agreed controls, covered systems, dated reports and open findingsA tool name or report title alone does not establish that a control works
Who has administrator access?An account list with its date, system coverage, authorisations and unresolved exceptionsA list for one system says nothing about accounts in systems it does not cover
What recovery has been demonstrated?A restore-test record naming the systems, date, result and unresolved issuesA successful test establishes a result within its test conditions, not every future recovery outcome
Does the reported service match the agreement?The service schedule beside records for the same periodA report stating that work is complete is a reported claim until its supporting evidence is checked
What happened to agreed actions?The action, owner, agreed date, current status and supporting recordAn open item needs context: check approvals, scope and any agreed change before assigning responsibility
Do billed quantities match the available records?Invoices, agreed charging units and relevant user, device or licence records for the same periodAn unexplained difference is a question to investigate, not a finding of overcharging
What changes need planning?Relevant supplier support notices, system requirements and proposed workA proposed plan is not evidence that a change has been completed

A request you can adapt

Agree a practical response date that fits the decision and the work needed to gather records. Use the provider decision worksheet to record findings, their limits and follow-up actions. It includes an illustrative example and blank rows; it does not calculate a score.

Separate the record from what it proves

For each answer, record the document reference, date, scope, what you inspected and what remains unknown. Use these suggested categories to keep the discussion clear. They are not ratings of your provider.

Suggested ways to record an answer
What you haveWhat to recordNext step
A supplied recordWhat the record says, its date and the systems it namesCheck whether it answers the question; identify any further verification needed
A reported claimThe statement and who made it; supporting evidence not yet checkedRequest the relevant record or test and clarify what it would establish
Missing informationThe unanswered question and the evidence requestedAsk what is available, who can provide it and when to follow up
A stated exclusionThe provider's explanation and the relevant agreement wordingConfirm the scope and decide how the business need should be met
A verified observationThe check performed, result, scope and who performed itRecord the finding without extending it to untested systems or future performance

Discuss the gap and the proposed response

Ask whether the concern involves an agreed commitment, a changed requirement, an exclusion or something still unresolved. If corrective work is proposed, record the action, owner, approval, cost treatment and how completion will be checked. Use dates suited to that work and your decision; do not substitute a generic review interval.

If the same fault keeps returning, use the recurring-problem evidence request. For questions about reporting, use what your provider's monthly report should show.

Record whether to keep, improve or investigate a replacement

Compare the supported findings, unresolved questions and business requirements. Record why you want to retain the arrangement, seek specific changes or explore another provider. Set a next action and owner for anything still open. A missing document alone should not determine the decision.

If renewal is the trigger, use the renewal guide to confirm the actual notice requirements and organise the review around them. If alternatives are needed, compare proposal scope and assumptions against the problems you want addressed.

Use online reviews for the claims they actually describe

Read what a reviewer says happened, when it happened and what work they describe. A review that does not discuss a restore test cannot establish its result. A testimonial about one project does not establish how your different systems will be supported.

Treat a claim in a review as a claim to assess. Look for context and corroborating information where it matters to your decision. Apply the same questions to the current provider and any proposed replacement; do not infer technical quality from a star rating alone.

Know when the question needs further verification

Collecting documents is not the same as independently verifying their accuracy or the systems they describe. If a decision depends on configuration, technical testing or interpreting a report beyond your expertise, involve someone qualified to assess that question. Define the scope and record what remains outside it.

actually. offers an independent review of evidence about your existing IT provider.

The review is a paid service.

See the actually. review to discuss the question, evidence and scope.

Common questions

How often should I evaluate my IT provider?
Set a review schedule around your agreement, business needs and unresolved issues. If renewal is approaching, confirm the actual notice requirements before choosing dates. Revisit a question when relevant circumstances or evidence change; this guide does not prescribe a universal annual or ninety-day interval.
How should I raise concerns with my provider?
Describe the concern, the relevant service commitment and the evidence you want to inspect. Agree who will respond and a suitable date. Assess the substance of the reply and follow-up work; do not treat a friendly or defensive reaction alone as evidence of delivery quality.
What if my provider cannot supply a requested document?
Record what is missing, ask whether another record answers the question and clarify whether the requested work or reporting was in scope. Keep the issue unresolved until you have a basis for a finding. Do not assume missing paperwork means either that the work was done or that it failed.
Sources

Discuss a paid independent review of the evidence about your current IT provider, with a scope matched to your question.

Discuss an Independent Review

Free PDF  ·  5 pages

Get a free five page PDF checklist with ten questions to ask your IT provider.