Online user guide Regulation and accreditation

External quality assessment in QualiChart

Step by step from registering the provider to the cycle certificate, with the screens of each round stage.

QualiChart editorial team

Laboratory professional opens a proficiency testing kit with control sample vials

1. Before you start

The external quality module records the unit's participation in proficiency testing, from the round announcement to the cycle certificate. It follows the actual order of the process: provider, program, program analytes, round (receipt, items, results, check and submission), the provider's official evaluation, nonconformities and appeals, cycle performance and certificate.

  1. Open External quality in the side menu. The group has Rounds, with the number of pending items, Nonconformities, Performance and Programs.
  2. Check the unit in the header. Providers apply to the whole laboratory; programs, rounds and nonconformities belong to the selected unit.
  3. While a setup step is missing, the Rounds screen shows the Start with the setup guide in four steps: Provider, Program, Program analytes and First round. Each completed step is checked, and the link leads to the next one.
Rounds screen of a unit without programs, with the four-step setup guide
Unit without programs: the provider already exists in the laboratory, and the guide points to the next step, registering the program.

The screens in this guide come from QualiChart with demonstration data. The Example Laboratory takes part in PNCQ, with the PRO-EX Clinical Chemistry, Immunology and Hematology programs, and in Controllab, with a Clinical Chemistry program that accepts more than one analytical system per assay. Five users split the roles: Helena Prado is the administrator, Rafael Souza receives the kits and enters the results, Camila Torres checks, submits and records the evaluations, Marcos Lima handles nonconformities, closes rounds and manages the setup, and Juliana Reis works at the North Unit.

2. Permissions, policy and audit trail

Before the first round, the laboratory administrator defines who does each step. In the laboratory menu, the building icon in the header, open the external quality settings. Only administrators change the policy and permissions, and they hold every permission in the module.

  1. In the Permissions tab, each row is a user and each column a permission. The All column checks the whole row.
  2. Separate the roles: who receives the kit, who enters results, who checks and submits, who records the evaluation and who approves.
  3. Click Save changes. Changes apply the next time the screens are opened.
Permissions tab with one user per row and one permission per column
Permissions split by role: Rafael receives and enters, Camila checks, submits and records evaluations, Marcos approves and manages.

When a permission is missing, the action button is disabled and shows the name of the permission required.

External quality permissions
PermissionWhat it allows
Receive kitsRegister rounds, the kit receipt or access to the material, and the items, with acceptance and substitutes.
Enter resultsEnter and correct results, record nonconformities, fill in the investigation and complete the action.
Check and submitCheck results, record the submission and rectifications, record nonconformities and mark the round as missed.
Record evaluationsRecord the provider's official evaluation, record nonconformities, and record and decide appeals.
Approve and closeRecord nonconformities, fill in the investigation, complete the action, decide effectiveness and close rounds.
Manage providers and programsRegister providers, programs, program analytes and certificates, cancel rounds and update a round's rules.
View audit trailSee the module's audit trail and issue the audit trail report.

The Policy tab applies to all of the laboratory's programs:

  • Due soon warning: how many days before the submission deadline the round shows as due soon; the default is 3. The same number warns when an appeal deadline is ending.
  • Rounds to check effectiveness: how many rounds evaluated after the corrective action the system waits for before suggesting whether it was effective; the default is 3.
  • Rounds to flag a trend: how many consecutive rounds with a deviation on the same side of the target flag a trend; the default is 3.
  • Near-limit warning index: the fraction of the acceptance limit from which a still acceptable result gets a warning; the default is 0.75.
  • Require a check by another person before submitting: on by default and recommended against transcription errors. Changing this option recalculates the status and next step of open rounds.
  • Send daily e-mail alerts: on by default; see section 17.
Policy tab with warning days, effectiveness and trend rounds, warning index and check and e-mail options
Laboratory policy: default values, check by another person and daily alerts turned on.

The Audit trail tab lists every addition, change and deletion in the module, with author, date and old and new values. Click a row to see the fields changed. The trail is available to administrators and to users with the View audit trail permission.

External quality audit trail with the date, user, record and operation of each change
Audit trail: the evaluation of round CL-2609 recorded by Camila Torres, one entry per evaluated result.

3. Register the provider

  1. In Programs, click Providers and then New provider.
  2. Choose the template, PNCQ, Controllab or Other provider, and click Use this template. Name, accreditation, website, source of the rules and every grading rule come filled in.
  3. In Provider details, complete the contact, e-mail and phone and click Add provider.
Choice of provider template among PNCQ, Controllab and Other provider
New provider: each template already brings grades, criterion, cycle start and accreditation.

A provider can also be created without leaving the program form, through the link that opens the registration from a template. A provider with programs cannot be deleted: uncheck Active provider so it does not appear in new programs, keeping its history.

List of providers with contact, grades and number of programs
The laboratory's providers: Controllab with one program and PNCQ with three.

The templates bring the initial values below. They are a QualiChart starting point, not the provider's rule: check each item against the participant manual and the laboratory's contract.

Initial values of the provider templates
Template rulePNCQControllabOther provider
GradesB (Good), A (Acceptable) and I (Unacceptable); NA, MC and QI are not countedA (Adequate) and I (Inadequate); NA is not countedA (Acceptable) and I (Unacceptable); NA is not counted
Quantitative resultStandard deviations: |Z| ≤ 1 → B, |Z| ≤ 2 → A, above → IAcceptance limit: |DI| ≤ 1 → A, above → IAcceptance limit: |DI| ≤ 1 → A, above → I
Qualitative and semi-quantitativeMatches → B; does not match → IMatches → A; does not match → IMatches → A; does not match → I
Annual cycleOctober to SeptemberOctober to SeptemberJanuary to December
Annual bandsExcellent from 81%, Good from 75%, Fair from 65% and Poor below thatNoneNone
Certificate11 rounds submitted (monthly) or 3 (quarterly) and a minimum acceptable rate of 75%No criterion in the program; per-assay minimums in the cycleNo criterion
Kit not received72 hours after shipping168 hours (one week) after shipping72 hours after shipping
Appeal deadline30 days from the evaluation releaseNo deadlineNo deadline
Analytical systems per assayOneMore than oneOne

Adjust the rules in Grading rules, on the provider page:

  • Source of the rules: the reference document, such as the participant manual page or the contract, and the date the rules took effect.
  • Grades: code, description and the Acceptable and Counted marks. Also register the grades that are not counted, such as not evaluated, method cancelled and insufficient quantity. At least one acceptable and one unacceptable counted grade are required.
  • Quantitative results: the criterion, standard deviations (Z-score) or acceptance limit (deviation index), the bands with the grade of each one and the grade above the last band.
  • Qualitative and semiquantitative: the grade when the result matches, the grade when it does not match and the semiquantitative tolerance in scale grades; 0 requires the same grade.
  • Annual performance and certificate: cycle start month, annual bands, minimum rounds per frequency and minimum acceptable rate.
  • Deadlines: hours to complain about a kit not received, counted from shipping, and days to appeal, counted from the evaluation release.
  • Analytical systems: whether the provider accepts the same assay from more than one instrument. It is the initial value for new programs.
PNCQ provider page with contact details, a note on the rules and the source of the rules
PNCQ provider: contact details and the source of the rules, with the participant manual and the effective date.
PNCQ grading rules with the grade table and the bands by standard deviations
Grading rules: grades that are counted or not and |Z| bands for quantitative results.

4. Register the program

Register one program for each contracted area, such as Clinical Chemistry, Immunology or Hematology. Each unit has its own programs.

  1. In Programs, click New program.
  2. Choose the provider and enter the Program name as it appears in the contract or on the provider's portal.
  3. Enter the Registration number, the laboratory's code at the provider, printed on the transcription sheet.
  4. Choose the Frequency and check the Rounds per cycle, filled in from it.
  5. Enter the Submission due day. It suggests each round's deadline: that day of the month after the kit is shipped or expected to arrive.
  6. Check Accepts more than one analytical system per assay, which comes from the provider and must follow the contract. When checked, each instrument reported to the provider submits and is evaluated separately; when unchecked, only one instrument submits each assay and the others are internal comparisons.
  7. In Participation period and notes, record the start and end of participation. Click Register a program.
List of programs with provider, frequency, analytes and open rounds
Programs of the Central Unit: three from PNCQ and one from Controllab, all monthly.
Details of the PRO-EX Clinical Chemistry program with registration number, frequency and submission due day
PRO-EX Clinical Chemistry: the form shows the provider's cycle and the certificate requirements.

The program page has the Program details, Analytes, Calendar and criteria and Certificates tabs, plus the Rounds, Performance and New round shortcuts. A program with rounds or certificates cannot be deleted or change provider: uncheck Active program when the contract ends.

5. Link the analytes to internal QC

Each row of the Analytes tab links an analyte of the provider's form to the internal control that measures it, that is, to the analyte on one instrument.

  1. In the Analytes tab, click Choose analytes from internal control. The list shows the analytes linked to the unit's active instruments.
  2. Filter by analyte or instrument, check the ones you want and click Add.
  3. Check each row, which comes filled in: analyte and code at the provider, provider unit, conversion factor and result type. The value submitted is the laboratory result multiplied by the factor, and the screen warns when the units differ.
  4. In System, decimals, method and reagent, enter the analytical system as the provider knows it, the decimals of the provider's form, the method and the reagent, which make up the peer group.
  5. Order the rows with the arrows, in the order of the transcription sheet, and click Save analytes.

For qualitative and semiquantitative analytes, Options as named on the provider's form gives the name the provider uses for each scale option, for example "Reactive" instead of "Positive". Save the analytes before naming the options. For items without internal control in QualiChart, such as a morphological identification, use Item without internal control.

Who submits to the provider and internal comparisons

  • Check Submits to provider on the instrument whose result is entered in the provider's channel. In a program with one system per assay, only one active instrument submits each assay.
  • In a program that accepts more than one system, check each instrument reported to the provider and identify it as on the provider's form. Each system gets its own evaluation.
  • Instruments that measure the same analyte without submitting are internal comparisons: choose the submitting instrument in Compare with. They are evaluated against the target reported for that submission, so they must use the provider's unit and have internal control.
Analytes of the Controllab Clinical Chemistry program with code, unit, factor, submission to the provider and internal comparison
Controllab: glucose submitted by both systems and creatinine on the Cobas c111 as an internal comparison of the Cobas c311.

While an analyte has results in open rounds, unit, factor, submission and comparison do not change. An analyte with results cannot be removed or change control: uncheck Active, and it leaves the next rounds and the items of open rounds that do not yet have its result.

6. Record the calendar and cycle criteria

  1. In the program's Calendar and criteria tab, choose the Cycle. The current cycle and the next one appear, so you can record the calendar as soon as the provider publishes it.
  2. With no saved calendar, the screen proposes the cycle's rounds from the frequency, with the submission deadline from the day set in the program and the rounds already registered in their place. Check each row against the provider's calendar.
  3. In Reference, enter the provider's document, with name and version, or attach the calendar file. One of the two is required.
  4. In the Official calendar, each row is a round: identifier, reference month, type (regular or educational), shipping, expected arrival and submission deadline. Use Add round and the bin to complete the list.
  5. Click Save calendar and criteria.
Official calendar of the cycle with a reference to the provider's document and the status of each round
PNCQ calendar 2026/2027: round P-2610 registered, educational round E-2610 with the kit not registered and the next rounds planned.

The Status column shows Round registered, with its link and status, Planned or Kit not registered. Kit not registered appears when the provider's deadline, counted from shipping, has passed without the round being registered: notify the provider and click Register round. Rounds registered before the calendar are linked with the Bind a round already registered option. Extensions and delays are corrected in the round itself; the calendar keeps the published dates.

When the provider certifies each assay with its own minimum, enter in Certificate criterion by assay the minimum for certificate (%) of each assay submitted to the provider. Left blank, the program criterion defined in the provider's rules applies. The minimums are kept in the cycle, with the same reference as the calendar, and a new cycle starts with those of the previous one for review.

Controllab calendar with linked rounds and the table of minimum for certificate by assay
Controllab, 2025/2026 cycle: rounds linked to the calendar and per-assay minimums of 80% and 90%.

7. Follow rounds and pending items

In External quality › Rounds, the pending items panel groups by type what needs attention in the unit. Each item leads to the right screen and shows the deadline or since when it is pending. The total also appears in the side menu.

External quality pending items panel grouped by type, above the list of rounds
Pending items of the Central Unit: late kits, deadlines, corrections, checks, evaluations, appeals, nonconformities and certificates.

Below the panel, the table shows each round with the program, the Next deadline, the status, the Next step, the acceptable rate and the open nonconformities. The next deadline is the earliest deadline among the items still open, highlighted when overdue or close, and the next step is a direct link to the pending stage. Filter by text, program, status and submission deadline; the status starts at Open.

Round statuses
StatusMeaning
Awaiting kitRound registered; the kit has not arrived or the virtual material has not been accessed yet.
Kit receivedThe receipt was recorded; the items or results are missing.
In analysisExpected assays have no result or, with the check required, results are awaiting the check.
CheckedAll expected assays have a checked result and some results have not been sent in the current version, including corrections to resend.
SubmittedEverything that goes to the provider was sent in the current version; the provider's official evaluation is missing.
EvaluatedThe provider's evaluation of every submitted result was recorded.
ClosedRound completed by the closing action.
MissedThe laboratory did not analyze or did not submit on time, with or without a justified absence.
CancelledCancelled by the provider or registered by mistake; it does not count in performance.

8. Register the round

  1. Click New round and choose the program. Programs without analytes do not appear.
  2. In Round, enter the identifier used by the provider, the Round type and the Reference month, the provider's reference month, which defines the cycle in which the round counts.
  3. In Material and deadlines, choose Physical kit, with samples sent by courier, or Virtual material, with images or cases on the provider's website. Enter the kit's shipping and expected arrival dates, or the date the virtual material was released.
  4. Check the Submission deadline. It follows the program's due day until you edit it.
  5. In Items, register the label codes and, in each item, the expected assays. All active program analytes come checked. More data holds the lot, storage and the item's own deadline.
  6. Click Register round. The identifier cannot repeat within the same program.
New round form with program, identifier, type, reference month, dates and items
New Controllab round filled in from the previous one: CL-2611, November reference month, two items with four assays each.

From the second round on, the identifier, reference month, material, dates, deadlines and items are suggested from the previous round; check them against the provider's announcement. When the cycle has an official calendar, the new round comes with the data of the next calendar round not yet registered and is linked to it.

  • Regular: a round of the program's calendar.
  • Recovery: a kit sent by the provider to replace a regular round that was lost or had rejected material. Choose the regular round in Recovers round; the reference month is the same, and the items that were not rejected come filled in.
  • Educational: does not count in cycle performance.
Round dates
DateWhat it is for
Reference monthPlaces the round in the provider's annual cycle, used in performance and in the certificate.
Shipped by the provider onKit shipping. The kit not received warning appears when the provider's deadline counted from it has passed.
Expected arrivalWithout a shipping date, the kit not received warning appears at the end of this day.
Released by the provider onVirtual material: start of access on the provider's website; there is no kit not received warning.
Submission deadlineBasis for the due soon and overdue warnings and for flagging late submissions.
Item submission deadlineException for one material; left blank, the round's deadline applies. The next deadline is the earliest among the items still open.
Use untilEnd of stability after preparation; makes the analysis time mandatory.

9. Receive the kit and check the items

The round page shows at the top the reference month, material, dates, next deadline and the Round report button. Just below are the stages Receipt and items, Results, Check, Submission, Evaluation and Nonconformities and closing, with the current stage highlighted. The Next step card says what to do, and the warnings flag a late kit, a deadline that is close or overdue, a correction to resend and problems with the material.

Round awaiting the kit, with the stages, the next step and the receipt form
Round P-2610 awaiting the kit, with the warning that the provider's arrival deadline has passed.
  1. Check the kit as soon as it arrives and record Received at, with date and time, the Condition and, when the provider requires it, the Temperature (°C). The conditions are Adequate, Damaged packaging or vial, Incomplete kit and Inadequate temperature.
  2. Any condition other than adequate requires the Complaint to the provider, with the problem and the contact made: date, channel and protocol.
  3. Click Record receipt. Until results are entered, Correct receipt lets you adjust the data.

For virtual material, the stage is called Access to the material: record the date the material was accessed and click Record access to the material.

When one box brings the material for rounds of several programs from the same provider, check in Same kit the rounds of the other programs that arrived together. The receipt is recorded once for all of them, with the same date, condition, temperature and complaint. Register the other programs' rounds first so they appear in the list.

Receipt with the Hematology and Immunology rounds checked in Same kit and the list of items
A single PNCQ kit for the Clinical Chemistry, Hematology and Immunology rounds.

Items and material acceptance

In Items (samples), each item has the label code, the description, the acceptance and the expected assays, that is, the analytes the provider expects for that sample. More data holds the lot, storage, its own deadline, expiry, the replaced item, preparation and stability and the provider's instructions.

  1. Mark each item as Accepted, Accepted with reservation or Rejected. For a reservation, describe what was observed and why the material can still be used; for a rejection, the reason and the contact with the provider.
  2. When the provider sends the replacement, click Register substitute item on the rejected item. The new item is linked to it and inherits the expected assays.
  3. Click Save items.
Kit received with a damaged vial, item 2 rejected with the reason and the substitute item
Round P-2609: kit with a damaged vial, item 2 rejected and the substitute P-2609-2R.

A rejected item does not receive results. While there is no substitute, the round shows the rejected material without substitute warning. With material accepted with reservation or rejected, the screen offers Record nonconformity with the round and the Receipt problem origin already filled in.

10. Enter the results

The grid has one row per analyte and instrument and one column per item, with each item's deadline and acceptance. Only expected assays receive a result: rejected items appear as rejected material, and expected cells still empty are highlighted.

  1. In Analysis, enter the date and the analyst. They apply to new results, and Apply date and analyst to all results repeats them on the others.
  2. Type the number in the laboratory unit. Below the cell appears the value sent to the provider, converted by the factor and with the decimals of the provider's form. For qualitative assays, choose the scale option.
  3. Click Save.
Results grid with one row per analyte and instrument and one column per item
Round P-2609: item 1 entered, item 2 rejected, substitute still incomplete and urea not performed.

The button next to each cell opens the Assay outcome: Result, Not performed or Not applicable. Not performed is reported to the provider, for example with the instrument down; Not applicable is not submitted. The reason is required, and the window keeps the date, time, analyst and notes of that result.

Assay outcome window with Not performed selected, reason, date, time and analyst
Urea on item P-2609-1 marked as not performed, with the reason that will be reported to the provider.

The Internal quality control on the day link on each row shows the runs, rejections, warnings and reagent and calibrator lots on the date of analysis, and whether the control was under observation. With no runs that day, it points to the closest one within 7 days.

Internal quality control on the day window with runs, rejections, warnings and control under observation
Cholesterol on the day of analysis: in control, but under observation after the calibrator lot change.
  • The date of analysis cannot be in the future or before the receipt. The time is mandatory for items with Use until.
  • A value 5 times or more above or below the last known target triggers a warning to check the unit and decimal separator.
  • A submitted result cannot be deleted. Changing it requires the Reason for correction and creates a new version, flagged for resending.
  • A result already evaluated by the provider is locked.

11. Check the results

With the check by another person required in the policy, someone who did not enter the result checks it against the instrument report. Results you entered show as awaiting another person.

  1. Select the results and click Review selected, or check all pending results at once.
  2. Click Download transcription sheet to generate the PDF with the values as the provider's form asks for them, in the portal's order.
Check table with result, value sent, analysis, who entered and who checked
Round P-2609: glucose and cholesterol checked by Camila Torres; the other results are waiting.

The table shows item, analyte, laboratory result, value sent to the provider, date of analysis, who entered and who checked, and identifies internal comparisons and versions to resend. Changing a result undoes its check. Without the requirement in the policy, the check remains available but does not block the submission.

12. Record the submission to the provider

  1. Enter the results in the provider's channel using the transcription sheet.
  2. In Results to send, check the selected results: by item, the ones not yet sent in the current version are listed, including assays not performed. With the check required, unchecked results cannot be selected. Internal comparisons and assays that do not apply are not submitted.
  3. Enter Submitted at, with date and time, and the Submission channel: Provider's portal, E-mail or Other channel.
  4. Record at least one piece of evidence: the protocol, the submission receipt (screenshot or PDF up to 20 MB) or, by marking that the channel gives no protocol or receipt, the reason.
  5. Click the record button, which shows how many results will be submitted and, when something is missing, what to complete.
Submission to the provider with the corrected creatinine marked as a rectification and the date, channel and protocol fields
Round P-2608: the creatinine corrected after the submission goes as a rectification, version 2, after the item's deadline.

Each submission freezes a copy of the results sent, with version, item, analyte, code, system, method, reagent, outcome, value, unit and decimals. The copy is kept in Recorded submissions, with the channel, the protocol or reason, the receipt and who recorded it.

Evaluated round with every stage completed up to the evaluation and the submission recorded with a protocol
Round P-2607: submission through the provider's portal, with the protocol and the 8 results sent.

Results can be submitted at different times, and a submission after the item's deadline is flagged as late. Resending a correction is recorded as a Rectification: confirm that the provider's channel accepted the correction. The round becomes Submitted when every expected assay that goes to the provider was sent in the current version; while one is missing, participation is partial.

13. Record the provider evaluation

When the provider releases the round report, open the Evaluation stage.

  1. Enter Evaluation released on. The date is required to record grades, cannot be in the future or before the last submission and starts the appeal period.
  2. Enter the acceptable rate reported by the provider, to compare with the calculated one, and attach the Evaluation report (PDF).
  3. For each submitted result, transcribe from the report the target, the standard deviation, the acceptance criterion, the number of participants, the provider's index and the Grade. Providers that grade by Z-score ask for target and standard deviation; those that grade by deviation index, target and limit or range.
  4. For qualitative and semiquantitative assays, enter the expected result. For descriptive assays and assays reported as not performed, record only the provider's grade.
  5. Click Save the evaluation. Save report data stores only the date, the rate and the PDF.
Provider evaluation with release date, reported rate and the grid of submitted results
Round P-2607 evaluated by PNCQ: unacceptable cholesterol, with a trend and a pending appeal, and an acceptable rate of 87.5%.

The official grade is the provider's. As you type, the indices and the grade calculated by the round's rules appear as a preview, to compare with the report. The preview only preselects the grade: what is recorded is the chosen grade, which must be the one in the report. Once saved, the row shows Decided by the provider's grade and, when the grade differs from the calculated one, shows the calculated grade.

Indices calculated in the evaluation
IndexCalculationReading
DRM (relative deviation from the mean)(result − target) ÷ |target| × 100Signed percentage deviation, compared with the TEa.
DI (deviation index)(result − target) ÷ limit; with a range, it uses the half on the result's side|DI| ≤ 1 is within the provider's criterion.
Z (Z-score)(result − target) ÷ group SDUsed by providers that grade by standard deviations.
TEa (total allowable error)Percentage and absolute TEa from the analyte setup, in the provider's unit; the larger appliesWithin the TEa when |DRM| ≤ TEa. Informative in the provider's evaluation.

The warnings are Near limit, for |DI| from the policy's warning index, Above TEa, Grade ≠ calculated and Trend, when deviations stayed on the same side of the target in the last consecutive rounds set in the policy. The items of one round count as one point. The TEa and the indices are for comparison and warnings; they never decide an official evaluation.

Each saved evaluation is noted, with the CEQ: prefix, in the comments of the control's last run. A result evaluated by the provider can no longer be changed in the Results stage; the evaluation can be corrected until the round is closed.

13.1 Internal comparisons

Each instrument linked in Compare with to a submitting system is evaluated automatically on the same item, with the target, standard deviation and limit or range recorded for that submission. With the check required in the policy, the comparison only happens after the result is checked. Since there is no provider grade, the provider's criterion decides, then the acceptable range and, finally, the analyte's TEa.

Internal comparisons table with the instrument compared, target, indices and grade
Round P-2607: glucose on the Cobas c111 evaluated against the target of the Cobas c311 submission.

The read-only Internal comparisons table shows what each instrument was compared with, the target, the indices and the grade, or what is still missing for the comparison. An unacceptable internal comparison opens its own nonconformity. These evaluations do not enter the provider's acceptable rate and have no appeal, but they appear in performance by analyte.

13.2 Appeals

  1. If the laboratory disagrees with the evaluation, open the row details in Internal control and appeal, in the Evaluation stage, or use Appeals on the nonconformity page.
  2. Click Record appeal and enter the date, the justification and the document. The date cannot be before the evaluation release.
  3. When the provider answers, record the Provider's decision, with a date not before the appeal.
Cholesterol details with the internal control on the day and the pending appeal with the decision form
Pending cholesterol appeal in round P-2607, next to the internal control on the day of analysis.

The deadline is counted from the evaluation release according to the round's rules; in the PNCQ template, 30 days. After it, the appeal is refused. An accepted appeal requires the Revised grade, which replaces the grade, while the original stays in the appeal, and recalculates the acceptance, the round's acceptable rate and the nonconformities. A rejected appeal keeps the grade. Each evaluation has at most one pending appeal, and internal comparisons have no appeal.

14. Handle nonconformities

When the evaluation is saved, each analyte and instrument with a counted unacceptable result automatically opens a nonconformity in the round, already linked to the results. The origin is Unacceptable result or Unacceptable internal comparison. A round marked as missed without a justified absence opens the Missed round origin.

List of open nonconformities with round, origin, status, responsible and action deadline
Open nonconformities: cholesterol in P-2607 with the deadline overdue and creatinine in P-2603 awaiting effectiveness.

The list filters by status, program and origin, shows only open ones by default and highlights those overdue.

14.1 Manual registration

For warnings, receipt problems or other findings, use Record nonconformity on the row warnings or on the material with a problem: the round and origin come filled in. You can also open Nonconformities and click Record nonconformity:

  1. Search for and choose the round.
  2. Choose the analyte and instrument or the whole round.
  3. Choose the origin: Warning, Receipt problem or Other.
  4. Describe what was observed, when and by whom, and click Record and investigate.
Record nonconformity form with round, analyte, origin and description
Manual registration in round P-2609, with the Receipt problem origin.

The nonconformity page shows the next step and, in What happened, the round, the analyte, the origin, who opened it, the results with target, indices, TEa, grade and warnings, and the internal control on the day of analysis, which helps separate systematic from random error. Progress follows the stages Open, Investigation and action defined, Action completed, Effectiveness checked and Closed, with dates and people responsible.

Nonconformity page with the next step, the result, the internal control on the day and the progress
Cholesterol in round P-2607: result, internal control on the day and progress, with the action deadline overdue.

14.2 Investigation and action plan

In Investigation and action plan, record:

  • the Category, the Root cause and the Catalog causes, the same catalog used in IQC rejections;
  • the Impact on patients, which can be not assessed, no impact, possible or confirmed, with the review of reports or of the affected period;
  • the Immediate correction, what was done with the result and the reports, and the Corrective action, what removes the cause;
  • the Responsible, the Action deadline, the instrument intervention of the last 12 months and documents up to 20 MB.
Investigation form with the checklist filled in, the category, the root cause and the catalog causes
Cholesterol investigation: methodological problem, root cause and catalog cause.

The list at the top of the form shows what is missing. With category, root cause, corrective action, responsible and deadline filled in, Save investigation moves the nonconformity to In progress. The investigation can be edited by users with Enter results or Approve and close, until closing.

Cause categories (CLSI QMS24)
CategoryWhen to use
Clerical errorResult typed, transcribed or sent with an error, such as swapped samples, unit or decimal separator.
Methodological problemLimitation of the method, reagent or calibration, including a peer group difference.
Equipment problemInstrument failure, maintenance or adjustment.
Technical problemExecution error: reconstitution, pipetting, dilution, storage or time until analysis.
Problem with the proficiency testing materialUnsuitable provider sample: matrix, stability or transport.
Problem with the evaluation of resultsUnsuitable provider target, group or criterion, or an evaluation error.
No explanation foundInvestigation completed without an identified cause; the result may have been a random error.

14.3 Action completion and effectiveness

  1. Once the action is carried out, enter the date in Action completion and click Record action completion. The nonconformity moves to Awaiting effectiveness.
  2. Effectiveness check gathers the analyses of the same analyte and instrument made after that date, already evaluated and counted. After the number of rounds in the policy, the system suggests Effective, when all were acceptable, or Ineffective.
  3. Users with Approve and close record the decision at any time. Effective and Not applicable close the nonconformity; Ineffective sends it back for treatment, without the completion date, for a new action. Ineffective and Not applicable require a justification.
Effectiveness check with the analyses after the action, the Effective suggestion and the decision
Creatinine in round P-2603: three acceptable rounds after the action and the Effective suggestion already selected.

The check uses the date of analysis, not the round deadline, and leaves out the analyses of the round itself and those of cancelled rounds. Closing is noted on the control's last run, with the CEQ: prefix.

15. Close the round

The Nonconformities and closing stage lists the round's nonconformities with origin, analyte, category, responsible, deadline and status, and the button to open each one.

  1. Check that every submitted result was evaluated and that each nonconformity has an investigation and action defined.
  2. Click Close the round. The action requires the Approve and close permission and an Evaluated round.
Nonconformities and closing stage with the list of the round nonconformities and the Close the round button
Round P-2607 ready to close: the cholesterol nonconformity has an action defined and is still being followed.

Nonconformities in progress or awaiting effectiveness are still followed on the nonconformities page after closing. Once the round is closed, results, submissions and evaluations can no longer be changed.

Under Missed or cancelled round, or provider's rules are the exception actions:

  • Record as not performed requires the Check and submit permission and only appears without submissions. It asks for the reason and counts the round as missed in the cycle. Check Justified absence when the absence has a documented justification, such as a kit not delivered; in that case, no nonconformity is opened.
  • Cancel the round requires the Manage providers and programs permission and is meant for rounds cancelled by the provider or registered by mistake, which do not count in performance.
  • Update provider's rules, with the same permission, applies the current rules from the provider setup while the provider has not yet evaluated any result of the round.

Recording as not performed and cancelling cannot be undone.

16. Follow cycle performance

In External quality › Performance, choose the program and the cycle. The cycle follows the provider's rules, and each round enters the cycle of its reference month, even with a submission deadline in the next cycle. A recovery counts in the reference month of the round it recovers, and cancelled rounds are left out.

  • Submitted rounds over those planned, with partial submissions or those already evaluated by the provider.
  • Missed rounds, with justified absences and recovered rounds.
  • Acceptable rate, acceptable results among those counted, with the annual band.
  • Certificate, with eligibility and whether the cycle certificate was recorded.
Performance screen with round, acceptable rate and certificate cards, official result and certificate criteria
PRO-EX Clinical Chemistry, 2024/2025 cycle: 12 rounds submitted, one recovered, an acceptable rate of 96.9% and certificate recorded.

The acceptable rate considers only the provider's official evaluations that are counted, from regular and recovery rounds. Grades such as not evaluated, method cancelled and insufficient quantity are left out, as are internal comparisons and educational rounds. In the example, 93 acceptable results out of 96 counted give 96.9%, the Excellent band in the PNCQ template.

Official result and local count puts side by side the result of the provider's certificate, the QualiChart calculation and the difference in percentage points. When there is a difference, check whether every evaluation was transcribed and whether the provider's rules are up to date: the official result prevails. Certificate criteria compares the submitted rounds with the minimum for the frequency and the acceptable rate with the provider's minimum.

Round participation in the cycle
ParticipationMeaningCounts as submitted
CompleteEvery expected assay that goes to the provider was sent in the current version.Yes
PartialPart of the expected assays was sent; the others are still pending or there is a correction to resend.No
PendingNothing has been sent yet.No
MissedThe round was recorded as not performed, without justification.No
Justified absenceNot performed, with a recorded justification; it does not open a nonconformity.No
RecoveredThe absence or rejected material was covered by a complete recovery round.Yes
CancelledCancelled; it does not count in the cycle.—

16.1 Rounds, analytes and trend

Rounds of the cycle lists each round with reference month, deadline, participation, status and the calculated and provider-reported acceptable rates. Analytes shows, by analyte and analytical system, including internal comparisons, the evaluated and acceptable results, the acceptable rate, the mean DRM and the Trend mark when deviations stayed on the same side of the target in the last consecutive rounds.

Rounds of the ongoing cycle and analytes table with the trend mark on cholesterol
PNCQ 2025/2026 cycle: cholesterol in a trend, with a 95% acceptable rate.

Investigate calibration and lots of an analyte in a trend before the result becomes unacceptable. The Cycle report button generates the performance PDF.

16.2 Per-assay certificate criterion

When the cycle has per-assay minimums, the Certificate card shows how many assays reach the minimum, and the Analytes table gains the Minimum for certificate column, with reached or below. An assay with a minimum and no evaluation in the cycle appears without an acceptable rate. The certificate issued by the provider remains the official reference.

Controllab performance with the Minimum for certificate column in the analytes table
Controllab, 2025/2026 cycle: glucose above the minimum on both systems and creatinine on the Cobas c311 below 90%.

16.3 Cycle certificate

  1. When the provider issues the certificate, click Record certificate on the Cycle certificate card of the performance screen or in the program's Certificates tab.
  2. Enter the provider's classification, the reported acceptable rate, the issue date, the certificate file and notes.
Certificates tab with the recorded certificate and the form for the next cycle
Certificates: the 2024/2025 cycle recorded as Excellent and the 2025/2026 cycle with the criteria not yet met.

There is one certificate per program and cycle; recording again updates the existing one. The Certificates tab shows, next to each certificate, the submitted rounds, the annual band and the criteria calculated by QualiChart. Differences point to evaluations not transcribed or rules to review. Recording certificates requires the Manage providers and programs permission. At the end of the cycle, programs whose provider defines certificate criteria show the Cycle certificate not recorded pending item.

17. Receive email alerts

With Send daily e-mail alerts turned on in the policy, QualiChart sends once a day, at 7 a.m. (Brasília time), an e-mail with each unit's external quality pending items, only when there is at least one. Administrators receive the pending items of every unit; other users, those of their unit that match their permissions. Each item brings the deadline or reference date and the link to the round, nonconformity or program, opened in the right unit. The address used is the user's e-mail, or the login when it is an e-mail address.

External quality pending items
Pending itemWhen it appearsWho receives it
Calendar rounds not registeredOfficial calendar round not registered after the provider's deadline counted from shipping.Receive kits
Kits not receivedPhysical kit not received after the provider's deadline counted from shipping or, with no shipping date, at the end of the expected arrival day.Receive kits
Submission deadline approachingAssays without results or results not sent, with the next deadline within the policy's warning days.Enter results or Check and submit
Submission deadline overdueThe same, with the deadline already passed.Enter results or Check and submit
Corrections to resendResult corrected after the submission and not yet resent to the provider.Check and submit
Results to checkWith the check required, entered results not yet checked.Enter results or Check and submit
Provider evaluations to recordSubmitted results without the provider's evaluation.Record evaluations
Appeal deadline endingUnacceptable result without an appeal whose deadline ends within the warning days.Record evaluations
Appeals awaiting the provider's decisionAppeal recorded without the provider's decision.Record evaluations
Nonconformities overdueOpen or in progress with the action deadline passed.Approve and close
Effectiveness to checkAwaiting effectiveness, already with enough analyses for the suggestion.Approve and close
Cycle certificate not recordedCycle ended with rounds, in a program whose provider defines certificate criteria.Manage providers and programs

The same pending items appear in the panel of the Rounds screen and in the side menu counter.

18. Generate reports

  1. In the Reports menu, click External Quality Assessment.
  2. Select one or more of the five reports. The window shows only the fields needed: program, round, cycle, period, nonconformity status, report language, inclusion of documents and background generation with delivery by e-mail.
  3. Click Generate report. A report without documents comes out as a PDF; several reports or the inclusion of documents produce a ZIP.
External quality reports window with the five reports and the program, round and language fields
External quality reports: transcription sheet and round report selected, with the required round and the language.

The PDFs use the header of the other QualiChart reports: laboratory, unit, director, technical manager, period, filters and issue date. The round report, the nonconformities and the audit trail come out in landscape. The report language can be Portuguese, English or Spanish and starts in the system language.

With Include documents (evidence), the ZIP brings the evidence folder with the evaluation reports, submission receipts, appeal and nonconformity documents and certificates linked to the chosen reports. Any external quality permission allows issuing the reports, except the audit trail.

External quality reports
ReportFiltersContent
Transcription sheetRoundExpected assays of each item as the provider's form asks for them, with the submission status.
Round reportRoundIdentification and rules, receipt and items, evaluation with indices, traceability, internal comparisons, appeals, submissions and nonconformities.
NonconformitiesPeriod, program and statusNonconformities opened in the period with category, cause, action, impact, responsible, deadline and effectiveness.
Cycle performanceProgram and cycleParticipation, official result and local count, certificate criteria, rounds, analytes and certificate.
Audit trailPeriodAdditions, changes and deletions in the module with author, date and values.

The examples below were generated with the demonstration data.

18.1 Transcription sheet

It brings provider, program, registration number, round, reference month and deadline and, for each usable item, the deadline, the lot and a table with the expected assays that go to the provider, in the program's order. Each row shows the analyte at the provider, code, analytical system, method, reagent, value as the provider's form asks for it, unit and submission status: No result, To send, Sent or Rectify with the provider. Rejected items are left out.

First page of the transcription sheet of round P-2609 with demonstration data
Transcription sheet of round P-2609: item 1 with urea not performed and the substitute 2R with two assays without results.

An assay not performed comes out with its reason, and To send stays highlighted while the result has not been checked. Use the sheet to enter results in the provider's channel and file it as the transcription record. After the submission, each row shows the data of the version sent.

18.2 Round report

The PDF, titled Round record, is the round's complete record for audits. It brings the identification and the source of the rules used, the receipt with condition, temperature and complaint, and the items with lot, acceptance, substitute and preparation.

First page of the round report for P-2607 with demonstration data
Page 1 of the round record for P-2607: identification, receipt, items and the provider's evaluation.

The following pages hold the provider's evaluation with each result, target, criterion, indices, TEa, grade, calculated preview and origin of the decision, the traceability of the analysis (date and time, analyst, who entered and checked, version, reagent and calibrator lots and correction reasons), internal comparisons, appeals, submissions and nonconformities.

Second page of the round report for P-2607 with the evaluated results and the traceability of the analysis
Page 2: results with indices, grades and warnings and the traceability of each analysis.

18.3 Nonconformities

It lists the nonconformities opened in the period, with the count by status and of those overdue. Each row brings the opening date, round, analyte, origin, category, cause, correction and corrective action with the completion date, impact on patients, responsible, deadline, highlighted when overdue, status and effectiveness, with the decision or the suggestion. Filter by program and status to follow the action plan.

External quality nonconformities report for the last 6 months with demonstration data
Nonconformities of the last 6 months: two closed as effective, one in progress with the deadline overdue and one awaiting effectiveness.

18.4 Cycle performance

It shows the program and the cycle, the summary of planned, submitted, partial, missed, justified-absence, recovered and evaluated rounds, the calculated acceptable rate, the official result, the difference and the band. Then come the certification criteria, the rounds of the cycle, the performance by analyte and system, with mean DRM and trend, and the recorded certificate. With documents, the ZIP includes the rounds' evaluation reports and the certificate.

First page of the cycle performance report for 2024/2025 with demonstration data
Performance of the 2024/2025 cycle: round P-2502 recovered by P-2502R, criteria met and an Excellent certificate.

18.5 Audit trail

It lists, for the period, every addition, change and deletion in external quality with date, user, record, operation and fields changed with old and new values, including the results sent in each version and the expected assays of each item. Laboratory records, such as providers, documents, policy and permissions, appear in every unit; programs, rounds and their records, only in the report's unit.

First page of the external quality audit trail with demonstration data
Audit trail: receipt, results and check of round P-2510, with old and new values.

The PDF brings up to 5,000 records; shorten the period to see the rest. The report requires the View audit trail permission.

To understand what RDC 978/2025, PALC and DICQ require from external quality assessment, read the external quality assessment guide.

Continue studying IQC

See all articles

Regulation and accreditation

Laboratory accreditation

What is laboratory accreditation, how the evaluation process works and why certification is fundamental to the quality of the clinical laboratory.

· 17 min read

Read more

Share this content on WhatsApp

Your next step in quality control

Put QualiChart to the test. Free for 30 days.

Create your account and evaluate QualiChart in your laboratory. Do you prefer a guided introduction? Request a demo with our team.