BiasLens Methodology NoteEvidence before conclusion.
BiasLens is designed to help organisations distinguish what their evidence demonstrates, what represents a credible risk, what remains emerging, and what has not been established.
This note explains the public methodology principles behind BiasLens. It is not legal advice, a conformity assessment, or a substitute for formal sector-specific or jurisdiction-specific review.
1. Unit of assessment
BiasLens assesses a defined AI-enabled system, workflow or decision process. The assessment boundary includes the purpose of the system, the decision context, available evidence, affected groups, controls, oversight and material unknowns.
Architectural principle: systems, not people. BiasLens is not designed as employee monitoring, productivity surveillance or individual scoring.
2. Bias taxonomy
The BiasLens bias taxonomy is grounded in Friedman and Nissenbaum’s peer-reviewed, vendor-independent academic work on bias in computer systems. BiasLens uses the categories preexisting bias, technical bias and emergent bias as a transparent foundation for examining where bias pathways may arise.
BiasLens also uses the operational term Bias Drift for material change over time. That term is BiasLens terminology aligned to the problem of emergent bias; it is not presented as wording from the 1996 paper.
3. Evidence strength is separate from severity
A serious potential harm does not automatically mean the available evidence is strong. BiasLens keeps those concepts separate so that concern is not mistaken for proof.
- Demonstrated: supported by available evidence.
- Credible risk: a substantiated concern that warrants attention.
- Emerging evidence: a signal that is not yet sufficiently established.
- Not established: the current evidence does not support the conclusion.
4. Uncertainty is preserved
“Not sure” is kept distinct from “No”. Missing documentation, unclear vendor claims and unknown affected-group evidence remain visible as uncertainty rather than being converted into reassurance.
This is deliberate: a known unknown is a governance question that can be assigned, investigated and tracked.
5. Fairness signals are not legal findings
BiasLens may use outcome comparisons and fairness measures where the underlying data is appropriate. A disparity or disparate-impact ratio is treated as a signal for investigation, not a determination of causation or unlawful discrimination.
The determination ladder is: outcome difference → evidence; possible concern → finding; cause → requires investigation; unlawful discrimination → legal determination.
6. Small-sample guardrails
BiasLens applies conservative minimum-sample guardrails to reduce false certainty and privacy risk. Current product methodology uses approximately 30+ observations for more reliable interpretation, treats smaller samples as indicative, and avoids reporting very small groups where privacy or statistical validity is compromised.
These are platform methodology thresholds, not statutory thresholds or legal safe harbours.
7. Traceability
BiasLens is designed as a rule-based, traceable assessment engine. Where a classification is generated, the intended evidence trail records the triggering rule, rationale, framework reference where applicable, confidence or evidence status, limitations and recommended next action.
Traceability improves reviewability; it does not guarantee that every regulator, court or external reviewer will accept a conclusion.
8. Accessibility evidence
BiasLens treats accessibility as an evidence question. A demonstration of one keyboard or screen-reader pathway is not the same as comprehensive accessibility testing, validation or WCAG conformance.
Assessments should distinguish implemented features from independently tested evidence and formal conformance claims.