Scrapeless Wiki

How Does Anti-Bot Scoring Work? – Signals, Weights, and Thresholds

Informational P2 how does anti-bot scoring work

Learn how a request becomes a score: which signals contribute, how contradictions are weighted, how thresholds map to actions, and why results vary.

Anti-bot systems do not run a single test. They accumulate weak evidence from several layers into a score, and the site maps score ranges to actions. Understanding that pipeline explains why outcomes are inconsistent.

1. Signals Arrive in Stages

Stage Available Contributes
Connection Immediately Address reputation, network class
TLS handshake Before any request Client software family
HTTP framing First frames Protocol implementation characteristics
Headers With the request Completeness, order, plausibility
Page execution After a challenge runs Environment consistency, rendering behaviour
Session behaviour Over time Navigation rhythm, interaction, sequencing

Earlier stages are cheap and coarse; later ones are expensive and precise. Systems escalate only when the cheap evidence is inconclusive.

2. Contradiction Weighs Most

Individual signals are weak. A datacenter address is ordinary for server-to-server traffic. A library's TLS fingerprint is ordinary for a script. A browser user agent is ordinary for a browser.

The combination of a browser user agent with a library handshake is not ordinary β€” it is a claim contradicted by evidence, and such contradictions carry disproportionate weight.

3. Scores, Not Verdicts

The output is typically a number expressing confidence. The site then chooses thresholds:

  • High confidence human β€” allow, sometimes with the score passed to the origin.
  • Uncertain β€” challenge, sized to the level of doubt.
  • Low confidence β€” block, or serve a deliberately expensive challenge.

Because thresholds are per site, identical traffic passes one domain and is refused by another.

4. Why Identical Requests Differ

  • Reputation is dynamic, changing hour to hour.
  • Scores are probabilistic, so borderline traffic falls either side.
  • Clearance is stateful β€” a session that already passed carries a token.
  • Rules change, and operators tune continuously.
  • Load matters; some systems tighten thresholds under pressure.

5. What Legitimate Automation Should Take From This

The system is looking for inconsistency, not for automation. A client that presents honestly and behaves consistently at every layer generates no contradiction, whatever it declares itself to be.

Conversely, adding browser-like attributes to a scripting client increases the gap between claim and evidence, which is why such changes often make things worse rather than better.

6. Behavioural Signals Come Last

Once a session is established, timing and navigation patterns accumulate. Uniform intervals, perfectly linear paths, and request sequences no interface would produce are all measurable.

Pacing and ordinary variation therefore matter as much as any header, and they cannot be faked by configuration alone.

7. What Operators Should Weigh

False positives concentrate on shared addresses, VPN users, older devices, and privacy-hardened browsers. Every threshold choice trades protection against those users, and the cost is invisible because refused visitors rarely complain.

8. Summary

Anti-bot scoring accumulates weak evidence across connection, handshake, protocol, headers, execution, and behaviour, weights contradictions heavily, and maps the resulting score to a site-configured action.

There is no single test to pass. Coherence across layers, reasonable pacing, and honest identification are what actually determine outcomes.