Mahal Systems

Overview › Benchmark catalog

OpenSanctions Pairs

Fits compliance screening or know-your-customer agents that match entities against sanctions lists. Borrow its pairwise labeled format from 293 sources across 45 jurisdictions and its rule-based baseline (91.3% F1) as a floor.

What it asks the agent to do

  • decide whether two sanctions or watchlist records refer to the same person or company
  • match names across languages and writing systems
  • compare records with partial dates, aliases and identifiers

What to borrow from it

baselinecase template

Caveats

Pairwise matching is already near ceiling (GPT-4o 99.0% F1) so it will not separate models; records are real named persons and organizations; no dataset or code link was found on the abstract page and the data license is not stated there.

Details

Workloadsdata analysis, finance, government, security
Interactionsingle turn
Environmentstatic
End state checkedNo
Toolsnone
Gradingprogrammatic check
Size755,540
Datareal public
Personal datayes
Licenseunknown
Harnessnone
Statussaturated

Links