Pipeline

End-to-end accuracy testing: real historical shipments are run through the CLI FACTS rate simulator, then compared against Roadvision reference data. Each test run validates tariff assignment, discount application, and overall pricing accuracy across the full pipeline.

Latest Run Summary

6,642 shipments tested across 137 customers. CLI rated 4,983 shipments (75.0%). Of rated shipments, 2.2% are full matches (tariff + discount correct).

Test Shipments
6,642
CLI Rated
4,983
Full Match
111
Match Rate
2.2%
CLI Zeroed
1,659
Customers
137
Run: unified_ratesim_top15_lane_targeted | Generated: 2026-03-13T19:32:34 | Window: 2025-03-13 to 2026-03-13

Pipeline Diagnostics — 6,642 Shipments

VERIFIED
MISMATCH
SCOPE CONFLICT
VERIFIED922(13.9%)
MISMATCH4,271(64.3%)
MISSING_LANE336(5.1%)
SCOPE_CONFLICT1,113(16.8%)

CLI vs RV Result — 6,642 Shipments (from actual CLI rate sim output)

Discount Off
Minimum Off
CLI Zeroed
Full Match111(1.7%)
Discount Off2,528(38.1%)
Tariff Off98(1.5%)
Minimum Off2,038(30.7%)
Multiple Off208(3.1%)
CLI Zeroed1,659(25.0%)

Lane Exception Coverage (Top 15)

FULL (10+ samples)320/590 (54.2%)
PARTIAL (1-9)81/590 (13.7%)
NONE (0)189/590 (32.0%)

Area Group Coverage

COVERED709/717 (98.9%)
UNCOVERED8/717

Result Bucket Definitions

Buckets are computed from actual CLI rate sim output compared to actual RV charges.

BucketWhat It MeansCountAction
Full MatchCLI total matches RV total (within $0.50), tariff and discount both match111None needed
Discount OffCLI used the correct tariff but actual discount applied differs from RV2,528Check DISC lane exception is imported and active in CLI
Tariff OffCLI used a different tariff/RTC than RV but discount matches98Verify RTC lane exception references the correct rate table code
Minimum OffTariff and discount match but CLI total differs from RV total — likely minimum/maximum charge effect2,038Check MIN/MAX lane exceptions and rate table minimums
Multiple OffBoth tariff and discount differ from RV — lane exceptions may not be applied at all208Full investigation — check customer setup, lane exception import, and geography
CLI ZeroedCLI returned zero charges — rate table may not exist, class/weight out of range, or tariff not found1,659Check that the tariff rate table is imported in CLI and covers the freight class/weight

Per-Customer Accuracy

Click a customer row to expand shipment details. Click column headers to sort. Use bucket filters to isolate failure modes.

Filter:
137 customers
CustomerTotalRatedMatchMatch% ↓Disc OffTar OffMin OffMultiZeroed
WESTE0305077100%000043
CHARM00250494693.9%00301
CALSA00350494081.6%00901
ALLPR0091510770%00305
TYTAN00150381128.9%0027012
AMERI01020014600%03143054
BEDRO01920019100%14504609
CHROB00120019400%13505906
ESTES00220015100%00151049
HUBGR00420020000%13506500
INDUS02220019700%17502203
MEGAW00120016900%327130031
MODED00120019500%9609905
NVENTX0720018800%01187012
PENWAT0120015200%700334948
PENWTX0120016500%132033035
TOROA00120000N/A0000200
HASSE0019400N/A000094
COPPE003504900%3601301
SALON002503800%3008012
SAVPL001504100%2501609
PACIF073505000%005000
GOODW019504800%400802
XYPEX001505000%1503500
RECTO004505000%1703300
CRYOM001505000%704300
NVENT006501000%0001040
MPIND001505000%7201490
BLUEG0015000N/A000050
LEDVA001504900%460301
GLTLO002504900%400901
POOLC016504900%2402501
BRAND013504500%2601905
FAIRG005505000%450500
BRADY01504700%420503
PROAM002505000%460400
CSWIN001505000%3501500
STELF002505000%005000
CYTEK001504800%0291902
OWAYI0025000N/A000050
IAPWE001504500%2202305
LATIC001505000%3301700
INTER043505000%005000
MOHAW001504900%2502401
ALEOL001504800%3601202
AMERI007504900%3401501
ECHOL001503200%17015018
ENTER003505000%2902100
TARGU0015000N/A000050
LOGIS004504800%430502
MATCO0015000N/A000050
CHEME001504900%2011361
HARRI001504500%3501005
WESTP005504800%2901902
CUSTO030505000%410900
AQUAB0075000N/A000050
SIGNA006504900%3901001
DIAMO100501900%7012031
ARCBE002505000%3801200
HUBGR0015000N/A000050
PALFI002505000%3401600
PENFLO01503800%3305012
REGIO001505000%3601400
IMPAC001505000%2602400
FAIRG001505000%005000
TRM001502400%673826
DAS4B001503100%16015019
TEACH001505000%430700
HUBMED04503100%3100019
PITTO002505000%1205330
ZZDTE0015000N/A000050
HUBLT001505000%3301700
ONEMO001504600%390704
FLEXF002505000%3401600
POWER020505000%420800
HUBFI001504900%460301
AQUAS008504800%1503302
SIGMA003505000%2003000
PITTO004504900%490001
MODED003501300%409037
EDMUN0015000N/A000050
BIO001451600%1105029
COMME012424000%1410252
TDICU002413100%2308010
PENFTX0382700%8019011
MARGI00235100%100034
TRIPA001342600%602008
RBWIR002331600%0501117
GAIAG001313100%1102000
PAPER005302900%1901001
ODWLO0042400N/A000024
ARCHE0082200N/A000022
PRIMO0082200N/A000022
CALOL0012100N/A000021
NEVED001211400%90507
ARCHE0102000N/A000020
JCAUT001201900%190001
FAIRM003202000%140600
GAIAG002201900%601301
BEJAC0011900N/A000019
VERTI006191300%06076
KEYLI003171700%54170
AMERI069171400%43343
LICAT001161600%82150
SANDE0031600N/A000016
PRIME0381500N/A000015
RIGHT0011500N/A000015
CENCA0021200N/A000012
WESTE0601200N/A000012
ELCOR002121100%30801
XMYAU0019900%20700
CSILC001900N/A00009
TMACO002800N/A00008
ALCOD0018700%05021
COAST029700N/A00007
INTER088600N/A00006
WINFI0016400%40002
BATTL0016100%01005
RAINP0024400%40000
ALCOT0014300%02011
GOLDM002300N/A00003
AQUAB0083300%20100
SYNER0072200%01010
SUPER153200N/A00002
RBDPA001200N/A00002
LIFEG005200N/A00002
ACCUR002200N/A00002
NEWCOM002200%20000
LUXU0011100%10000
ALLCO0011100%10000
THEBO003100N/A00001
AIRSEA100N/A00001
THEPL007100N/A00001
SUPER0781100%10000
4LESS0011100%01000
PENAQU01100N/A00001
WATER009100N/A00001

Rate Area Group Detail

Geographic resolution status of all 719 rate area groups. Groups define which ZIPs/states belong to each named group. Lane exceptions reference these groups as origin/destination scope. If a group has incomplete geography, lane exceptions referencing it may not trigger correctly.

RATED
PARTIAL
UNRATED
RATED 495
PARTIAL 141
UNRATED 83
719 groups
Group CodeDescriptionRow CountStrategyTierReasonLane Usage
4LESO4LESS AUCTIONS1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
ABAOGABATIX1raw_codePARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
ACCOGACCURATE ORIGIN1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Helper override source.0
ACCT1PHX AREA AP106first4_last1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: first4_last1.0
ACCT2PHX AREA AP33first4_last1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: first4_last1.0
ACCT3PHX AREA AP242first4_last1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: first4_last1.0
ACCTOAP ACCURATE TEST1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Helper override source.0
ACCU1ACCURATE CARGO 900-91810raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
ACCU2ACCURATE CARGO 926-9283raw_codeUNRATEDRate sim: 0/3 samples rated — CLI could not resolve geography for any test shipment.0
ACCU3ACCURATE CARGO 919-9257raw_codePARTIALRate sim: 1/3 samples rated (33%) — CLI failed to resolve 2 test shipment(s).0
ACCU4ACCURATE CARGO 9301raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
ACCU5ACCURATE CARGO 932-95818raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
ACCUOACCURATE FREIGHT SYSTEMS1manual_overrideRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: manual_override.0
AIRPGAIR PRODUCTS SALES MONTEBELLO1first4_last1PARTIALRate sim: 1/3 samples rated (33%) — CLI failed to resolve 2 test shipment(s).0
ALC01ALCO TARGETS1first4_last1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: first4_last1.0
ALCOGALCO DESIGNS1raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
ALEOGALEO OG1first4_last1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
ALLCGALLCON PRODUCTS1first4_last1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
ALPO1ALPHA ALUMINUM ANAHEIM CA928011first4_last1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
AMENCRTC:AMERIPAL TOK:NCAL28RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. RTC reference supplement (not live zone backed).0
AMENVRTC:AMERIPAL TOK:NVM2PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
AMEO0RTC:AMERIPAL TOK:OG1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
AMEOGAMERICAN MAPLE1raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
AMERGAMERICAN FLOOR MATS SURPRISE A1first4_last1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: first4_last1.0
AMESCRTC:AMERIPAL TOK:SCAL31RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. RTC reference supplement (not live zone backed).0
AMPRGAMERICAN WATER PRODUCTS INC1first4_last1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
AMQOGAMQ OG1raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
ANAANA MAPTITUDE 1.26.26763raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
ANAOGRTC:DMNDPLT TOK:OG1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. RTC reference supplement (not live zone backed).0
AQUA0RTC:AQUABELL TOK:AZ OGG1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. RTC reference supplement (not live zone backed).0
1 / 24