Pipeline

End-to-end accuracy testing: real historical shipments are run through the CLI FACTS rate simulator, then compared against Roadvision reference data. Each test run validates tariff assignment, discount application, and overall pricing accuracy across the full pipeline.

Latest Run Summary

6,642 shipments tested across 137 customers. CLI rated 4,983 shipments (75.0%). Of rated shipments, 2.2% are full matches (tariff + discount correct).

Test Shipments
6,642
CLI Rated
4,983
Full Match
111
Match Rate
2.2%
CLI Zeroed
1,659
Customers
137
Run: unified_ratesim_top15_lane_targeted | Generated: 2026-03-13T19:32:34 | Window: 2025-03-13 to 2026-03-13

Pipeline Diagnostics — 6,642 Shipments

VERIFIED
MISMATCH
SCOPE CONFLICT
VERIFIED922(13.9%)
MISMATCH4,271(64.3%)
MISSING_LANE336(5.1%)
SCOPE_CONFLICT1,113(16.8%)

CLI vs RV Result — 6,642 Shipments (from actual CLI rate sim output)

Note: the CLI export provides a Tariff field, not an explicit final RTC-used field. Tariff comparisons here use that export field as a proxy.

Discount Off
Minimum Off
CLI Zeroed
Full Match111(1.7%)
Discount Off2,528(38.1%)
Tariff Off98(1.5%)
Minimum Off2,038(30.7%)
Multiple Off208(3.1%)
CLI Zeroed1,659(25.0%)

Lane Exception Coverage (Top 15)

FULL (10+ samples)320/590 (54.2%)
PARTIAL (1-9)81/590 (13.7%)
NONE (0)189/590 (32.0%)

Area Group Coverage

COVERED709/717 (98.9%)
UNCOVERED8/717

Result Bucket Definitions

Buckets are computed from actual CLI rate sim output compared to actual RV charges.

BucketWhat It MeansCountAction
Full MatchCLI total matches RV total (within $0.50), tariff and discount both match111None needed
Discount OffCLI used the correct tariff but actual discount applied differs from RV2,528Check DISC lane exception is imported and active in CLI
Tariff OffCLI output Tariff field differs from RV mapped tariff/RTC reference while discount matches98Review tariff-field comparison and lane RTC setup before treating as routing failure
Minimum OffTariff and discount match but CLI total differs from RV total — likely minimum/maximum charge effect2,038Check MIN/MAX lane exceptions and rate table minimums
Multiple OffBoth tariff and discount differ from RV — lane exceptions may not be applied at all208Full investigation — check customer setup, lane exception import, and geography
CLI ZeroedCLI returned zero charges — rate table may not exist, class/weight out of range, or tariff not found1,659Check that the tariff rate table is imported in CLI and covers the freight class/weight

Per-Customer Accuracy

Click a customer row to expand shipment details. Click column headers to sort. Use bucket filters to isolate failure modes.

Filter:
137 customers
CustomerTotalRatedMatchMatch% ↓Disc OffTar OffMin OffMultiZeroed
▸WESTE0305077100%000043
▸CHARM00250494693.9%00301
▸CALSA00350494081.6%00901
▸ALLPR0091510770%00305
▸TYTAN00150381128.9%0027012
▸AMERI01020014600%03143054
▸BEDRO01920019100%14504609
▸CHROB00120019400%13505906
▸ESTES00220015100%00151049
▸HUBGR00420020000%13506500
▸INDUS02220019700%17502203
▸MEGAW00120016900%327130031
▸MODED00120019500%9609905
▸NVENTX0720018800%01187012
▸PENWAT0120015200%700334948
▸PENWTX0120016500%132033035
▸TOROA00120000N/A0000200
▸HASSE0019400N/A000094
▸COPPE003504900%3601301
▸SALON002503800%3008012
▸SAVPL001504100%2501609
▸PACIF073505000%005000
▸GOODW019504800%400802
▸XYPEX001505000%1503500
▸RECTO004505000%1703300
▸CRYOM001505000%704300
▸NVENT006501000%0001040
▸MPIND001505000%7201490
▸BLUEG0015000N/A000050
▸LEDVA001504900%460301
▸GLTLO002504900%400901
▸POOLC016504900%2402501
▸BRAND013504500%2601905
▸FAIRG005505000%450500
▸BRADY01504700%420503
▸PROAM002505000%460400
▸CSWIN001505000%3501500
▸STELF002505000%005000
▸CYTEK001504800%0291902
▸OWAYI0025000N/A000050
▸IAPWE001504500%2202305
▸LATIC001505000%3301700
▸INTER043505000%005000
▸MOHAW001504900%2502401
▸ALEOL001504800%3601202
▸AMERI007504900%3401501
▸ECHOL001503200%17015018
▸ENTER003505000%2902100
▸TARGU0015000N/A000050
▸LOGIS004504800%430502
▸MATCO0015000N/A000050
▸CHEME001504900%2011361
▸HARRI001504500%3501005
▸WESTP005504800%2901902
▸CUSTO030505000%410900
▸AQUAB0075000N/A000050
▸SIGNA006504900%3901001
▸DIAMO100501900%7012031
▸ARCBE002505000%3801200
▸HUBGR0015000N/A000050
▸PALFI002505000%3401600
▸PENFLO01503800%3305012
▸REGIO001505000%3601400
▸IMPAC001505000%2602400
▸FAIRG001505000%005000
▸TRM001502400%673826
▸DAS4B001503100%16015019
▸TEACH001505000%430700
▸HUBMED04503100%3100019
▸PITTO002505000%1205330
▸ZZDTE0015000N/A000050
▸HUBLT001505000%3301700
▸ONEMO001504600%390704
▸FLEXF002505000%3401600
▸POWER020505000%420800
▸HUBFI001504900%460301
▸AQUAS008504800%1503302
▸SIGMA003505000%2003000
▸PITTO004504900%490001
▸MODED003501300%409037
▸EDMUN0015000N/A000050
▸BIO001451600%1105029
▸COMME012424000%1410252
▸TDICU002413100%2308010
▸PENFTX0382700%8019011
▸MARGI00235100%100034
▸TRIPA001342600%602008
▸RBWIR002331600%0501117
▸GAIAG001313100%1102000
▸PAPER005302900%1901001
▸ODWLO0042400N/A000024
▸ARCHE0082200N/A000022
▸PRIMO0082200N/A000022
▸CALOL0012100N/A000021
▸NEVED001211400%90507
▸ARCHE0102000N/A000020
▸JCAUT001201900%190001
▸FAIRM003202000%140600
▸GAIAG002201900%601301
▸BEJAC0011900N/A000019
▸VERTI006191300%06076
▸KEYLI003171700%54170
▸AMERI069171400%43343
▸LICAT001161600%82150
▸SANDE0031600N/A000016
▸PRIME0381500N/A000015
▸RIGHT0011500N/A000015
▸CENCA0021200N/A000012
▸WESTE0601200N/A000012
▸ELCOR002121100%30801
▸XMYAU0019900%20700
▸CSILC001900N/A00009
▸TMACO002800N/A00008
▸ALCOD0018700%05021
▸COAST029700N/A00007
▸INTER088600N/A00006
▸WINFI0016400%40002
▸BATTL0016100%01005
▸RAINP0024400%40000
▸ALCOT0014300%02011
▸GOLDM002300N/A00003
▸AQUAB0083300%20100
▸SYNER0072200%01010
▸SUPER153200N/A00002
▸RBDPA001200N/A00002
▸LIFEG005200N/A00002
▸ACCUR002200N/A00002
▸NEWCOM002200%20000
▸LUXU0011100%10000
▸ALLCO0011100%10000
▸THEBO003100N/A00001
▸AIRSEA100N/A00001
▸THEPL007100N/A00001
▸SUPER0781100%10000
▸4LESS0011100%01000
▸PENAQU01100N/A00001
▸WATER009100N/A00001

Rate Area Group Detail

Geographic resolution status of all 719 rate area groups. Groups define which ZIPs/states belong to each named group. Lane exceptions reference these groups as origin/destination scope. If a group has incomplete geography, lane exceptions referencing it may not trigger correctly.

RATED
PARTIAL
UNRATED
RATED 495
PARTIAL 141
UNRATED 83
719 groups
Group CodeDescriptionRow CountStrategyTierReasonLane Usage
▸4LESO4LESS AUCTIONS1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
▸ABAOGABATIX1raw_codePARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
▸ACCOGACCURATE ORIGIN1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Helper override source.0
▸ACCT1PHX AREA AP106first4_last1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: first4_last1.0
▸ACCT2PHX AREA AP33first4_last1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: first4_last1.0
▸ACCT3PHX AREA AP242first4_last1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: first4_last1.0
▸ACCTOAP ACCURATE TEST1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Helper override source.0
▸ACCU1ACCURATE CARGO 900-91810raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
▸ACCU2ACCURATE CARGO 926-9283raw_codeUNRATEDRate sim: 0/3 samples rated — CLI could not resolve geography for any test shipment.0
▸ACCU3ACCURATE CARGO 919-9257raw_codePARTIALRate sim: 1/3 samples rated (33%) — CLI failed to resolve 2 test shipment(s).0
▸ACCU4ACCURATE CARGO 9301raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
▸ACCU5ACCURATE CARGO 932-95818raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
▸ACCUOACCURATE FREIGHT SYSTEMS1manual_overrideRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: manual_override.0
▸AIRPGAIR PRODUCTS SALES MONTEBELLO1first4_last1PARTIALRate sim: 1/3 samples rated (33%) — CLI failed to resolve 2 test shipment(s).0
▸ALC01ALCO TARGETS1first4_last1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: first4_last1.0
▸ALCOGALCO DESIGNS1raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
▸ALEOGALEO OG1first4_last1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
▸ALLCGALLCON PRODUCTS1first4_last1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
▸ALPO1ALPHA ALUMINUM ANAHEIM CA928011first4_last1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
▸AMENCRTC:AMERIPAL TOK:NCAL28RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. RTC reference supplement (not live zone backed).0
▸AMENVRTC:AMERIPAL TOK:NVM2PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
▸AMEO0RTC:AMERIPAL TOK:OG1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
▸AMEOGAMERICAN MAPLE1raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
▸AMERGAMERICAN FLOOR MATS SURPRISE A1first4_last1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Source: live_zone, strategy: first4_last1.0
▸AMESCRTC:AMERIPAL TOK:SCAL31RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. RTC reference supplement (not live zone backed).0
▸AMPRGAMERICAN WATER PRODUCTS INC1first4_last1PARTIALRate sim: 2/3 samples rated (67%) — CLI failed to resolve 1 test shipment(s).0
▸AMQOGAMQ OG1raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
▸ANAANA MAPTITUDE 1.26.26763raw_codeRATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. Direct live code.0
▸ANAOGRTC:DMNDPLT TOK:OG1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. RTC reference supplement (not live zone backed).0
▸AQUA0RTC:AQUABELL TOK:AZ OGG1RATEDRate sim: 3/3 samples rated (100%), but no per-group pricing accuracy verification available. RTC reference supplement (not live zone backed).0
1 / 24