CMS Claims Data Comparison Report

Generated 2026-03-06 21:07:45

Data Under Comparison

This report compares outputs from two CMS Medicare claims processing systems. The old system is the legacy production pipeline (CMS DE-SynPUF reference dataset, 2008–2010). The new system is the replacement pipeline whose outputs are validated against the old system to ensure correctness before cutover.

Old System (Reference) 5 files

File	Rows	Size
DE1_0_2008_Beneficiary_Summary_File_Sample_1.csv	116,352	13.9 MB
DE1_0_2008_to_2010_Carrier_Claims_Sample_1A.csv	2,370,667	1179.2 MB
DE1_0_2008_to_2010_Carrier_Claims_Sample_1B.csv	2,370,668	1179.2 MB
DE1_0_2009_Beneficiary_Summary_File_Sample_1.csv	114,538	13.8 MB
DE1_0_2010_Beneficiary_Summary_File_Sample_1.csv	112,754	13.4 MB

Source: data/old_system

New System (Under Test) 5 files

File	Rows	Size
DE1_0_2008_Beneficiary_Summary_File_Sample_1_NEWSYSTEM.csv	116,352	13.9 MB
DE1_0_2008_to_2010_Carrier_Claims_Sample_1A_NEWSYSTEM.csv	2,373,066	1180.4 MB
DE1_0_2008_to_2010_Carrier_Claims_Sample_1B_NEWSYSTEM.csv	2,373,046	1180.4 MB
DE1_0_2009_Beneficiary_Summary_File_Sample_1_NEWSYSTEM.csv	114,538	13.8 MB
DE1_0_2010_Beneficiary_Summary_File_Sample_1_NEWSYSTEM.csv	112,754	13.4 MB

Source: data/new_system

Record Matching Results

Beneficiary Summary

99.91%

343,485 matched · 159 old-only · 159 new-only

Carrier Claims

99.9%

4,741,335 matched · 0 old-only · 4,777 new-only

Executive Summary

Total Beneficiaries

343,644

Across 3 summary years

Total Carrier Claims

4,741,335

Parts A + B combined

Checks Passed

13 / 19

6 issues detected

New System Status

Loaded

110 comparison checks

Claims Payment Discrepancy

$1,994,823.86

Total NCH payment divergence across all claim lines

Claims with Payment Changes

13,731

Matched claims with altered payment amounts

Beneficiaries Affected

339

Distinct beneficiaries with any field-level change

Injected Test Records

159 + 4,777

Fake "ZZ" beneficiaries + fabricated claims

Issues Requiring Attention

identity beneficiaries_without_claims

17,726 issues (15.23%)

Beneficiaries in summary files with zero carrier claims

clinical esrd_regression

13,720 issues (11.7918%)

Beneficiaries whose ESRD indicator regresses from Y to non-Y in a later year (clinically impossible)

financial financial_recon_medreimb_car

3,998 issues (1.53%)

Beneficiary summary MEDREIMB_CAR vs computed aggregate from carrier claim lines (tolerance: $0.01)

financial financial_recon_benres_car

3,690 issues (1.41%)

Beneficiary summary BENRES_CAR vs computed aggregate from carrier claim lines (tolerance: $0.01)

financial financial_recon_pppymt_car

84 issues (0.03%)

Beneficiary summary PPPYMT_CAR vs computed aggregate from carrier claim lines (tolerance: $0.01)

clinical icd9_format_validation

1 issues (0.0%)

ICD-9 diagnosis codes (ICD9_DGNS_CD_1–8) failing alphanumeric 3–5 char format check

Discrepancy Dashboard

The old system (CMS DE-SynPUF) is treated as ground truth. All metrics below quantify how the new system's outputs deviate from the old system. Discrepancies indicate potential issues in the new claims processing pipeline that must be resolved before cutover.

Beneficiaries with Data Mismatches

—

Claims with Payment Mismatches

—

Total Financial Divergence

—

Sum of absolute differences across all reimbursement columns

Phantom / Missing Records

—

Records in one system but not the other

Discrepancy Charts

Validation Results

Check	Category	Description	Checked	Issues	Rate	Status
orphan_claims_beneficiaries	identity	Beneficiary IDs in carrier claims not found in any beneficiary summary file	98,626	0	0.0%	PASS
beneficiaries_without_claims	identity	Beneficiaries in summary files with zero carrier claims	116,352	17,726	15.23%	FAIL
duplicate_claim_ids	identity	Claim IDs appearing more than once in carrier claims	4,741,335	0	0.0%	PASS
claims_after_death	temporal	Carrier claims with start date after beneficiary death date	4,741,335	0	0.0%	PASS
claim_date_inversion	temporal	Claims where start date is after end date	4,741,335	0	0.0%	PASS
summary_after_death	temporal	Deceased beneficiaries with summary records in years after their death year	5,461	0	0.0%	PASS
sex_change_across_years	demographic	Beneficiaries whose sex code changes across summary years	116,352	0	0.0%	PASS
race_change_across_years	demographic	Beneficiaries whose race code changes across summary years	116,352	0	0.0%	PASS
dob_change_across_years	demographic	Beneficiaries whose date of birth changes across summary years	116,352	0	0.0%	PASS
coverage_range_bene_hi_cvrage_tot_mons	coverage	Hospital Insurance (Part A) coverage months outside valid 0–12 range	343,644	0	0.0%	PASS
coverage_range_bene_smi_cvrage_tot_mons	coverage	Supplementary Medical Insurance (Part B) coverage months outside valid 0–12 range	343,644	0	0.0%	PASS
coverage_range_bene_hmo_cvrage_tot_mons	coverage	HMO coverage months outside valid 0–12 range	343,644	0	0.0%	PASS
esrd_regression	clinical	Beneficiaries whose ESRD indicator regresses from Y to non-Y in a later year (clinically impossible)	116,352	13,720	11.7918%	FAIL
state_change_across_years	demographic	Beneficiaries whose state code changes across years (possible relocation, but worth flagging)	116,352	0	0.0%	PASS
financial_recon_medreimb_car	financial	Beneficiary summary MEDREIMB_CAR vs computed aggregate from carrier claim lines (tolerance: $0.01)	262,017	3,998	1.53%	FAIL
financial_recon_benres_car	financial	Beneficiary summary BENRES_CAR vs computed aggregate from carrier claim lines (tolerance: $0.01)	262,017	3,690	1.41%	FAIL
financial_recon_pppymt_car	financial	Beneficiary summary PPPYMT_CAR vs computed aggregate from carrier claim lines (tolerance: $0.01)	262,017	84	0.03%	FAIL
icd9_format_validation	clinical	ICD-9 diagnosis codes (ICD9_DGNS_CD_1–8) failing alphanumeric 3–5 char format check	10,122,005	1	0.0%	FAIL
npi_format_validation	identity	Performing physician NPIs (PRF_PHYSN_NPI_1–5) failing 10-digit numeric format check	8,790,902	0	0.0%	PASS

Issues by Check bar chart

Year-over-Year Trends

Financial Analysis

System Comparison

All Comparison Checks 110 checks across schema, row-level, field-level, and aggregate categories

Check	Category	Table Pair	Description	Metric	Impact
missing_columns_in_new	schema	beneficiary_summary vs new_beneficiary_summary	Columns present in old system but missing in new system	0
extra_columns_in_new	schema	beneficiary_summary vs new_beneficiary_summary	Columns present in new system but not in old system	0
type_mismatches	schema	beneficiary_summary vs new_beneficiary_summary	Columns with different data types between systems	0
row_count_difference	row_level	beneficiary_summary vs new_beneficiary_summary	Row count: old=343,644, new=343,644	0
keys_missing_in_new	row_level	beneficiary_summary vs new_beneficiary_summary	Distinct (DESYNPUF_ID, summary_year) values in old but not in new	159	159 beneficiary-year records missing: 157 real beneficiaries each lost one year of data, plus 2 beneficiaries (both deceased 2008) dropped entirely. Potential data loss for eligibility and claims history.
keys_extra_in_new	row_level	beneficiary_summary vs new_beneficiary_summary	Distinct (DESYNPUF_ID, summary_year) values in new but not in old	159	159 new records all have 'ZZ'-prefixed IDs — fabricated test beneficiaries injected into the new system. Must be filtered before any production analysis.
field_mismatch_bene_birth_dt	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column BENE_BIRTH_DT on matched rows	178	178 birth dates changed from month-only precision (day=01) to actual day-of-month. Data quality improvement; may affect age calculations that assumed first-of-month.
field_mismatch_bene_death_dt	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column BENE_DEATH_DT on matched rows	0
field_mismatch_bene_sex_ident_cd	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column BENE_SEX_IDENT_CD on matched rows	0
field_mismatch_bene_race_cd	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column BENE_RACE_CD on matched rows	0
field_mismatch_bene_esrd_ind	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column BENE_ESRD_IND on matched rows	0
field_mismatch_sp_state_code	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_STATE_CODE on matched rows	0
field_mismatch_bene_county_cd	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column BENE_COUNTY_CD on matched rows	0
field_mismatch_bene_hi_cvrage_tot_mons	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column BENE_HI_CVRAGE_TOT_MONS on matched rows	29	Hospital insurance coverage months changed for a small number of beneficiaries. Affects eligibility determination.
field_mismatch_bene_smi_cvrage_tot_mons	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column BENE_SMI_CVRAGE_TOT_MONS on matched rows	26	Supplementary medical insurance coverage months changed. Affects Part B eligibility calculations.
field_mismatch_bene_hmo_cvrage_tot_mons	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column BENE_HMO_CVRAGE_TOT_MONS on matched rows	38	HMO coverage months changed. Affects managed care enrollment tracking.
field_mismatch_plan_cvrg_mos_num	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column PLAN_CVRG_MOS_NUM on matched rows	23	Plan coverage months changed. Affects Part D enrollment and prescription benefit calculations.
field_mismatch_sp_alzhdmta	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_ALZHDMTA on matched rows	0
field_mismatch_sp_chf	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_CHF on matched rows	0
field_mismatch_sp_chrnkidn	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_CHRNKIDN on matched rows	0
field_mismatch_sp_cncr	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_CNCR on matched rows	0
field_mismatch_sp_copd	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_COPD on matched rows	0
field_mismatch_sp_depressn	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_DEPRESSN on matched rows	0
field_mismatch_sp_diabetes	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_DIABETES on matched rows	0
field_mismatch_sp_ischmcht	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_ISCHMCHT on matched rows	0
field_mismatch_sp_osteoprs	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_OSTEOPRS on matched rows	0
field_mismatch_sp_ra_oa	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_RA_OA on matched rows	0
field_mismatch_sp_strketia	field_level	beneficiary_summary vs new_beneficiary_summary	Value mismatches for column SP_STRKETIA on matched rows	0
aggregate_divergence_medreimb_ip	aggregate	beneficiary_summary vs new_beneficiary_summary	Aggregate comparison for MEDREIMB_IP	2,283.01	Inpatient Medicare reimbursement sum divergence. Indicates payment recalculation on ~38 beneficiaries.
aggregate_divergence_benres_ip	aggregate	beneficiary_summary vs new_beneficiary_summary	Aggregate comparison for BENRES_IP	1,210.88	Inpatient beneficiary responsibility sum divergence. Affects cost-sharing calculations.
aggregate_divergence_pppymt_ip	aggregate	beneficiary_summary vs new_beneficiary_summary	Aggregate comparison for PPPYMT_IP	2,128.46	Inpatient primary payer payment sum divergence. Indicates coordination-of-benefits changes.
aggregate_divergence_medreimb_op	aggregate	beneficiary_summary vs new_beneficiary_summary	Aggregate comparison for MEDREIMB_OP	1,745.50	Outpatient Medicare reimbursement sum divergence. Indicates payment recalculation on ~47 beneficiaries.
aggregate_divergence_benres_op	aggregate	beneficiary_summary vs new_beneficiary_summary	Aggregate comparison for BENRES_OP	1,140.38	Outpatient beneficiary responsibility sum divergence.
aggregate_divergence_pppymt_op	aggregate	beneficiary_summary vs new_beneficiary_summary	Aggregate comparison for PPPYMT_OP	1,506.84	Outpatient primary payer payment sum divergence.
aggregate_divergence_medreimb_car	aggregate	beneficiary_summary vs new_beneficiary_summary	Aggregate comparison for MEDREIMB_CAR	933.54	Carrier Medicare reimbursement sum divergence. Affects provider payment reconciliation.
aggregate_divergence_benres_car	aggregate	beneficiary_summary vs new_beneficiary_summary	Aggregate comparison for BENRES_CAR	309.64	Carrier beneficiary responsibility sum divergence.
aggregate_divergence_pppymt_car	aggregate	beneficiary_summary vs new_beneficiary_summary	Aggregate comparison for PPPYMT_CAR	1,935.46	Carrier primary payer payment sum divergence.
missing_columns_in_new	schema	carrier_claims vs new_carrier_claims	Columns present in old system but missing in new system	0
extra_columns_in_new	schema	carrier_claims vs new_carrier_claims	Columns present in new system but not in old system	0
type_mismatches	schema	carrier_claims vs new_carrier_claims	Columns with different data types between systems	1	Column type differences may cause downstream query or aggregation errors if not resolved.
row_count_difference	row_level	carrier_claims vs new_carrier_claims	Row count: old=4,741,335, new=4,746,112	4,777	New system has 4,777 additional claim rows: 4,737 linked to fake 'ZZ' beneficiaries, plus 40 extra claims silently added to real beneficiaries (one per beneficiary).
keys_missing_in_new	row_level	carrier_claims vs new_carrier_claims	Distinct (CLM_ID) values in old but not in new	0
keys_extra_in_new	row_level	carrier_claims vs new_carrier_claims	Distinct (CLM_ID) values in new but not in old	4,777	4,777 new claim IDs not in old system. 4,737 belong to fabricated 'ZZ' beneficiaries; 40 are injected claims on legitimate beneficiaries.
field_mismatch_desynpuf_id	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column DESYNPUF_ID on matched rows	0
field_mismatch_clm_from_dt	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column CLM_FROM_DT on matched rows	465	465 claim start dates replaced with invalid sentinel value 20231332 (month 13, day 32). Corrupted date; will break any date-based reporting or temporal validation.
field_mismatch_clm_thru_dt	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column CLM_THRU_DT on matched rows	0
field_mismatch_icd9_dgns_cd_1	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column ICD9_DGNS_CD_1 on matched rows	497	Primary diagnosis codes nulled on ~497 claims as part of a broader record-scrubbing pattern (DX, HCPCS, NPI, and tax ID all wiped on the same claims).
field_mismatch_icd9_dgns_cd_2	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column ICD9_DGNS_CD_2 on matched rows	275	Secondary diagnosis codes nulled (subset of the 497 scrubbed claims). Affects comorbidity analysis.
field_mismatch_icd9_dgns_cd_3	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column ICD9_DGNS_CD_3 on matched rows	165	Tertiary diagnosis codes nulled (subset of scrubbed claims).
field_mismatch_icd9_dgns_cd_4	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column ICD9_DGNS_CD_4 on matched rows	93	Diagnosis code 4 nulled (subset of scrubbed claims).
field_mismatch_icd9_dgns_cd_5	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column ICD9_DGNS_CD_5 on matched rows	14	Diagnosis code 5 differences.
field_mismatch_icd9_dgns_cd_6	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column ICD9_DGNS_CD_6 on matched rows	6	Diagnosis code 6 differences.
field_mismatch_icd9_dgns_cd_7	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column ICD9_DGNS_CD_7 on matched rows	2	Diagnosis code 7 differences.
field_mismatch_icd9_dgns_cd_8	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column ICD9_DGNS_CD_8 on matched rows	0
field_mismatch_hcpcs_cd_1	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_1 on matched rows	488	Primary procedure codes nulled on ~488 claims (same scrubbed-record set as DX code nulls). Affects service categorization and payment accuracy.
field_mismatch_hcpcs_cd_2	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_2 on matched rows	198	Secondary procedure code differences (subset of scrubbed claims).
field_mismatch_hcpcs_cd_3	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_3 on matched rows	89	Procedure code 3 differences.
field_mismatch_hcpcs_cd_4	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_4 on matched rows	50	Procedure code 4 differences.
field_mismatch_hcpcs_cd_5	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_5 on matched rows	31	Procedure code 5 differences.
field_mismatch_hcpcs_cd_6	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_6 on matched rows	21	Procedure code 6 differences.
field_mismatch_hcpcs_cd_7	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_7 on matched rows	11	Procedure code 7 differences.
field_mismatch_hcpcs_cd_8	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_8 on matched rows	7	Procedure code 8 differences.
field_mismatch_hcpcs_cd_9	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_9 on matched rows	5	Procedure code 9 differences.
field_mismatch_hcpcs_cd_10	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_10 on matched rows	6	Procedure code 10 differences.
field_mismatch_hcpcs_cd_11	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_11 on matched rows	5	Procedure code 11 differences.
field_mismatch_hcpcs_cd_12	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_12 on matched rows	2	Procedure code 12 differences.
field_mismatch_hcpcs_cd_13	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column HCPCS_CD_13 on matched rows	2	Procedure code 13 differences.
field_mismatch_prf_physn_npi_1	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column PRF_PHYSN_NPI_1 on matched rows	493	Primary provider NPI nulled on ~493 claims (same scrubbed-record set). Loss of provider identification breaks referral tracking and fraud detection.
field_mismatch_prf_physn_npi_2	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column PRF_PHYSN_NPI_2 on matched rows	219	Secondary provider NPI differences (subset of scrubbed claims).
field_mismatch_prf_physn_npi_3	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column PRF_PHYSN_NPI_3 on matched rows	102	Provider NPI 3 differences.
field_mismatch_prf_physn_npi_4	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column PRF_PHYSN_NPI_4 on matched rows	56	Provider NPI 4 differences.
field_mismatch_prf_physn_npi_5	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column PRF_PHYSN_NPI_5 on matched rows	36	Provider NPI 5 differences.
field_mismatch_tax_num_1	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column TAX_NUM_1 on matched rows	497	Primary tax ID nulled on ~497 claims (same scrubbed-record set). Loss of provider tax identification impacts payment reconciliation.
field_mismatch_tax_num_2	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column TAX_NUM_2 on matched rows	221	Secondary tax ID differences (subset of scrubbed claims).
field_mismatch_tax_num_3	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column TAX_NUM_3 on matched rows	103	Tax ID 3 differences.
field_mismatch_tax_num_4	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column TAX_NUM_4 on matched rows	56	Tax ID 4 differences.
field_mismatch_tax_num_5	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column TAX_NUM_5 on matched rows	36	Tax ID 5 differences.
field_mismatch_line_prcsg_ind_cd_1	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column LINE_PRCSG_IND_CD_1 on matched rows	695	Line 1 processing indicator changed on ~695 claims: 452 nulled (scrubbed), plus ~198 changed to different values. Affects adjudication status tracking.
field_mismatch_line_prcsg_ind_cd_2	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column LINE_PRCSG_IND_CD_2 on matched rows	284	Line 2 processing indicator differences.
field_mismatch_line_prcsg_ind_cd_3	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column LINE_PRCSG_IND_CD_3 on matched rows	132	Line 3 processing indicator differences.
field_mismatch_line_prcsg_ind_cd_4	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column LINE_PRCSG_IND_CD_4 on matched rows	66	Line 4 processing indicator differences.
field_mismatch_line_prcsg_ind_cd_5	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column LINE_PRCSG_IND_CD_5 on matched rows	41	Line 5 processing indicator differences.
field_mismatch_line_icd9_dgns_cd_1	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column LINE_ICD9_DGNS_CD_1 on matched rows	533	Line 1 diagnosis code differences (~533 claims). Partially overlaps with header DX nulling.
field_mismatch_line_icd9_dgns_cd_2	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column LINE_ICD9_DGNS_CD_2 on matched rows	236	Line 2 diagnosis code differences.
field_mismatch_line_icd9_dgns_cd_3	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column LINE_ICD9_DGNS_CD_3 on matched rows	108	Line 3 diagnosis code differences.
field_mismatch_line_icd9_dgns_cd_4	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column LINE_ICD9_DGNS_CD_4 on matched rows	60	Line 4 diagnosis code differences.
field_mismatch_line_icd9_dgns_cd_5	field_level	carrier_claims vs new_carrier_claims	Value mismatches for column LINE_ICD9_DGNS_CD_5 on matched rows	36	Line 5 diagnosis code differences.
aggregate_divergence_line_nch_pmt_amt_1	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_NCH_PMT_AMT_1	1,071,288.98	Line 1 NCH payment sum divergence. 8,401 claims reduced to exactly 90% of original (systematic 10% cut), 16 claims zeroed out, ~115 with scattered changes. High financial impact.
aggregate_divergence_line_nch_pmt_amt_2	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_NCH_PMT_AMT_2	467,834.32	Line 2 NCH payment sum divergence. Same 90% reduction pattern extends to secondary claim lines (1,483 at 0.90 ratio).
aggregate_divergence_line_nch_pmt_amt_3	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_NCH_PMT_AMT_3	234,920.33	Line 3 NCH payment sum divergence (553 at 0.90 ratio).
aggregate_divergence_line_nch_pmt_amt_4	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_NCH_PMT_AMT_4	134,216.17	Line 4 NCH payment sum divergence (279 at 0.90 ratio).
aggregate_divergence_line_nch_pmt_amt_5	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_NCH_PMT_AMT_5	86,564.06	Line 5 NCH payment sum divergence (165 at 0.90 ratio).
aggregate_divergence_line_bene_ptb_ddctbl_amt_1	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_BENE_PTB_DDCTBL_AMT_1	1,183,391.00	Line 1 Part B deductible sum divergence. Affects beneficiary out-of-pocket calculations.
aggregate_divergence_line_bene_ptb_ddctbl_amt_2	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_BENE_PTB_DDCTBL_AMT_2	486,823.57	Line 2 Part B deductible sum divergence.
aggregate_divergence_line_bene_ptb_ddctbl_amt_3	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_BENE_PTB_DDCTBL_AMT_3	253,755.18	Line 3 Part B deductible sum divergence.
aggregate_divergence_line_bene_ptb_ddctbl_amt_4	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_BENE_PTB_DDCTBL_AMT_4	151,778.67	Line 4 Part B deductible sum divergence.
aggregate_divergence_line_bene_ptb_ddctbl_amt_5	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_BENE_PTB_DDCTBL_AMT_5	103,008.51	Line 5 Part B deductible sum divergence.
aggregate_divergence_line_bene_prmry_pyr_pd_amt_1	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_BENE_PRMRY_PYR_PD_AMT_1	1,184,796.48	Line 1 primary payer amount sum divergence.
aggregate_divergence_line_bene_prmry_pyr_pd_amt_2	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_BENE_PRMRY_PYR_PD_AMT_2	482,686.00	Line 2 primary payer amount sum divergence.
aggregate_divergence_line_bene_prmry_pyr_pd_amt_3	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_BENE_PRMRY_PYR_PD_AMT_3	259,749.86	Line 3 primary payer amount sum divergence.
aggregate_divergence_line_coinsrnc_amt_1	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_COINSRNC_AMT_1	1,185,385.00	Line 1 coinsurance sum divergence. Affects beneficiary cost-sharing calculations.
aggregate_divergence_line_coinsrnc_amt_2	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_COINSRNC_AMT_2	462,782.82	Line 2 coinsurance sum divergence.
aggregate_divergence_line_coinsrnc_amt_3	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_COINSRNC_AMT_3	244,780.00	Line 3 coinsurance sum divergence.
aggregate_divergence_line_coinsrnc_amt_4	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_COINSRNC_AMT_4	128,910.83	Line 4 coinsurance sum divergence.
aggregate_divergence_line_coinsrnc_amt_5	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_COINSRNC_AMT_5	84,659.79	Line 5 coinsurance sum divergence.
aggregate_divergence_line_alowd_chrg_amt_1	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_ALOWD_CHRG_AMT_1	1,165,858.09	Line 1 allowed charge sum divergence. Affects fee schedule and payment calculations.
aggregate_divergence_line_alowd_chrg_amt_2	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_ALOWD_CHRG_AMT_2	465,581.85	Line 2 allowed charge sum divergence.
aggregate_divergence_line_alowd_chrg_amt_3	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_ALOWD_CHRG_AMT_3	235,498.60	Line 3 allowed charge sum divergence.
aggregate_divergence_line_alowd_chrg_amt_4	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_ALOWD_CHRG_AMT_4	129,969.83	Line 4 allowed charge sum divergence.
aggregate_divergence_line_alowd_chrg_amt_5	aggregate	carrier_claims vs new_carrier_claims	Aggregate comparison for LINE_ALOWD_CHRG_AMT_5	82,501.99	Line 5 allowed charge sum divergence.

Data Profiles

Column-level quality profiles for each ingested table. Click to expand.

beneficiary_summary 343,644 rows, 33 cols · 1 high-null cols

Column	Type	Nulls	Null %	Distinct	Min	Max	Mean
DESYNPUF_ID	VARCHAR	0	0.0%	116,352	-	-	-
BENE_BIRTH_DT	BIGINT	0	0.0%	900	19090101	19831201	19364346.65
BENE_DEATH_DT	BIGINT	338,183	98.41%	36	20080101	20101201	20090740.77
BENE_SEX_IDENT_CD	BIGINT	0	0.0%	2	1	2	1.55
BENE_RACE_CD	BIGINT	0	0.0%	4	1	5	1.29
BENE_ESRD_IND	VARCHAR	0	0.0%	2	-	-	-
SP_STATE_CODE	VARCHAR	0	0.0%	52	-	-	-
BENE_COUNTY_CD	VARCHAR	0	0.0%	307	-	-	-
BENE_HI_CVRAGE_TOT_MONS	BIGINT	0	0.0%	13	0	12	11.19
BENE_SMI_CVRAGE_TOT_MONS	BIGINT	0	0.0%	13	0	12	10.84
BENE_HMO_CVRAGE_TOT_MONS	BIGINT	0	0.0%	13	0	12	3.16
PLAN_CVRG_MOS_NUM	VARCHAR	0	0.0%	13	-	-	-
SP_ALZHDMTA	BIGINT	0	0.0%	2	1	2	1.80
SP_CHF	BIGINT	0	0.0%	2	1	2	1.70
SP_CHRNKIDN	BIGINT	0	0.0%	2	1	2	1.83
SP_CNCR	BIGINT	0	0.0%	2	1	2	1.93
SP_COPD	BIGINT	0	0.0%	2	1	2	1.87
SP_DEPRESSN	BIGINT	0	0.0%	2	1	2	1.79
SP_DIABETES	BIGINT	0	0.0%	2	1	2	1.64
SP_ISCHMCHT	BIGINT	0	0.0%	2	1	2	1.58
SP_OSTEOPRS	BIGINT	0	0.0%	2	1	2	1.83
SP_RA_OA	BIGINT	0	0.0%	2	1	2	1.86
SP_STRKETIA	BIGINT	0	0.0%	2	1	2	1.96
MEDREIMB_IP	DOUBLE	0	0.0%	3,226	-3000.0	164220.0	1887.00
BENRES_IP	DOUBLE	0	0.0%	315	0.0	53096.0	214.82
PPPYMT_IP	DOUBLE	0	0.0%	74	0.0	91000.0	77.31
MEDREIMB_OP	DOUBLE	0	0.0%	2,101	-100.0	50020.0	609.04
BENRES_OP	DOUBLE	0	0.0%	801	0.0	13840.0	187.67
PPPYMT_OP	DOUBLE	0	0.0%	122	0.0	19000.0	23.30
MEDREIMB_CAR	DOUBLE	0	0.0%	1,319	0.0	21160.0	1117.49
BENRES_CAR	DOUBLE	0	0.0%	404	0.0	5260.0	314.95
PPPYMT_CAR	DOUBLE	0	0.0%	159	0.0	2200.0	17.51
summary_year	INTEGER	0	0.0%	3	2008	2010	2008.99

carrier_claims 4,741,335 rows, 142 cols · 66 high-null cols

Column	Type	Nulls	Null %	Distinct	Min	Max	Mean
DESYNPUF_ID	VARCHAR	0	0.0%	98,626	-	-	-
CLM_ID	BIGINT	0	0.0%	4,741,335	887013384714946	887993389571976	887503229715279.12
CLM_FROM_DT	BIGINT	0	0.0%	1,096	20080101	20101231	20089487.75
CLM_THRU_DT	BIGINT	0	0.0%	1,096	20080101	20101231	20089492.30
ICD9_DGNS_CD_1	VARCHAR	131	0.0%	12,625	-	-	-
ICD9_DGNS_CD_2	VARCHAR	2,071,021	43.68%	8,644	-	-	-
ICD9_DGNS_CD_3	VARCHAR	3,163,046	66.71%	7,857	-	-	-
ICD9_DGNS_CD_4	VARCHAR	3,847,368	81.15%	7,024	-	-	-
ICD9_DGNS_CD_5	VARCHAR	4,623,287	97.51%	4,249	-	-	-
ICD9_DGNS_CD_6	VARCHAR	4,677,558	98.65%	3,450	-	-	-
ICD9_DGNS_CD_7	VARCHAR	4,707,310	99.28%	2,843	-	-	-
ICD9_DGNS_CD_8	VARCHAR	4,718,954	99.53%	2,439	-	-	-
PRF_PHYSN_NPI_1	VARCHAR	9,128	0.19%	614,977	-	-	-
PRF_PHYSN_NPI_2	VARCHAR	2,656,271	56.02%	478,122	-	-	-
PRF_PHYSN_NPI_3	VARCHAR	3,701,236	78.06%	356,126	-	-	-
PRF_PHYSN_NPI_4	VARCHAR	4,160,101	87.74%	260,576	-	-	-
PRF_PHYSN_NPI_5	VARCHAR	4,389,037	92.57%	189,485	-	-	-
PRF_PHYSN_NPI_6	VARCHAR	4,518,473	95.3%	136,725	-	-	-
PRF_PHYSN_NPI_7	VARCHAR	4,620,880	97.46%	83,879	-	-	-
PRF_PHYSN_NPI_8	VARCHAR	4,661,027	98.31%	59,382	-	-	-
PRF_PHYSN_NPI_9	VARCHAR	4,686,566	98.84%	42,219	-	-	-
PRF_PHYSN_NPI_10	VARCHAR	4,702,681	99.18%	30,749	-	-	-
PRF_PHYSN_NPI_11	VARCHAR	4,714,630	99.44%	21,842	-	-	-
PRF_PHYSN_NPI_12	VARCHAR	4,721,317	99.58%	16,622	-	-	-
PRF_PHYSN_NPI_13	VARCHAR	4,727,310	99.7%	11,877	-	-	-
TAX_NUM_1	VARCHAR	1	0.0%	232,675	-	-	-
TAX_NUM_2	VARCHAR	2,651,813	55.93%	191,436	-	-	-
TAX_NUM_3	VARCHAR	3,698,708	78.01%	151,953	-	-	-
TAX_NUM_4	VARCHAR	4,158,547	87.71%	118,839	-	-	-
TAX_NUM_5	VARCHAR	4,388,051	92.55%	92,203	-	-	-
TAX_NUM_6	VARCHAR	4,517,849	95.29%	71,087	-	-	-
TAX_NUM_7	VARCHAR	4,620,521	97.45%	48,271	-	-	-
TAX_NUM_8	VARCHAR	4,660,791	98.3%	36,624	-	-	-
TAX_NUM_9	VARCHAR	4,686,409	98.84%	27,705	-	-	-
TAX_NUM_10	VARCHAR	4,702,574	99.18%	21,313	-	-	-
TAX_NUM_11	VARCHAR	4,714,551	99.44%	15,964	-	-	-
TAX_NUM_12	VARCHAR	4,721,267	99.58%	12,648	-	-	-
TAX_NUM_13	VARCHAR	4,727,272	99.7%	9,422	-	-	-
HCPCS_CD_1	VARCHAR	53,627	1.13%	6,694	-	-	-
HCPCS_CD_2	VARCHAR	2,873,203	60.6%	6,301	-	-	-
HCPCS_CD_3	VARCHAR	3,811,038	80.38%	5,245	-	-	-
HCPCS_CD_4	VARCHAR	4,219,720	89.0%	4,421	-	-	-
HCPCS_CD_5	VARCHAR	4,424,532	93.32%	3,782	-	-	-
HCPCS_CD_6	VARCHAR	4,540,457	95.76%	3,258	-	-	-
HCPCS_CD_7	VARCHAR	4,632,432	97.7%	2,650	-	-	-
HCPCS_CD_8	VARCHAR	4,668,755	98.47%	2,290	-	-	-
HCPCS_CD_9	VARCHAR	4,691,840	98.96%	1,967	-	-	-
HCPCS_CD_10	VARCHAR	4,706,502	99.27%	1,757	-	-	-
HCPCS_CD_11	VARCHAR	4,717,326	99.49%	1,522	-	-	-
HCPCS_CD_12	VARCHAR	4,723,327	99.62%	1,326	-	-	-
HCPCS_CD_13	VARCHAR	4,728,670	99.73%	1,148	-	-	-
LINE_NCH_PMT_AMT_1	DOUBLE	0	0.0%	56	0.0	550.0	57.78
LINE_NCH_PMT_AMT_2	DOUBLE	0	0.0%	56	0.0	550.0	14.39
LINE_NCH_PMT_AMT_3	DOUBLE	0	0.0%	56	0.0	550.0	6.36
LINE_NCH_PMT_AMT_4	DOUBLE	0	0.0%	56	0.0	550.0	3.40
LINE_NCH_PMT_AMT_5	DOUBLE	0	0.0%	56	0.0	550.0	2.10
LINE_NCH_PMT_AMT_6	DOUBLE	0	0.0%	56	0.0	550.0	1.31
LINE_NCH_PMT_AMT_7	DOUBLE	0	0.0%	56	0.0	550.0	0.70
LINE_NCH_PMT_AMT_8	DOUBLE	0	0.0%	56	0.0	550.0	0.46
LINE_NCH_PMT_AMT_9	DOUBLE	0	0.0%	56	0.0	550.0	0.32
LINE_NCH_PMT_AMT_10	DOUBLE	0	0.0%	56	0.0	550.0	0.24
LINE_NCH_PMT_AMT_11	DOUBLE	0	0.0%	56	0.0	550.0	0.16
LINE_NCH_PMT_AMT_12	DOUBLE	0	0.0%	56	0.0	550.0	0.13
LINE_NCH_PMT_AMT_13	DOUBLE	0	0.0%	54	0.0	550.0	0.09
LINE_BENE_PTB_DDCTBL_AMT_1	DOUBLE	0	0.0%	16	0.0	150.0	3.55
LINE_BENE_PTB_DDCTBL_AMT_2	DOUBLE	0	0.0%	16	0.0	150.0	0.38
LINE_BENE_PTB_DDCTBL_AMT_3	DOUBLE	0	0.0%	16	0.0	150.0	0.14
LINE_BENE_PTB_DDCTBL_AMT_4	DOUBLE	0	0.0%	16	0.0	150.0	0.06
LINE_BENE_PTB_DDCTBL_AMT_5	DOUBLE	0	0.0%	16	0.0	150.0	0.03
LINE_BENE_PTB_DDCTBL_AMT_6	DOUBLE	0	0.0%	16	0.0	150.0	0.02
LINE_BENE_PTB_DDCTBL_AMT_7	DOUBLE	0	0.0%	16	0.0	150.0	0.01
LINE_BENE_PTB_DDCTBL_AMT_8	DOUBLE	0	0.0%	16	0.0	150.0	0.00
LINE_BENE_PTB_DDCTBL_AMT_9	DOUBLE	0	0.0%	16	0.0	150.0	0.00
LINE_BENE_PTB_DDCTBL_AMT_10	DOUBLE	0	0.0%	16	0.0	150.0	0.00
LINE_BENE_PTB_DDCTBL_AMT_11	DOUBLE	0	0.0%	14	0.0	150.0	0.00
LINE_BENE_PTB_DDCTBL_AMT_12	DOUBLE	0	0.0%	14	0.0	150.0	0.00
LINE_BENE_PTB_DDCTBL_AMT_13	DOUBLE	0	0.0%	15	0.0	150.0	0.00
LINE_BENE_PRMRY_PYR_PD_AMT_1	DOUBLE	0	0.0%	22	0.0	1200.0	0.94
LINE_BENE_PRMRY_PYR_PD_AMT_2	DOUBLE	0	0.0%	22	0.0	1200.0	0.22
LINE_BENE_PRMRY_PYR_PD_AMT_3	DOUBLE	0	0.0%	22	0.0	1200.0	0.10
LINE_BENE_PRMRY_PYR_PD_AMT_4	DOUBLE	0	0.0%	21	0.0	1200.0	0.05
LINE_BENE_PRMRY_PYR_PD_AMT_5	DOUBLE	0	0.0%	22	0.0	1200.0	0.03
LINE_BENE_PRMRY_PYR_PD_AMT_6	DOUBLE	0	0.0%	22	0.0	1200.0	0.02
LINE_BENE_PRMRY_PYR_PD_AMT_7	DOUBLE	0	0.0%	19	0.0	1200.0	0.01
LINE_BENE_PRMRY_PYR_PD_AMT_8	DOUBLE	0	0.0%	19	0.0	1200.0	0.01
LINE_BENE_PRMRY_PYR_PD_AMT_9	DOUBLE	0	0.0%	19	0.0	1200.0	0.01
LINE_BENE_PRMRY_PYR_PD_AMT_10	DOUBLE	0	0.0%	19	0.0	1200.0	0.00
LINE_BENE_PRMRY_PYR_PD_AMT_11	DOUBLE	0	0.0%	15	0.0	1200.0	0.00
LINE_BENE_PRMRY_PYR_PD_AMT_12	DOUBLE	0	0.0%	18	0.0	1200.0	0.00
LINE_BENE_PRMRY_PYR_PD_AMT_13	DOUBLE	0	0.0%	14	0.0	1200.0	0.00
LINE_COINSRNC_AMT_1	DOUBLE	0	0.0%	19	0.0	180.0	13.96
LINE_COINSRNC_AMT_2	DOUBLE	0	0.0%	19	0.0	180.0	3.23
LINE_COINSRNC_AMT_3	DOUBLE	0	0.0%	19	0.0	180.0	1.38
LINE_COINSRNC_AMT_4	DOUBLE	0	0.0%	19	0.0	180.0	0.71
LINE_COINSRNC_AMT_5	DOUBLE	0	0.0%	19	0.0	180.0	0.43
LINE_COINSRNC_AMT_6	DOUBLE	0	0.0%	19	0.0	180.0	0.27
LINE_COINSRNC_AMT_7	DOUBLE	0	0.0%	19	0.0	180.0	0.14
LINE_COINSRNC_AMT_8	DOUBLE	0	0.0%	19	0.0	180.0	0.09
LINE_COINSRNC_AMT_9	DOUBLE	0	0.0%	19	0.0	180.0	0.06
LINE_COINSRNC_AMT_10	DOUBLE	0	0.0%	19	0.0	180.0	0.04
LINE_COINSRNC_AMT_11	DOUBLE	0	0.0%	19	0.0	180.0	0.03
LINE_COINSRNC_AMT_12	DOUBLE	0	0.0%	19	0.0	180.0	0.02
LINE_COINSRNC_AMT_13	DOUBLE	0	0.0%	19	0.0	180.0	0.02
LINE_ALOWD_CHRG_AMT_1	DOUBLE	0	0.0%	68	0.0	670.0	75.82
LINE_ALOWD_CHRG_AMT_2	DOUBLE	0	0.0%	68	0.0	670.0	18.09
LINE_ALOWD_CHRG_AMT_3	DOUBLE	0	0.0%	68	0.0	670.0	7.94
LINE_ALOWD_CHRG_AMT_4	DOUBLE	0	0.0%	68	0.0	670.0	4.20
LINE_ALOWD_CHRG_AMT_5	DOUBLE	0	0.0%	68	0.0	670.0	2.56
LINE_ALOWD_CHRG_AMT_6	DOUBLE	0	0.0%	68	0.0	670.0	1.61
LINE_ALOWD_CHRG_AMT_7	DOUBLE	0	0.0%	68	0.0	670.0	0.85
LINE_ALOWD_CHRG_AMT_8	DOUBLE	0	0.0%	68	0.0	670.0	0.56
LINE_ALOWD_CHRG_AMT_9	DOUBLE	0	0.0%	68	0.0	670.0	0.39
LINE_ALOWD_CHRG_AMT_10	DOUBLE	0	0.0%	68	0.0	670.0	0.28
LINE_ALOWD_CHRG_AMT_11	DOUBLE	0	0.0%	68	0.0	670.0	0.20
LINE_ALOWD_CHRG_AMT_12	DOUBLE	0	0.0%	67	0.0	670.0	0.15
LINE_ALOWD_CHRG_AMT_13	DOUBLE	0	0.0%	65	0.0	670.0	0.11
LINE_PRCSG_IND_CD_1	VARCHAR	0	0.0%	33	-	-	-
LINE_PRCSG_IND_CD_2	VARCHAR	2,651,812	55.93%	30	-	-	-
LINE_PRCSG_IND_CD_3	VARCHAR	3,698,708	78.01%	31	-	-	-
LINE_PRCSG_IND_CD_4	VARCHAR	4,158,547	87.71%	27	-	-	-
LINE_PRCSG_IND_CD_5	VARCHAR	4,388,051	92.55%	28	-	-	-
LINE_PRCSG_IND_CD_6	VARCHAR	4,517,849	95.29%	26	-	-	-
LINE_PRCSG_IND_CD_7	VARCHAR	4,620,521	97.45%	26	-	-	-
LINE_PRCSG_IND_CD_8	VARCHAR	4,660,791	98.3%	25	-	-	-
LINE_PRCSG_IND_CD_9	VARCHAR	4,686,409	98.84%	24	-	-	-
LINE_PRCSG_IND_CD_10	VARCHAR	4,702,574	99.18%	22	-	-	-
LINE_PRCSG_IND_CD_11	VARCHAR	4,714,551	99.44%	22	-	-	-
LINE_PRCSG_IND_CD_12	VARCHAR	4,721,267	99.58%	23	-	-	-
LINE_PRCSG_IND_CD_13	VARCHAR	4,727,272	99.7%	20	-	-	-
LINE_ICD9_DGNS_CD_1	VARCHAR	61,581	1.3%	8,794	-	-	-
LINE_ICD9_DGNS_CD_2	VARCHAR	2,749,895	58.0%	7,544	-	-	-
LINE_ICD9_DGNS_CD_3	VARCHAR	3,747,980	79.05%	6,413	-	-	-
LINE_ICD9_DGNS_CD_4	VARCHAR	4,184,546	88.26%	5,527	-	-	-
LINE_ICD9_DGNS_CD_5	VARCHAR	4,403,201	92.87%	4,767	-	-	-
LINE_ICD9_DGNS_CD_6	VARCHAR	4,526,653	95.47%	4,127	-	-	-
LINE_ICD9_DGNS_CD_7	VARCHAR	4,625,167	97.55%	3,283	-	-	-
LINE_ICD9_DGNS_CD_8	VARCHAR	4,663,687	98.36%	2,842	-	-	-
LINE_ICD9_DGNS_CD_9	VARCHAR	4,688,251	98.88%	2,515	-	-	-
LINE_ICD9_DGNS_CD_10	VARCHAR	4,703,929	99.21%	2,186	-	-	-
LINE_ICD9_DGNS_CD_11	VARCHAR	4,715,499	99.46%	1,899	-	-	-
LINE_ICD9_DGNS_CD_12	VARCHAR	4,721,908	99.59%	1,717	-	-	-
LINE_ICD9_DGNS_CD_13	VARCHAR	4,727,756	99.71%	1,483	-	-	-

new_beneficiary_summary 343,644 rows, 33 cols · 1 high-null cols

Column	Type	Nulls	Null %	Distinct	Min	Max	Mean
DESYNPUF_ID	VARCHAR	0	0.0%	116,509	-	-	-
BENE_BIRTH_DT	BIGINT	0	0.0%	1,074	19090101	19831201	19364346.17
BENE_DEATH_DT	BIGINT	338,183	98.41%	36	20080101	20101201	20090740.77
BENE_SEX_IDENT_CD	BIGINT	0	0.0%	2	1	2	1.55
BENE_RACE_CD	BIGINT	0	0.0%	4	1	5	1.29
BENE_ESRD_IND	VARCHAR	0	0.0%	2	-	-	-
SP_STATE_CODE	VARCHAR	0	0.0%	52	-	-	-
BENE_COUNTY_CD	VARCHAR	0	0.0%	307	-	-	-
BENE_HI_CVRAGE_TOT_MONS	BIGINT	0	0.0%	13	0	12	11.19
BENE_SMI_CVRAGE_TOT_MONS	BIGINT	0	0.0%	13	0	12	10.84
BENE_HMO_CVRAGE_TOT_MONS	BIGINT	0	0.0%	13	0	12	3.16
PLAN_CVRG_MOS_NUM	VARCHAR	0	0.0%	18	-	-	-
SP_ALZHDMTA	BIGINT	0	0.0%	2	1	2	1.80
SP_CHF	BIGINT	0	0.0%	2	1	2	1.70
SP_CHRNKIDN	BIGINT	0	0.0%	2	1	2	1.83
SP_CNCR	BIGINT	0	0.0%	2	1	2	1.93
SP_COPD	BIGINT	0	0.0%	2	1	2	1.87
SP_DEPRESSN	BIGINT	0	0.0%	2	1	2	1.79
SP_DIABETES	BIGINT	0	0.0%	2	1	2	1.64
SP_ISCHMCHT	BIGINT	0	0.0%	2	1	2	1.58
SP_OSTEOPRS	BIGINT	0	0.0%	2	1	2	1.83
SP_RA_OA	BIGINT	0	0.0%	2	1	2	1.86
SP_STRKETIA	BIGINT	0	0.0%	2	1	2	1.96
MEDREIMB_IP	DOUBLE	0	0.0%	3,264	-3000.0	164220.0	1887.01
BENRES_IP	DOUBLE	0	0.0%	347	0.0	53096.0	214.82
PPPYMT_IP	DOUBLE	0	0.0%	108	0.0	91000.0	77.31
MEDREIMB_OP	DOUBLE	0	0.0%	2,148	-100.0	50020.0	609.03
BENRES_OP	DOUBLE	0	0.0%	842	0.0	13840.0	187.67
PPPYMT_OP	DOUBLE	0	0.0%	153	0.0	19000.0	23.30
MEDREIMB_CAR	DOUBLE	0	0.0%	1,348	0.0	21160.0	1117.49
BENRES_CAR	DOUBLE	0	0.0%	450	0.0	5260.0	314.96
PPPYMT_CAR	DOUBLE	0	0.0%	203	0.0	2200.0	17.51
summary_year	INTEGER	0	0.0%	3	2008	2010	2008.99

new_carrier_claims 4,746,112 rows, 142 cols · 66 high-null cols

Column	Type	Nulls	Null %	Distinct	Min	Max	Mean
DESYNPUF_ID	VARCHAR	0	0.0%	103,363	-	-	-
CLM_ID	VARCHAR	0	0.0%	4,746,112	-	-	-
CLM_FROM_DT	BIGINT	0	0.0%	1,097	20080101	20231332	20089502.91
CLM_THRU_DT	BIGINT	0	0.0%	1,103	20080101	20110107	20089493.62
ICD9_DGNS_CD_1	VARCHAR	628	0.01%	12,625	-	-	-
ICD9_DGNS_CD_2	VARCHAR	2,073,351	43.69%	8,643	-	-	-
ICD9_DGNS_CD_3	VARCHAR	3,166,383	66.72%	7,857	-	-	-
ICD9_DGNS_CD_4	VARCHAR	3,851,333	81.15%	7,024	-	-	-
ICD9_DGNS_CD_5	VARCHAR	4,627,971	97.51%	4,248	-	-	-
ICD9_DGNS_CD_6	VARCHAR	4,682,285	98.66%	3,450	-	-	-
ICD9_DGNS_CD_7	VARCHAR	4,712,062	99.28%	2,842	-	-	-
ICD9_DGNS_CD_8	VARCHAR	4,723,709	99.53%	2,439	-	-	-
PRF_PHYSN_NPI_1	VARCHAR	9,621	0.2%	619,690	-	-	-
PRF_PHYSN_NPI_2	VARCHAR	2,659,190	56.03%	479,954	-	-	-
PRF_PHYSN_NPI_3	VARCHAR	3,705,056	78.07%	357,048	-	-	-
PRF_PHYSN_NPI_4	VARCHAR	4,164,329	87.74%	261,075	-	-	-
PRF_PHYSN_NPI_5	VARCHAR	4,393,480	92.57%	189,801	-	-	-
PRF_PHYSN_NPI_6	VARCHAR	4,523,060	95.3%	136,907	-	-	-
PRF_PHYSN_NPI_7	VARCHAR	4,625,548	97.46%	83,982	-	-	-
PRF_PHYSN_NPI_8	VARCHAR	4,665,732	98.31%	59,448	-	-	-
PRF_PHYSN_NPI_9	VARCHAR	4,691,291	98.84%	42,268	-	-	-
PRF_PHYSN_NPI_10	VARCHAR	4,707,418	99.18%	30,781	-	-	-
PRF_PHYSN_NPI_11	VARCHAR	4,719,380	99.44%	21,868	-	-	-
PRF_PHYSN_NPI_12	VARCHAR	4,726,069	99.58%	16,645	-	-	-
PRF_PHYSN_NPI_13	VARCHAR	4,732,065	99.7%	11,897	-	-	-
TAX_NUM_1	VARCHAR	498	0.01%	237,398	-	-	-
TAX_NUM_2	VARCHAR	2,654,733	55.93%	193,284	-	-	-
TAX_NUM_3	VARCHAR	3,702,529	78.01%	152,891	-	-	-
TAX_NUM_4	VARCHAR	4,162,775	87.71%	119,355	-	-	-
TAX_NUM_5	VARCHAR	4,392,494	92.55%	92,528	-	-	-
TAX_NUM_6	VARCHAR	4,522,436	95.29%	71,277	-	-	-
TAX_NUM_7	VARCHAR	4,625,189	97.45%	48,379	-	-	-
TAX_NUM_8	VARCHAR	4,665,496	98.3%	36,694	-	-	-
TAX_NUM_9	VARCHAR	4,691,134	98.84%	27,757	-	-	-
TAX_NUM_10	VARCHAR	4,707,311	99.18%	21,348	-	-	-
TAX_NUM_11	VARCHAR	4,719,301	99.44%	15,992	-	-	-
TAX_NUM_12	VARCHAR	4,726,019	99.58%	12,673	-	-	-
TAX_NUM_13	VARCHAR	4,732,027	99.7%	9,443	-	-	-
HCPCS_CD_1	VARCHAR	54,165	1.14%	11,032	-	-	-
HCPCS_CD_2	VARCHAR	2,876,326	60.6%	8,035	-	-	-
HCPCS_CD_3	VARCHAR	3,814,958	80.38%	6,142	-	-	-
HCPCS_CD_4	VARCHAR	4,224,026	89.0%	4,924	-	-	-
HCPCS_CD_5	VARCHAR	4,429,009	93.32%	4,099	-	-	-
HCPCS_CD_6	VARCHAR	4,545,060	95.76%	3,449	-	-	-
HCPCS_CD_7	VARCHAR	4,637,108	97.7%	2,762	-	-	-
HCPCS_CD_8	VARCHAR	4,673,466	98.47%	2,361	-	-	-
HCPCS_CD_9	VARCHAR	4,696,566	98.96%	2,023	-	-	-
HCPCS_CD_10	VARCHAR	4,711,247	99.27%	1,793	-	-	-
HCPCS_CD_11	VARCHAR	4,722,076	99.49%	1,554	-	-	-
HCPCS_CD_12	VARCHAR	4,728,079	99.62%	1,353	-	-	-
HCPCS_CD_13	VARCHAR	4,733,426	99.73%	1,171	-	-	-
LINE_NCH_PMT_AMT_1	DOUBLE	497	0.01%	4,751	0.0	584.72	57.95
LINE_NCH_PMT_AMT_2	DOUBLE	497	0.01%	1,951	0.0	580.84	14.47
LINE_NCH_PMT_AMT_3	DOUBLE	497	0.01%	1,046	0.0	562.27	6.40
LINE_NCH_PMT_AMT_4	DOUBLE	497	0.01%	605	0.0	559.12	3.43
LINE_NCH_PMT_AMT_5	DOUBLE	497	0.01%	404	0.0	550.0	2.11
LINE_NCH_PMT_AMT_6	DOUBLE	497	0.01%	270	0.0	550.0	1.32
LINE_NCH_PMT_AMT_7	DOUBLE	497	0.01%	179	0.0	550.0	0.71
LINE_NCH_PMT_AMT_8	DOUBLE	497	0.01%	140	0.0	550.0	0.47
LINE_NCH_PMT_AMT_9	DOUBLE	497	0.01%	119	0.0	550.0	0.33
LINE_NCH_PMT_AMT_10	DOUBLE	497	0.01%	100	0.0	550.0	0.24
LINE_NCH_PMT_AMT_11	DOUBLE	497	0.01%	94	0.0	550.0	0.17
LINE_NCH_PMT_AMT_12	DOUBLE	497	0.01%	86	0.0	550.0	0.13
LINE_NCH_PMT_AMT_13	DOUBLE	497	0.01%	80	0.0	550.0	0.09
LINE_BENE_PTB_DDCTBL_AMT_1	DOUBLE	497	0.01%	4,624	0.0	605.74	3.80
LINE_BENE_PTB_DDCTBL_AMT_2	DOUBLE	497	0.01%	2,185	0.0	585.79	0.48
LINE_BENE_PTB_DDCTBL_AMT_3	DOUBLE	497	0.01%	1,322	0.0	532.15	0.19
LINE_BENE_PTB_DDCTBL_AMT_4	DOUBLE	497	0.01%	966	0.0	543.91	0.09
LINE_BENE_PTB_DDCTBL_AMT_5	DOUBLE	497	0.01%	795	0.0	532.32	0.05
LINE_BENE_PTB_DDCTBL_AMT_6	DOUBLE	497	0.01%	679	0.0	497.61	0.03
LINE_BENE_PTB_DDCTBL_AMT_7	DOUBLE	497	0.01%	526	0.0	499.55	0.02
LINE_BENE_PTB_DDCTBL_AMT_8	DOUBLE	497	0.01%	501	0.0	497.45	0.01
LINE_BENE_PTB_DDCTBL_AMT_9	DOUBLE	497	0.01%	472	0.0	497.16	0.01
LINE_BENE_PTB_DDCTBL_AMT_10	DOUBLE	497	0.01%	493	0.0	465.79	0.01
LINE_BENE_PTB_DDCTBL_AMT_11	DOUBLE	497	0.01%	492	0.0	489.47	0.01
LINE_BENE_PTB_DDCTBL_AMT_12	DOUBLE	497	0.01%	510	0.0	497.07	0.01
LINE_BENE_PTB_DDCTBL_AMT_13	DOUBLE	497	0.01%	470	0.0	455.27	0.01
LINE_BENE_PRMRY_PYR_PD_AMT_1	DOUBLE	497	0.01%	4,654	0.0	1200.0	1.19
LINE_BENE_PRMRY_PYR_PD_AMT_2	DOUBLE	497	0.01%	2,199	0.0	1200.0	0.32
LINE_BENE_PRMRY_PYR_PD_AMT_3	DOUBLE	497	0.01%	1,330	0.0	1200.0	0.15
LINE_BENE_PRMRY_PYR_PD_AMT_4	DOUBLE	497	0.01%	933	0.0	1200.0	0.08
LINE_BENE_PRMRY_PYR_PD_AMT_5	DOUBLE	497	0.01%	725	0.0	1200.0	0.05
LINE_BENE_PRMRY_PYR_PD_AMT_6	DOUBLE	497	0.01%	659	0.0	1200.0	0.03
LINE_BENE_PRMRY_PYR_PD_AMT_7	DOUBLE	497	0.01%	561	0.0	1200.0	0.02
LINE_BENE_PRMRY_PYR_PD_AMT_8	DOUBLE	497	0.01%	502	0.0	1200.0	0.01
LINE_BENE_PRMRY_PYR_PD_AMT_9	DOUBLE	497	0.01%	512	0.0	1200.0	0.01
LINE_BENE_PRMRY_PYR_PD_AMT_10	DOUBLE	497	0.01%	506	0.0	1200.0	0.01
LINE_BENE_PRMRY_PYR_PD_AMT_11	DOUBLE	497	0.01%	470	0.0	1200.0	0.01
LINE_BENE_PRMRY_PYR_PD_AMT_12	DOUBLE	497	0.01%	454	0.0	1200.0	0.01
LINE_BENE_PRMRY_PYR_PD_AMT_13	DOUBLE	497	0.01%	472	0.0	1200.0	0.01
LINE_COINSRNC_AMT_1	DOUBLE	497	0.01%	4,659	0.0	600.28	14.20
LINE_COINSRNC_AMT_2	DOUBLE	497	0.01%	1,888	0.0	562.41	3.32
LINE_COINSRNC_AMT_3	DOUBLE	497	0.01%	981	0.0	549.83	1.43
LINE_COINSRNC_AMT_4	DOUBLE	497	0.01%	547	0.0	562.71	0.73
LINE_COINSRNC_AMT_5	DOUBLE	497	0.01%	351	0.0	598.74	0.45
LINE_COINSRNC_AMT_6	DOUBLE	497	0.01%	217	0.0	497.33	0.28
LINE_COINSRNC_AMT_7	DOUBLE	497	0.01%	135	0.0	499.98	0.15
LINE_COINSRNC_AMT_8	DOUBLE	497	0.01%	93	0.0	499.44	0.09
LINE_COINSRNC_AMT_9	DOUBLE	497	0.01%	77	0.0	483.12	0.07
LINE_COINSRNC_AMT_10	DOUBLE	497	0.01%	57	0.0	495.97	0.05
LINE_COINSRNC_AMT_11	DOUBLE	497	0.01%	51	0.0	490.21	0.03
LINE_COINSRNC_AMT_12	DOUBLE	497	0.01%	46	0.0	474.16	0.03
LINE_COINSRNC_AMT_13	DOUBLE	497	0.01%	42	0.0	493.75	0.02
LINE_ALOWD_CHRG_AMT_1	DOUBLE	497	0.01%	4,703	0.0	670.0	76.00
LINE_ALOWD_CHRG_AMT_2	DOUBLE	497	0.01%	1,928	0.0	747.37	18.17
LINE_ALOWD_CHRG_AMT_3	DOUBLE	497	0.01%	1,020	0.0	670.0	7.98
LINE_ALOWD_CHRG_AMT_4	DOUBLE	497	0.01%	598	0.0	670.0	4.22
LINE_ALOWD_CHRG_AMT_5	DOUBLE	497	0.01%	409	0.0	670.0	2.57
LINE_ALOWD_CHRG_AMT_6	DOUBLE	497	0.01%	266	0.0	670.0	1.62
LINE_ALOWD_CHRG_AMT_7	DOUBLE	497	0.01%	181	0.0	670.0	0.85
LINE_ALOWD_CHRG_AMT_8	DOUBLE	497	0.01%	144	0.0	670.0	0.56
LINE_ALOWD_CHRG_AMT_9	DOUBLE	497	0.01%	126	0.0	670.0	0.40
LINE_ALOWD_CHRG_AMT_10	DOUBLE	497	0.01%	105	0.0	670.0	0.28
LINE_ALOWD_CHRG_AMT_11	DOUBLE	497	0.01%	101	0.0	670.0	0.20
LINE_ALOWD_CHRG_AMT_12	DOUBLE	497	0.01%	95	0.0	670.0	0.15
LINE_ALOWD_CHRG_AMT_13	DOUBLE	497	0.01%	88	0.0	670.0	0.11
LINE_PRCSG_IND_CD_1	VARCHAR	497	0.01%	33	-	-	-
LINE_PRCSG_IND_CD_2	VARCHAR	2,654,732	55.93%	31	-	-	-
LINE_PRCSG_IND_CD_3	VARCHAR	3,702,529	78.01%	32	-	-	-
LINE_PRCSG_IND_CD_4	VARCHAR	4,162,775	87.71%	28	-	-	-
LINE_PRCSG_IND_CD_5	VARCHAR	4,392,494	92.55%	29	-	-	-
LINE_PRCSG_IND_CD_6	VARCHAR	4,522,436	95.29%	27	-	-	-
LINE_PRCSG_IND_CD_7	VARCHAR	4,625,189	97.45%	28	-	-	-
LINE_PRCSG_IND_CD_8	VARCHAR	4,665,496	98.3%	25	-	-	-
LINE_PRCSG_IND_CD_9	VARCHAR	4,691,134	98.84%	25	-	-	-
LINE_PRCSG_IND_CD_10	VARCHAR	4,707,311	99.18%	22	-	-	-
LINE_PRCSG_IND_CD_11	VARCHAR	4,719,301	99.44%	23	-	-	-
LINE_PRCSG_IND_CD_12	VARCHAR	4,726,019	99.58%	23	-	-	-
LINE_PRCSG_IND_CD_13	VARCHAR	4,732,027	99.7%	20	-	-	-
LINE_ICD9_DGNS_CD_1	VARCHAR	62,089	1.31%	12,014	-	-	-
LINE_ICD9_DGNS_CD_2	VARCHAR	2,752,822	58.0%	8,984	-	-	-
LINE_ICD9_DGNS_CD_3	VARCHAR	3,751,804	79.05%	7,203	-	-	-
LINE_ICD9_DGNS_CD_4	VARCHAR	4,188,777	88.26%	5,985	-	-	-
LINE_ICD9_DGNS_CD_5	VARCHAR	4,407,641	92.87%	5,069	-	-	-
LINE_ICD9_DGNS_CD_6	VARCHAR	4,531,240	95.47%	4,303	-	-	-
LINE_ICD9_DGNS_CD_7	VARCHAR	4,629,838	97.55%	3,383	-	-	-
LINE_ICD9_DGNS_CD_8	VARCHAR	4,668,391	98.36%	2,910	-	-	-
LINE_ICD9_DGNS_CD_9	VARCHAR	4,692,975	98.88%	2,568	-	-	-
LINE_ICD9_DGNS_CD_10	VARCHAR	4,708,665	99.21%	2,220	-	-	-
LINE_ICD9_DGNS_CD_11	VARCHAR	4,720,249	99.46%	1,930	-	-	-
LINE_ICD9_DGNS_CD_12	VARCHAR	4,726,660	99.59%	1,743	-	-	-
LINE_ICD9_DGNS_CD_13	VARCHAR	4,732,511	99.71%	1,506	-	-	-

_discrepancy_detail 343,485 rows, 37 cols

Column	Type	Null %	Distinct	Min	Max	Mean
DESYNPUF_ID	VARCHAR	0.0%	116,350	-	-	-
summary_year	INTEGER	0.0%	3	2008	2010	2008.99
SP_STATE_CODE	VARCHAR	0.0%	52	-	-	-
diff_medreimb_ip	INTEGER	0.0%	2	0	1	0.00
diff_benres_ip	INTEGER	0.0%	2	0	1	0.00
diff_pppymt_ip	INTEGER	0.0%	2	0	1	0.00
diff_medreimb_op	INTEGER	0.0%	2	0	1	0.00
diff_benres_op	INTEGER	0.0%	2	0	1	0.00
diff_pppymt_op	INTEGER	0.0%	2	0	1	0.00
diff_medreimb_car	INTEGER	0.0%	2	0	1	0.00
diff_benres_car	INTEGER	0.0%	2	0	1	0.00
diff_pppymt_car	INTEGER	0.0%	2	0	1	0.00
diff_bene_sex_ident_cd	INTEGER	0.0%	1	0	0	0.00
diff_bene_race_cd	INTEGER	0.0%	1	0	0	0.00
diff_bene_birth_dt	INTEGER	0.0%	2	0	1	0.00
diff_bene_death_dt	INTEGER	0.0%	1	0	0	0.00
diff_sp_alzhdmta	INTEGER	0.0%	1	0	0	0.00
diff_sp_chf	INTEGER	0.0%	1	0	0	0.00
diff_sp_chrnkidn	INTEGER	0.0%	1	0	0	0.00
diff_sp_cncr	INTEGER	0.0%	1	0	0	0.00
diff_sp_copd	INTEGER	0.0%	1	0	0	0.00
diff_sp_depressn	INTEGER	0.0%	1	0	0	0.00
diff_sp_diabetes	INTEGER	0.0%	1	0	0	0.00
diff_sp_ischmcht	INTEGER	0.0%	1	0	0	0.00
diff_sp_osteoprs	INTEGER	0.0%	1	0	0	0.00
diff_sp_ra_oa	INTEGER	0.0%	1	0	0	0.00
diff_sp_strketia	INTEGER	0.0%	1	0	0	0.00
delta_medreimb_ip	DOUBLE	0.0%	39	0.0	2360.5300000000007	0.02
delta_benres_ip	DOUBLE	0.0%	33	0.0	748.73	0.01
delta_pppymt_ip	DOUBLE	0.0%	35	0.0	572.4200000000001	0.01
delta_medreimb_op	DOUBLE	0.0%	48	0.0	5339.950000000001	0.03
delta_benres_op	DOUBLE	0.0%	42	0.0	189.99	0.01
delta_pppymt_op	DOUBLE	0.0%	32	0.0	99.56	0.00
delta_medreimb_car	DOUBLE	0.0%	31	0.0	831.5	0.01
delta_benres_car	DOUBLE	0.0%	47	0.0	269.24	0.01
delta_pppymt_car	DOUBLE	0.0%	45	0.0	99.72	0.01
total_diffs	INTEGER	0.0%	3	0	2	0.00

_financial_recon 262,017 rows, 11 cols

Column	Type	Null %	Distinct	Min	Max	Mean
DESYNPUF_ID	VARCHAR	0.0%	98,424	-	-	-
summary_year	INTEGER	0.0%	3	2008	2010	2009.00
reported_medreimb	DOUBLE	0.0%	1,319	0.0	21160.0	1465.59
calc_medreimb_car	DOUBLE	0.0%	1,323	0.0	21160.0	1465.62
reported_benres	DOUBLE	0.0%	404	0.0	5260.0	413.06
calc_benres_car	DOUBLE	0.0%	402	0.0	5380.0	413.07
reported_pppymt	DOUBLE	0.0%	159	0.0	2200.0	22.96
calc_pppymt_car	DOUBLE	0.0%	159	0.0	2200.0	22.96
medreimb_diff	DOUBLE	0.0%	121	0.0	3100.0	3.55
benres_diff	DOUBLE	0.0%	48	0.0	990.0	0.93
pppymt_diff	DOUBLE	0.0%	15	0.0	1200.0	0.04

_match_beneficiary 343,803 rows, 3 cols

Column	Type	Null %	Distinct	Min	Max	Mean
DESYNPUF_ID	VARCHAR	0.0%	116,511	-	-	-
summary_year	VARCHAR	0.0%	3	-	-	-
match_status	VARCHAR	0.0%	3	-	-	-

_match_claims 4,746,112 rows, 2 cols

Column	Type	Nulls	Null %	Distinct	Min	Max	Mean
CLM_ID	VARCHAR	0	0.0%	4,746,112	-	-	-
match_status	VARCHAR	0	0.0%	2	-	-	-

Pipeline: INGEST → PROFILE → VALIDATE → COMPARE → REPORT

CMS DE-SynPUF 2008–2010 · DuckDB + Python