Content is user-generated and unverified.

Analytics Tables Inventory for Database Migration

Overview

This document contains a comprehensive inventory of all analytical tables that need to be migrated from MySQL to another database system. These tables are used for aggregations and reporting purposes.

DSP Database (`rtb-dsp` schema)

Campaign Performance Report Tables

Table Name	Row Count	Data Size (bytes)	Data Size (GB)
campaign_performance_report_adstxt	538,847	116,998,144	0.11
campaign_performance_report_age_group	12,702,773	1,888,468,992	1.76
campaign_performance_report_age_group_custom	10,190,863	1,516,240,896	1.41
campaign_performance_report_analytics	76,380,687	9,049,227,264	8.43
campaign_performance_report_audience	2,014,475	303,923,200	0.28
campaign_performance_report_audience_footfall	389,377	27,869,184	0.03
campaign_performance_report_bidder	305,216,020	71,035,240,448	66.16
campaign_performance_report_browser	30,263,557	5,056,823,296	4.71
campaign_performance_report_campaign	1,900,494	274,497,536	0.26
campaign_performance_report_campaign_tz	1,893,983	272,400,384	0.25
campaign_performance_report_creative	23,200,956	3,878,535,168	3.61
campaign_performance_report_creative_size	216,928,047	30,787,239,936	28.68
campaign_performance_report_creative_type	1,736,805	269,303,808	0.25
campaign_performance_report_device_model	694,367,864	149,258,797,056	139.03
campaign_performance_report_device_type	6,920,711	1,055,916,032	0.98
campaign_performance_report_exchange	32,693,090	5,677,563,904	5.29
campaign_performance_report_exchange_platform	96,012	13,156,352	0.01
campaign_performance_report_exchange_tz	21,007,115	3,093,299,200	2.88
campaign_performance_report_gender	4,523,798	689,963,008	0.64
campaign_performance_report_gender_custom	3,688,018	560,988,160	0.52
campaign_performance_report_hour	29,280,309	4,127,178,752	3.84
campaign_performance_report_location	211,787,861	44,263,440,384	41.23
campaign_performance_report_location_custom	11,516,288	1,477,443,584	1.38
campaign_performance_report_metrics	25,741,674	1,736,966,144	1.62
campaign_performance_report_metrics_adstxt	6,581,606	605,339,648	0.56
campaign_performance_report_metrics_age_group	5,706,050	542,277,632	0.51
campaign_performance_report_metrics_audience	2,826,540	268,075,008	0.25
campaign_performance_report_metrics_browser	14,942,553	1,380,728,832	1.29
campaign_performance_report_metrics_creative	11,375,416	1,042,038,784	0.97
campaign_performance_report_metrics_creative_size	44,013,103	3,917,348,864	3.65
campaign_performance_report_metrics_creative_type	2,151,525	208,207,872	0.19
campaign_performance_report_metrics_device_model	344,618,746	30,590,550,016	28.50
campaign_performance_report_metrics_device_type	4,749,051	424,574,976	0.40
campaign_performance_report_metrics_exchange	14,068,287	1,356,218,368	1.26
campaign_performance_report_metrics_gender	3,934,655	338,509,824	0.32
campaign_performance_report_metrics_location	102,113,496	8,714,387,456	8.12
campaign_performance_report_metrics_operator	14,401,244	1,383,858,176	1.29
campaign_performance_report_metrics_os	6,449,825	582,254,592	0.54
campaign_performance_report_metrics_package	789,406	76,365,824	0.07
campaign_performance_report_metrics_placement	0	180,224	0.00
campaign_performance_report_metrics_placement_instl	3,009,181	274,350,080	0.26
campaign_performance_report_metrics_placement_pos	8,080,757	731,447,296	0.68
campaign_performance_report_metrics_private_marketplace	2,779,459	241,795,072	0.23
campaign_performance_report_metrics_schain	5,543,031	532,824,064	0.50
campaign_performance_report_metrics_site	382,888,212	35,952,050,176	33.49
campaign_performance_report_metrics_site_platform	4,077,967	387,907,584	0.36
campaign_performance_report_metrics_site_type	3,040,226	292,241,408	0.27
campaign_performance_report_operator	14,971,910	2,227,159,040	2.07
campaign_performance_report_os	14,194,098	2,257,125,376	2.10
campaign_performance_report_package	55,334	14,172,160	0.01
campaign_performance_report_placement_instl	3,016,514	460,324,864	0.43
campaign_performance_report_placement_pos	8,965,430	1,333,788,672	1.24
campaign_performance_report_private_marketplace	373,340	74,088,448	0.07
campaign_performance_report_reach	2,493,071	40,191,868,928	37.44
campaign_performance_report_reach_alt	191,287	175,308,800	0.16
campaign_performance_report_reach_operator	9,894,267	62,595,104,768	58.32
campaign_performance_report_schain	3,508,215	531,628,032	0.50
campaign_performance_report_site	1,291,754,748	315,046,985,728	293.47
campaign_performance_report_site_platform	4,779,877	728,760,320	0.68
campaign_performance_report_site_type	2,816,375	429,916,160	0.40

Campaign Performance Stats Tables

Table Name	Row Count	Data Size (bytes)	Data Size (GB)
campaign_performance_stats_bid_loss	1,053,755	47,824,896	0.04
campaign_performance_stats_country	226	16,384	0.00
campaign_performance_stats_custom	7,592,723	757,432,320	0.71
campaign_performance_stats_custom_subtypes	7,709	1,425,408	0.00
campaign_performance_stats_custom_types	7	16,384	0.00
campaign_performance_stats_measurement	316,405	34,701,312	0.03
campaign_performance_stats_segmentless	0	524,288	0.00

Campaign Optimization Stats Tables

Table Name	Row Count	Data Size (bytes)	Data Size (GB)
campaign_optimisation_stats_banner	136,332,154	34,998,337,536	32.61
campaign_optimisation_stats_native	19,624	11,583,488	0.01
campaign_optimisation_stats_native_video	0	16,384	0.00
campaign_optimisation_stats_placements	6,329,718	1,302,364,160	1.21
campaign_optimisation_stats_placements_tracking	1,129,767	370,294,784	0.34
campaign_optimisation_stats_video	35,015,532	7,322,222,592	6.82

Other Analytics Tables

Table Name	Row Count	Data Size (bytes)	Data Size (GB)
campaign_performance_aggregator_stats	520,560	79,413,248	0.07
private_marketplace_stats	11,752,191	1,954,578,432	1.82
private_marketplace_stats_OLD	0	127,549,440	0.12
rtb_sites_bidding_stats	495,521,422	58,620,739,584	54.62
partner_provided_data_statistics	881,334	119,308,288	0.11
brand_safety_validation_stats	0	1,015,808	0.00
site_bid_request_statistics	0	1,507,328	0.00

BI Tables

Table Name	Row Count	Data Size (bytes)	Data Size (GB)
bi_daily_currency_rates	9,268	1,589,248	0.00
bi_pipedrive_activities	1,006,785	248,397,824	0.23
bi_pipedrive_deals	44,702	14,204,928	0.01
bi_pipedrive_io_number_deals	38,418	2,637,824	0.00
bi_pipedrive_leads	5,533	2,523,136	0.00
bi_pipedrive_organizations	133,624	43,614,208	0.04
bi_pipedrive_peoples	198,922	80,379,904	0.07
bi_pipedrive_stages	128	16,384	0.00
bi_pipedrive_users	259	49,152	0.00
bi_pipedrive_users_teams	6	16,384	0.00
bi_pipedrive_users_teams_am	10	16,384	0.00

DSP Database (`traffic-discovery` schema)

Bid Request Statistics Tables

Table Name	Row Count	Data Size (bytes)	Data Size (GB)
bid_requests_stats_1d	9,108,092	789,577,728	0.74
bid_requests_stats_1d_country_id	226	16,384	0.00
bid_requests_stats_1d_exchange_id	55	16,384	0.00
bid_requests_stats_1d_top_countries	144	16,384	0.00
bid_requests_stats_1d_top_sites	1,048,916	50,937,856	0.05
bid_requests_stats_7d	13,253,123	1,123,024,896	1.05
bid_requests_stats_7d_country_id	230	16,384	0.00
bid_requests_stats_7d_exchange_id	55	16,384	0.00
bid_requests_stats_7d_top_countries	177	16,384	0.00
bid_requests_stats_7d_top_sites	2,173,534	105,512,960	0.10
bid_requests_stats_30d	17,007,296	1,402,994,688	1.31
bid_requests_stats_30d_countries_sites	3,773,940	100,270,080	0.09
bid_requests_stats_30d_country_id	238	16,384	0.00
bid_requests_stats_30d_exchange_id	51	16,384	0.00
bid_requests_stats_30d_operators	54,172	2,637,824	0.00
bid_requests_stats_30d_top_countries	220	16,384	0.00
bid_requests_stats_30d_top_sites	3,476,837	167,444,480	0.16

Bid Request Stats 30d Partitioned Tables (600-664)

Table Name	Row Count	Data Size (bytes)	Data Size (GB)
bid_requests_stats_30d_600	14,938,502	1,103,085,568	1.03
bid_requests_stats_30d_601	15,052,294	1,111,474,176	1.04
bid_requests_stats_30d_602	16,832,072	1,242,546,176	1.16
bid_requests_stats_30d_603	16,964,152	1,253,031,936	1.17
bid_requests_stats_30d_604	12,929,870	955,236,352	0.89
bid_requests_stats_30d_605	12,219,686	902,807,552	0.84
bid_requests_stats_30d_606	11,891,772	878,690,304	0.82
bid_requests_stats_30d_607	11,839,956	874,496,000	0.81
bid_requests_stats_30d_608	13,843,000	1,022,345,216	0.95
bid_requests_stats_30d_609	12,306,808	909,099,008	0.85
bid_requests_stats_30d_610	15,262,860	1,127,202,816	1.05
bid_requests_stats_30d_611	18,646,394	1,376,763,904	1.28
bid_requests_stats_30d_612	20,606,512	1,521,467,392	1.42
bid_requests_stats_30d_613	22,864,826	1,688,190,976	1.57
bid_requests_stats_30d_614	24,664,670	1,821,360,128	1.70
bid_requests_stats_30d_615	25,907,238	1,912,586,240	1.78
bid_requests_stats_30d_616	31,783,020	2,345,648,128	2.18
bid_requests_stats_30d_617	31,235,904	2,305,802,240	2.15
bid_requests_stats_30d_618	31,522,162	2,326,773,760	2.17
bid_requests_stats_30d_619	16,664,178	1,231,011,840	1.15
bid_requests_stats_30d_620	14,930,882	1,103,085,568	1.03
bid_requests_stats_30d_621	24,187,404	1,785,708,544	1.66
bid_requests_stats_30d_622	20,305,014	1,498,398,720	1.40
bid_requests_stats_30d_623	25,662,502	1,700,790,272	1.58
bid_requests_stats_30d_624	13,856,398	1,215,299,584	1.13
bid_requests_stats_30d_625	12,737,616	1,116,733,440	1.04
bid_requests_stats_30d_626	12,933,913	1,099,956,224	1.02
bid_requests_stats_30d_627	15,863,694	1,304,428,544	1.22
bid_requests_stats_30d_628	23,408,582	2,049,966,080	1.91
bid_requests_stats_30d_629	22,935,627	1,837,105,152	1.71
bid_requests_stats_30d_630	23,129,558	1,815,085,056	1.69
bid_requests_stats_30d_631	22,382,762	1,731,198,976	1.61
bid_requests_stats_30d_632	22,346,747	1,730,150,400	1.61
bid_requests_stats_30d_633	23,062,503	1,846,542,336	1.72
bid_requests_stats_30d_634	23,499,714	1,911,554,048	1.78
bid_requests_stats_30d_635	20,154,713	1,574,961,152	1.47
bid_requests_stats_30d_636	20,945,848	1,758,461,952	1.64
bid_requests_stats_30d_637	15,391,148	1,285,554,176	1.20
bid_requests_stats_30d_638	13,327,277	1,141,899,264	1.06
bid_requests_stats_30d_639	11,585,923	967,835,648	0.90
bid_requests_stats_30d_640	13,190,135	1,105,199,104	1.03
bid_requests_stats_30d_641	16,712,832	1,428,160,512	1.33
bid_requests_stats_30d_642	19,059,252	1,664,090,112	1.55
bid_requests_stats_30d_643	17,506,668	1,480,589,312	1.38
bid_requests_stats_30d_644	16,012,329	1,337,982,976	1.25
bid_requests_stats_30d_645	19,530,793	1,680,867,328	1.57
bid_requests_stats_30d_646	22,333,686	1,894,776,832	1.76
bid_requests_stats_30d_647	22,283,173	1,945,108,480	1.81
bid_requests_stats_30d_648	17,438,990	1,408,237,568	1.31
bid_requests_stats_30d_649	17,490,026	1,411,383,296	1.31
bid_requests_stats_30d_650	14,539,668	1,142,947,840	1.06
bid_requests_stats_30d_651	10,567,844	946,864,128	0.88
bid_requests_stats_30d_652	8,757,334	785,383,424	0.73
bid_requests_stats_30d_653	7,130,273	605,028,352	0.56
bid_requests_stats_30d_654	10,065,614	861,929,472	0.80
bid_requests_stats_30d_655	15,717,063	1,304,428,544	1.22
bid_requests_stats_30d_656	14,735,920	1,311,768,576	1.22
bid_requests_stats_30d_657	12,157,268	1,006,632,960	0.94
bid_requests_stats_30d_658	12,623,730	1,068,498,944	1.00
bid_requests_stats_30d_659	13,895,950	1,155,530,752	1.08
bid_requests_stats_30d_660	17,366,270	1,499,463,680	1.40
bid_requests_stats_30d_661	17,019,730	1,389,363,200	1.29
bid_requests_stats_30d_662	19,977,820	1,743,781,888	1.62
bid_requests_stats_30d_663	16,522,944	1,441,792,000	1.34
bid_requests_stats_30d_664	16,348,832	1,463,812,096	1.36

Other Tables

Table Name	Row Count	Data Size (bytes)	Data Size (GB)
custom_fields_table_status	2,044	147,456	0.00

RTB Stats Database (`rtb-dsp-stats` schema)

Campaign Performance Stats Tables (Daily Partitioned)

Table Name	Row Count	Data Size (bytes)	Data Size (GB)
campaign_performance_stats_2025-05-27	32,718,020	7,446,921,216	6.94
campaign_performance_stats_2025-05-28	33,359,585	8,744,992,768	8.15
campaign_performance_stats_2025-05-29	34,177,329	7,903,051,776	7.36
campaign_performance_stats_2025-05-30	30,368,670	8,320,319,488	7.75
campaign_performance_stats_2025-05-31	30,508,416	7,232,962,560	6.74
campaign_performance_stats_2025-06-01	17,045,403	4,281,221,120	3.99
campaign_performance_stats_2025-06-02	17,270,549	4,098,850,816	3.82
campaign_performance_stats_2025-06-03	17,924,810	4,772,003,840	4.45
campaign_performance_stats_2025-06-04	24,321,977	5,714,690,048	5.32
campaign_performance_stats_2025-06-05	22,862,955	5,759,713,280	5.37
campaign_performance_stats_2025-06-06	22,093,329	6,021,873,664	5.61
campaign_performance_stats_2025-06-07	20,818,210	5,296,275,456	4.93
campaign_performance_stats_2025-06-08	17,203,089	4,692,312,064	4.37
campaign_performance_stats_2025-06-09	27,933,862	6,080,626,688	5.66
campaign_performance_stats_2025-06-10	27,440,931	6,828,212,224	6.36
campaign_performance_stats_2025-06-11	24,691,943	6,922,584,064	6.45
campaign_performance_stats_2025-06-12	28,122,861	7,342,063,616	6.84
campaign_performance_stats_2025-06-13	27,421,446	7,643,971,584	7.12
campaign_performance_stats_2025-06-14	23,602,341	6,967,721,984	6.49
campaign_performance_stats_2025-06-15	22,040,288	5,236,506,624	4.88
campaign_performance_stats_2025-06-16	15,556,399	4,310,597,632	4.02
campaign_performance_stats_2025-06-17	20,956,789	5,102,223,360	4.75
campaign_performance_stats_2025-06-18	23,645,071	6,195,920,896	5.77
campaign_performance_stats_2025-06-19	27,192,687	7,849,459,712	7.31
campaign_performance_stats_2025-06-20	26,708,054	7,705,903,104	7.18
campaign_performance_stats_2025-06-21	31,680,987	7,407,058,944	6.90
campaign_performance_stats_2025-06-22	25,375,332	7,457,341,440	6.95
campaign_performance_stats_2025-06-23	30,490,433	7,810,744,320	7.28
campaign_performance_stats_2025-06-24	32,583,459	8,202,944,512	7.64
campaign_performance_stats_2025-06-25	33,507,493	7,972,192,256	7.43
campaign_performance_stats_2025-06-26	22,531,884	5,448,269,824	5.08
campaign_performance_stats_2025-06-27	0	16,384	0.00

Campaign Performance Stats Non-RTB Tables (Daily Partitioned)

Table Name	Row Count	Data Size (bytes)
campaign_performance_stats_non_rtb_2025-05-27	162	49,152
campaign_performance_stats_non_rtb_2025-05-28	162	49,152
campaign_performance_stats_non_rtb_2025-05-29	196	65,536
campaign_performance_stats_non_rtb_2025-05-30	218	65,536
campaign_performance_stats_non_rtb_2025-05-31	184	81,920
campaign_performance_stats_non_rtb_2025-06-01	178	65,536
campaign_performance_stats_non_rtb_2025-06-02	103	16,384
campaign_performance_stats_non_rtb_2025-06-03	98	16,384
campaign_performance_stats_non_rtb_2025-06-04	98	16,384
campaign_performance_stats_non_rtb_2025-06-05	93	16,384
campaign_performance_stats_non_rtb_2025-06-06	94	16,384
campaign_performance_stats_non_rtb_2025-06-07	93	16,384
campaign_performance_stats_non_rtb_2025-06-08	93	16,384
campaign_performance_stats_non_rtb_2025-06-09	118	49,152
campaign_performance_stats_non_rtb_2025-06-10	115	49,152
campaign_performance_stats_non_rtb_2025-06-11	113	49,152
campaign_performance_stats_non_rtb_2025-06-12	110	16,384
campaign_performance_stats_non_rtb_2025-06-13	53	16,384
campaign_performance_stats_non_rtb_2025-06-14	57	16,384
campaign_performance_stats_non_rtb_2025-06-15	56	16,384
campaign_performance_stats_non_rtb_2025-06-16	83	16,384
campaign_performance_stats_non_rtb_2025-06-17	83	16,384
campaign_performance_stats_non_rtb_2025-06-18	83	16,384
campaign_performance_stats_non_rtb_2025-06-19	83	16,384
campaign_performance_stats_non_rtb_2025-06-20	83	16,384
campaign_performance_stats_non_rtb_2025-06-21	83	16,384
campaign_performance_stats_non_rtb_2025-06-22	83	16,384
campaign_performance_stats_non_rtb_2025-06-23	82	16,384
campaign_performance_stats_non_rtb_2025-06-24	36	16,384
campaign_performance_stats_non_rtb_2025-06-25	39	16,384
campaign_performance_stats_non_rtb_2025-06-26	39	16,384
campaign_performance_stats_non_rtb_2025-06-27	0	16,384

Other Analytics Tables

Table Name	Row Count	Data Size (bytes)	Data Size (GB)
bid_loss_reasons	1,029	163,840	0.00
bid_loss_statistics	7,562,250	594,329,600	0.55
campaign_performance_stats_segmentless	279,607,765	66,355,773,440	61.82
campaign_performance_stats_segmentless_non_rtb	10,820	3,014,656	0.00
sites_domains_stats	116,229,258	17,793,810,432	16.57
sites_url_data	362,888	109,805,568	0.10
sites_url_data_old	180,563	37,322,752	0.03
sites_url_hash_map	614,784,667	149,907,324,928	139.63
user_identity_stats	91,361,725	9,569,370,112	8.92
user_tracking_pixel_stats	63,763,666	19,538,788,352	18.20

Reference Tables

Table Name	Row Count	Data Size (bytes)
offsets	0	16,384
tmp_attribution_types	2	16,384
tmp_browsers	1,110	98,304
tmp_countries	250	16,384
tmp_exchanges	575	65,536
tmp_exchanges_types	5	16,384
tmp_oses	3,153	245,760
tmp_sites_types	2	16,384
tmp_users_admin	15,057	1,589,248
tmp_user_identity_types	4	16,384

Summary Statistics

Total Data Volume by Database

Database	Schema	Total Tables	Total Rows	Total Size (GB)
DSP	rtb-dsp	99	7,027,335,544	1,396.17
DSP	traffic-discovery	83	1,097,729,548	89.29
RTB Stats	rtb-dsp-stats	84	2,117,659,925	558.52
Grand Total	-	266	10,242,725,017	2,043.98

Key Observations for Migration

Data Volume: Total of ~2TB of analytical data across 266 tables
Row Count: Over 10 billion rows of data
Largest Tables:
- sites_url_hash_map: 614M rows, 139.63 GB
- campaign_performance_report_site: 1.29B rows, 293.47 GB
- campaign_performance_report_device_model: 694M rows, 139.03 GB
Time-Partitioned Tables: Most analytical tables use daily or periodic partitioning
Monetary Data: All monetary fields need division by 10,000,000 for ClickHouse

Migration Recommendations

Priority Tables: Focus on frequently queried tables first
Partitioning Strategy: Maintain time-based partitioning for performance
Compression: ClickHouse columnar storage should significantly reduce storage requirements
Incremental Migration: Consider migrating historical data in batches
Data Validation: Implement checksums for data integrity verification
Parallel Processing: Use multiple threads for large table migrations

Content is user-generated and unverified.

Analytics Tables Inventory for Database Migration

Overview

DSP Database (rtb-dsp schema)

Campaign Performance Report Tables

Campaign Performance Stats Tables

Campaign Optimization Stats Tables

Other Analytics Tables

BI Tables

DSP Database (traffic-discovery schema)

Bid Request Statistics Tables

Bid Request Stats 30d Partitioned Tables (600-664)

Other Tables

RTB Stats Database (rtb-dsp-stats schema)

Campaign Performance Stats Tables (Daily Partitioned)

Campaign Performance Stats Non-RTB Tables (Daily Partitioned)

Other Analytics Tables

Reference Tables

Summary Statistics

Total Data Volume by Database

Key Observations for Migration

Migration Recommendations

DSP Database (`rtb-dsp` schema)

DSP Database (`traffic-discovery` schema)

RTB Stats Database (`rtb-dsp-stats` schema)