Doris [DATA_QUALITY_ERROR]too many filtered rows
通过StreamLoad往数据库写数据报错
{"TxnId": 2433098,"Label": "097a7f45-f731-4888-a1ed-3fca2e8ee26e","Comment": "","TwoPhaseCommit": "false","Status": "Fail","Message": "[DATA_QUALITY_ERROR]too many filtered rows","NumberTotalRows": 1,"NumberLoadedRows": 0,"NumberFilteredRows": 1,"NumberUnselectedRows": 0,"LoadBytes": 362,"LoadTimeMs": 16,"BeginTxnTimeMs": 0,"StreamLoadPutTimeMs": 3,"ReadDataTimeMs": 0,"WriteDataTimeMs": 9,"CommitAndPublishTimeMs": 0,"ErrorURL": "http://ip:port/api/_load_error_log?file=__shard_774/error_log_insert_stmt_c34e04b0aa73a1a7-1ac7b5b233a6fbbb_c34e04b0aa73a1a7_1ac7b5b233a6fbbb"
}
Message信息提示[DATA_QUALITY_ERROR]too many filtered rows,并不能直观看出问题所在。可以通过ErrorURL的链接打开查看。一般常见的问题为:
1.分区的字段值有问题。比如按时间分区,当前分区只截止到202412月份,但是却传入了更大的日期,比如2025年12月。
2.表结构有问题。比如不可为空的字段你传入了null;此时请仔细检查数据库的表字段顺序和你传入的表头顺序是否一致(一般都是此问题导致),或者数据库的表结构非空等限制!