首页 > 代码库 > mongodb读取测试

mongodb读取测试

1. there are a large amount of data in Hbase (row numer = 3849920), read all data from mongodb again and below is the log:

[azureuser@h3crd-wlan31 ~]$ kubectl logs histclientsdataetl-20161028141055-doize |grep @ETL@ @ETL@ getLatestOnlineTime: 2016-10-27 23:59:59.815 @ETL@ get uplineDate from hbase: 2016-10-27 23:59:59.815 @ETL@ getCurrentPosFromDB: 2016-10-27 23:59:59.815 @ETL@ Start finding at time: 2016-10-28 15:00:17.991, startFindDayIndex=17101 @ETL@ Finding finished at time: 2016-10-28 15:00:21.551 @ETL@ Wrting to Hbase has been finished ! @ETL@readCount: 3849920,putCount: 0,time: 2016-10-28 15:11:48.784 @ETL@ child file name: 1.1.1.1-histclientsdataetl @ETL@ Change logfile name has finished: 2016-10-28 15:11:48.792 @ETL@ cmd: sh /home/mongo-hive-hbase/Hive_HistClientsInfoAnalysis.sh @ETL@: exec has finished! @ETL@ new Executing remote hive shell has finished: 2016-10-28 15:12:49.273 @ETL@ result:

 

mongodb读取测试