首页 > 代码库 > 报错记录
报错记录
hadoop-root-datanode-f72e3728f11d.log
[code=csharp]
2017-05-19 03:52:54,753 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:9000 starting to offer service
2017-05-19 03:52:54,763 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2017-05-19 03:52:54,765 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 50020: starting
2017-05-19 03:52:55,204 INFO org.apache.hadoop.hdfs.server.common.Storage: Using 1 threads to upgrade data directories (dfs.datanode.parallel.volumes.load.threads.num=1, dataDirs=1)
2017-05-19 03:52:55,220 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /tmp/hadoop-root/dfs/data/in_use.lock acquired by nodename 3232@f72e3728f11d
2017-05-19 03:52:55,223 WARN org.apache.hadoop.hdfs.server.common.Storage: Failed to add storage directory [DISK]file:/tmp/hadoop-root/dfs/data/
java.io.IOException: Incompatible clusterIDs in /tmp/hadoop-root/dfs/data: namenode clusterID = CID-7f25bc20-e822-4b15-9063-4da48884cb60; datanode clusterID = CID-911d3bd8-bf2f-4cb7-8401-d470c89798e4
at org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:775)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadStorageDirectory(DataStorage.java:300)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadDataStorage(DataStorage.java:416)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:395)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:573)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1362)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1327)
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:317)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:223)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:802)
at java.lang.Thread.run(Thread.java:745)
2017-05-19 03:52:55,226 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:9000. Exiting.
java.io.IOException: All specified directories are failed to load.
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:574)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1362)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1327)
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:317)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:223)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:802)
at java.lang.Thread.run(Thread.java:745)
2017-05-19 03:52:55,227 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:9000
2017-05-19 03:52:55,232 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Removed Block pool <registering> (Datanode Uuid unassigned)
2017-05-19 03:52:57,232 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode
2017-05-19 03:52:57,233 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 0
2017-05-19 03:52:57,234 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
[/code]
hadoop-root-namenode-f72e3728f11d.log
[code=csharp]
p-root/dfs/name/current/edits_inprogress_0000000000000005535 -> /tmp/hadoop-root/dfs/name/current/edits_0000000000000005535-0000000000000005536
2017-05-21 01:43:53,830 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 5537
2017-05-21 01:44:53,881 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll Edit Log from 127.0.0.1
2017-05-21 01:44:53,881 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Rolling edit logs
2017-05-21 01:44:53,881 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Ending log segment 5537
2017-05-21 01:44:53,881 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of syncs: 2 SyncTimes(ms): 27
2017-05-21 01:44:53,885 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of syncs: 3 SyncTimes(ms): 31
2017-05-21 01:44:53,886 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Finalizing edits file /tmp/hadoop-root/dfs/name/current/edits_inprogress_0000000000000005537 -> /tmp/hadoop-root/dfs/name/current/edits_0000000000000005537-0000000000000005538
2017-05-21 01:44:53,886 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 5539
2017-05-21 01:45:53,931 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll Edit Log from 127.0.0.1
2017-05-21 01:45:53,931 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Rolling edit logs
2017-05-21 01:45:53,931 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Ending log segment 5539
2017-05-21 01:45:53,931 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 1 Number of transactions batched in Syncs: 0 Number of syncs: 2 SyncTimes(ms): 27
2017-05-21 01:45:53,934 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 1 Number of transactions batched in Syncs: 0 Number of syncs: 3 SyncTimes(ms): 30
2017-05-21 01:45:53,934 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Finalizing edits file /tmp/hadoop-root/dfs/name/current/edits_inprogress_0000000000000005539 -> /tmp/hadoop-root/dfs/name/current/edits_0000000000000005539-0000000000000005540
2017-05-21 01:45:53,935 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 5541
[/code]
hadoop-root-secondarynamenode-f72e3728f11d.log
[code=csharp]
2017-05-21 01:45:53,969 ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpoint
java.io.IOException: Inconsistent checkpoint fields.
LV = -63 namespaceID = 920772853 cTime = 0 ; clusterId = CID-7f25bc20-e822-4b15-9063-4da48884cb60 ; blockpoolId = BP-610225686-172.17.0.2-1495163265222.
Expecting respectively: -63; 260347945; 0; CID-911d3bd8-bf2f-4cb7-8401-d470c89798e4; BP-108388655-172.17.0.4-1495157412977.
at org.apache.hadoop.hdfs.server.namenode.CheckpointSignature.validateStorageInfo(CheckpointSignature.java:134)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:531)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:395)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$1.run(SecondaryNameNode.java:361)
at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:415)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:357)
at java.lang.Thread.run(Thread.java:745)
2017-05-21 01:46:54,020 ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpoint
java.io.IOException: Inconsistent checkpoint fields.
LV = -63 namespaceID = 920772853 cTime = 0 ; clusterId = CID-7f25bc20-e822-4b15-9063-4da48884cb60 ; blockpoolId = BP-610225686-172.17.0.2-1495163265222.
Expecting respectively: -63; 260347945; 0; CID-911d3bd8-bf2f-4cb7-8401-d470c89798e4; BP-108388655-172.17.0.4-1495157412977.
at org.apache.hadoop.hdfs.server.namenode.CheckpointSignature.validateStorageInfo(CheckpointSignature.java:134)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:531)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:395)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$1.run(SecondaryNameNode.java:361)
at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:415)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:357)
at java.lang.Thread.run(Thread.java:745)
2017-05-21 01:47:54,072 ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpoint
java.io.IOException: Inconsistent checkpoint fields.
LV = -63 namespaceID = 920772853 cTime = 0 ; clusterId = CID-7f25bc20-e822-4b15-9063-4da48884cb60 ; blockpoolId = BP-610225686-172.17.0.2-1495163265222.
Expecting respectively: -63; 260347945; 0; CID-911d3bd8-bf2f-4cb7-8401-d470c89798e4; BP-108388655-172.17.0.4-1495157412977.
at org.apache.hadoop.hdfs.server.namenode.CheckpointSignature.validateStorageInfo(CheckpointSignature.java:134)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:531)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:395)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$1.run(SecondaryNameNode.java:361)
at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:415)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:357)
at java.lang.Thread.run(Thread.java:745)
[/code]
yarn-root-nodemanager-f72e3728f11d.log
[code=csharp]
2017-05-19 03:53:09,381 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2017-05-19 03:53:09,381 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2017-05-19 03:53:09,390 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /node/*
2017-05-19 03:53:09,390 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
2017-05-19 03:53:09,923 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2017-05-19 03:53:09,927 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8042
2017-05-19 03:53:09,927 INFO org.mortbay.log: jetty-6.1.26
2017-05-19 03:53:09,958 INFO org.mortbay.log: Extract jar:file:/root/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar!/webapps/node to /tmp/Jetty_0_0_0_0_8042_node____19tj0x/webapp
2017-05-19 03:53:11,645 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042
2017-05-19 03:53:11,645 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app node started at 8042
2017-05-19 03:53:11,653 INFO org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8031
2017-05-19 03:53:11,682 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: []
2017-05-19 03:53:11,689 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[]
2017-05-19 03:53:11,924 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id 1923995252
2017-05-19 03:53:11,927 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id 1202604938
2017-05-19 03:53:11,927 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as f72e3728f11d:33073 with total resource of <memory:8192, vCores:8>
2017-05-19 03:53:11,927 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Notifying ContainerManager to unblock new container-requests
2017-05-20 03:53:07,184 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id 1923995253
2017-05-20 03:53:07,185 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id 1202604939
[/code]
yarn-root-resourcemanager-f72e3728f11d.log
[code=csharp]
2017-05-19 03:53:11,212 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2017-05-19 03:53:11,212 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8033: starting
2017-05-19 03:53:11,902 INFO org.apache.hadoop.yarn.util.RackResolver: Resolved f72e3728f11d to /default-rack
2017-05-19 03:53:11,904 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: NodeManager from node f72e3728f11d(cmPort: 33073 httpPort: 8042) registered with capability: <memory:8192, vCores:8>, assigned nodeId f72e3728f11d:33073
2017-05-19 03:53:11,908 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: f72e3728f11d:33073 Node Transitioned from NEW to RUNNING
2017-05-19 03:53:11,912 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added node f72e3728f11d:33073 clusterResource: <memory:8192, vCores:8>
2017-05-19 04:03:06,854 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Release request cache is cleaned up
2017-05-20 03:53:07,002 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Rolling master-key for amrm-tokens
2017-05-20 03:53:07,003 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken
2017-05-20 03:53:07,004 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens
2017-05-20 03:53:07,004 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Going to activate master-key with key-id 1923995253 in 900000ms
2017-05-20 03:53:07,004 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens
2017-05-20 03:53:07,004 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Going to activate master-key with key-id 1202604939 in 900000ms
2017-05-20 03:53:11,000 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2017-05-20 03:53:11,000 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 3
2017-05-20 03:53:11,001 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey.
2017-05-20 03:53:13,175 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2017-05-20 04:08:07,004 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Activating next master key with id: -1734027871
2017-05-20 04:08:07,005 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken
2017-05-20 04:08:07,005 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Activating next master key with id: 1923995253
2017-05-20 04:08:07,005 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Activating next master key with id: 1202604939
[/code]
报错记录