hadoop - localhost: ERROR: Cannot set priority of datanode process 32156 - Stack Overflow
Join Stack Overflow to learn, share knowledge, and build your career.
or sign in with
I am trying to install hadoop on ubuntu 16.04 but while starting the hadoop it will give me following error
localhost: ERROR: Cannot set priority of datanode process 32156.
Starting secondary namenodes [it-OptiPlex-3020]
21:13:48,343 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting resourcemanager
Starting nodemanagers
Please someone tell me why i am getting this error ? Thanks in advance.
I have the same error when installing Hadoop 3.0.0-RC0.
My situation is all services starting successfully except Datanode.
I found that some configs in hadoop-env.sh weren't correct in version 3.0.0-RC0, but correct in version 2.x.
Finally, I replace my hadoop-env.sh with the official one and just setting JAVA_HOME and HADOOP_HOME.
Now, Datanodes work well.
Your Answer
Sign up or
Sign up using Google
Sign up using Facebook
Post as a guest
Post as a guest
By posting your answer, you agree to the
Not the answer you're looking for?
Browse other questions tagged
Stack Overflow works best with JavaScript enabledbigdata - ocalhost: ERROR: Cannot set priority of resourcemanager process 9799 - Stack Overflow
Join Stack Overflow to learn, share knowledge, and build your career.
or sign in with
after using this command hdfs namenode -format.
localhost: ERROR: Cannot set priority of resourcemanager process 9799 similarly in case of datanode resourcemanager nodemanager.
not able to remove these errors
Know someone who can answer? Share a link to this
via , , , or .
Your Answer
Sign up or
Sign up using Google
Sign up using Facebook
Post as a guest
Post as a guest
By posting your answer, you agree to the
Browse other questions tagged
Stack Overflow works best with JavaScript enabled博客分类：
今早一来，突然发现使用-put命令往HDFS里传数据传不上去了，抱一大堆错误，然后我使用bin/hadoop dfsadmin
-report查看系统状态
admin@adw1:/home/admin/joe.wangh/hadoop-0.19.2&bin/hadoop dfsadmin
-reportConfigured Capacity: 0 (0 KB)Present Capacity: 0 (0 KB)DFS
Remaining: 0 (0 KB)DFS Used: 0 (0 KB)DFS Used%:
?%-------------------------------------------------Datanodes
available: 0 (0 total, 0 dead)
使用bin/stop-all.sh关闭HADOOP
admin@adw1:/home/admin/joe.wangh/hadoop-0.19.2&bin/stop-all.shstopping
jobtracker172.16.197.192: stopping tasktracker172.16.197.193: stopping
tasktrackerstopping namenode172.16.197.193:
no datanode to stop172.16.197.192: no datanode to stop
172.16.197.191: stopping secondarynamenode
哦，看到了吧，发现datanode前面并没有启动起来。去DATANODE上查看一下日志
admin@adw2:/home/admin/joe.wangh/hadoop-0.19.2/logs&vi
hadoop-admin-datanode-adw2.hst.ali.dw.alidc.net.log************************************************************/
10:12:11,987 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Incompatible namespaceIDs in
/home/admin/joe.wangh/hadoop/data/dfs.data.dir: namenode namespaceID =
; datanode namespaceID =
org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:233)
org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:148)
org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:288)
org.apache.hadoop.hdfs.server.datanode.DataNode.&init&(DataNode.java:206)
org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1239)
org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1194)
org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1202)
org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1324)......
错误提示namespaceIDs不一致。
下面给出两种解决办法，我使用的是第二种。
[if gte mso 9]&&xml&
&w:WordDocument&
&w:View&Normal&/w:View&
&w:Zoom&0&/w:Zoom&
&w:TrackMoves /&
&w:TrackFormatting /&
&w:PunctuationKerning /&
&w:DrawingGridVerticalSpacing&7.8 磅&/w:DrawingGridVerticalSpacing&
&w:DisplayHorizontalDrawingGridEvery&0&/w:DisplayHorizontalDrawingGridEvery&
&w:DisplayVerticalDrawingGridEvery&2&/w:DisplayVerticalDrawingGridEvery&
&w:ValidateAgainstSchemas /&
&w:SaveIfXMLInvalid&false&/w:SaveIfXMLInvalid&
&w:IgnoreMixedContent&false&/w:IgnoreMixedContent&
&w:AlwaysShowPlaceholderText&false&/w:AlwaysShowPlaceholderText&
&w:DoNotPromoteQF /&
&w:LidThemeOther&EN-US&/w:LidThemeOther&
&w:LidThemeAsian&ZH-CN&/w:LidThemeAsian&
&w:LidThemeComplexScript&X-NONE&/w:LidThemeComplexScript&
&w:Compatibility&
&w:SpaceForUL /&
&w:BalanceSingleByteDoubleByteWidth /&
&w:DoNotLeaveBackslashAlone /&
&w:ULTrailSpace /&
&w:DoNotExpandShiftReturn /&
&w:AdjustLineHeightInTable /&
&w:BreakWrappedTables /&
&w:SnapToGridInCell /&
&w:WrapTextWithPunct /&
&w:UseAsianBreakRules /&
&w:DontGrowAutofit /&
&w:SplitPgBreakAndParaMark /&
&w:DontVertAlignCellWithSp /&
&w:DontBreakConstrainedForcedTables /&
&w:DontVertAlignInTxbx /&
&w:Word11KerningPairs /&
&w:CachedColBalance /&
&w:UseFELayout /&
&/w:Compatibility&
&w:BrowserLevel&MicrosoftInternetExplorer4&/w:BrowserLevel&
&m:mathPr&
&m:mathFont m:val="Cambria Math" /&
&m:brkBin m:val="before" /&
&m:brkBinSub m:val="--" /&
&m:smallFrac m:val="off" /&
&m:dispDef /&
&m:lMargin m:val="0" /&
&m:rMargin m:val="0" /&
&m:defJc m:val="centerGroup" /&
&m:wrapIndent m:val="1440" /&
&m:intLim m:val="subSup" /&
&m:naryLim m:val="undOvr" /&
&/m:mathPr&&/w:WordDocument&
&/xml&&![endif]--&&!--
[if gte mso 9]&&xml&
&w:LatentStyles DefLockedState="false" DefUnhideWhenUsed="true"
DefSemiHidden="true" DefQFormat="false" DefPriority="99"
LatentStyleCount="267"&
&w:LsdException Locked="false" Priority="0" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Normal" /&
&w:LsdException Locked="false" Priority="9" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="heading 1" /&
&w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 2" /&
&w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 3" /&
&w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 4" /&
&w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 5" /&
&w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 6" /&
&w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 7" /&
&w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 8" /&
&w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 9" /&
&w:LsdException Locked="false" Priority="39" Name="toc 1" /&
&w:LsdException Locked="false" Priority="39" Name="toc 2" /&
&w:LsdException Locked="false" Priority="39" Name="toc 3" /&
&w:LsdException Locked="false" Priority="39" Name="toc 4" /&
&w:LsdException Locked="false" Priority="39" Name="toc 5" /&
&w:LsdException Locked="false" Priority="39" Name="toc 6" /&
&w:LsdException Locked="false" Priority="39" Name="toc 7" /&
&w:LsdException Locked="false" Priority="39" Name="toc 8" /&
&w:LsdException Locked="false" Priority="39" Name="toc 9" /&
&w:LsdException Locked="false" Priority="35" QFormat="true" Name="caption" /&
&w:LsdException Locked="false" Priority="10" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Title" /&
&w:LsdException Locked="false" Priority="1" Name="Default Paragraph Font" /&
&w:LsdException Locked="false" Priority="11" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Subtitle" /&
&w:LsdException Locked="false" Priority="22" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Strong" /&
&w:LsdException Locked="false" Priority="20" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Emphasis" /&
&w:LsdException Locked="false" Priority="59" SemiHidden="false"
UnhideWhenUsed="false" Name="Table Grid" /&
&w:LsdException Locked="false" UnhideWhenUsed="false" Name="Placeholder Text" /&
&w:LsdException Locked="false" Priority="1" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="No Spacing" /&
&w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading" /&
&w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List" /&
&w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid" /&
&w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1" /&
&w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2" /&
&w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1" /&
&w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2" /&
&w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1" /&
&w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2" /&
&w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3" /&
&w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List" /&
&w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading" /&
&w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List" /&
&w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid" /&
&w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 1" /&
&w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 1" /&
&w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 1" /&
&w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 1" /&
&w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 1" /&
&w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 1" /&
&w:LsdException Locked="false" UnhideWhenUsed="false" Name="Revision" /&
&w:LsdException Locked="false" Priority="34" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="List Paragraph" /&
&w:LsdException Locked="false" Priority="29" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Quote" /&
&w:LsdException Locked="false" Priority="30" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Intense Quote" /&
&w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 1" /&
&w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 1" /&
&w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 1" /&
&w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 1" /&
&w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 1" /&
&w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 1" /&
&w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 1" /&
&w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 1" /&
&w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 2" /&
&w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 2" /&
&w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 2" /&
&w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 2" /&
&w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 2" /&
&w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 2" /&
&w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 2" /&
&w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 2" /&
&w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 2" /&
&w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 2" /&
&w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 2" /&
&w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 2" /&
&w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 2" /&
&w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 2" /&
&w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 3" /&
&w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 3" /&
&w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 3" /&
&w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 3" /&
&w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 3" /&
&w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 3" /&
&w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 3" /&
&w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 3" /&
&w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 3" /&
&w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 3" /&
&w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 3" /&
&w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 3" /&
&w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 3" /&
&w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 3" /&
&w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 4" /&
&w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 4" /&
&w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 4" /&
&w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 4" /&
&w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 4" /&
&w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 4" /&
&w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 4" /&
&w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 4" /&
&w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 4" /&
&w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 4" /&
&w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 4" /&
&w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 4" /&
&w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 4" /&
&w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 4" /&
&w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 5" /&
&w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 5" /&
&w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 5" /&
&w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 5" /&
&w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 5" /&
&w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 5" /&
&w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 5" /&
&w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 5" /&
&w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 5" /&
&w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 5" /&
&w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 5" /&
&w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 5" /&
&w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 5" /&
&w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 5" /&
&w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 6" /&
&w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 6" /&
&w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 6" /&
&w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 6" /&
&w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 6" /&
&w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 6" /&
&w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 6" /&
&w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 6" /&
&w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 6" /&
&w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 6" /&
&w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 6" /&
&w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 6" /&
&w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 6" /&
&w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 6" /&
&w:LsdException Locked="false" Priority="19" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Subtle Emphasis" /&
&w:LsdException Locked="false" Priority="21" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Intense Emphasis" /&
&w:LsdException Locked="false" Priority="31" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Subtle Reference" /&
&w:LsdException Locked="false" Priority="32" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Intense Reference" /&
&w:LsdException Locked="false" Priority="33" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Book Title" /&
&w:LsdException Locked="false" Priority="37" Name="Bibliography" /&
&w:LsdException Locked="false" Priority="39" QFormat="true" Name="TOC Heading" /&
&/w:LatentStyles&
&/xml&&![endif]--&&!--
[if gte mso 10]&
&mce:style&&!--
/* Style Definitions */
table.MsoNormalTable
{mso-style-name:普通表格;
mso-tstyle-rowband-size:0;
mso-tstyle-colband-size:0;
mso-style-noshow:
mso-style-priority:99;
mso-style-qformat:
mso-style-parent:"";
mso-padding-alt:0cm 5.4pt 0cm 5.4
mso-para-margin:0
mso-para-margin-bottom:.0001
mso-pagination:widow-
font-size:10.5
mso-bidi-font-size:11.0
font-family:"Calibri","sans-serif";
mso-ascii-font-family:C
mso-ascii-theme-font:minor-
mso-hansi-font-family:C
mso-hansi-theme-font:minor-
mso-font-kerning:1.0}
--&&!-- [endif]--&
Workaround
1: Start from scratch
testify that the following steps solve this error, but the side effects won't
make you happy (me neither). The crude workaround I have found is to:
[if !supportLists]--&1.&!--
[endif]--&stop the
[if !supportLists]--&2.&!--
[endif]--&delete the
data directory on the problematic datanode: the directory is specified by
dfs.data.dir in conf/hdfs-site. if you followed this tutorial, the relevant
directory is /usr/local/hadoop-datastore/hadoop-hadoop/dfs/data
[if !supportLists]--&3.&!--
[endif]--&reformat the
namenode (NOTE: all HDFS data is lost during this process!)
[if !supportLists]--&4.&!--
[endif]--&restart the
deleting all the HDFS data and starting from scratch does not sound like a good
idea (it might be ok during the initial setup/testing), you might give the
second approach a try.
Workaround
2: Updating namespaceID of problematic datanodes
Big thanks
to Jared Stehler for the following suggestion. I have not tested it myself yet,
but feel free to try it out and send me your feedback. This workaround is
"minimally invasive" as you only have to edit one file on the problematic
datanodes:
[if !supportLists]--&1.&!--
[endif]--&stop the
[if !supportLists]--&2.&!--
[endif]--&edit the
value of namespaceID in &dfs.data.dir&/current/VERSION to match the value
of the current namenode
[if !supportLists]--&3.&!--
[endif]--&restart the
followed the instructions in my tutorials, the full path of the relevant file is
/usr/local/hadoop-datastore/hadoop-hadoop/dfs/data/current/VERSION (background:
dfs.data.dir is by default set to ${hadoop.tmp.dir}/dfs/data, and we set
hadoop.tmp.dir to /usr/local/hadoop-datastore/hadoop-hadoop).
wonder how the contents of VERSION look like, here's one of mine:
#contents of
&dfs.data.dir&/current/VERSION
namespaceID=
storageID=DS--10.10.10.1-6713481
storageType=DATA_NODE
layoutVersion=-13
原因:每次namenode
format会重新创建一个namenodeId,而tmp/dfs/data下包含了上次format下的id,namenode
format清空了namenode下的数据,但是没有晴空datanode下的数据,导致启动时失败,所要做的就是每次fotmat前,清空tmp一下的所有目录.
浏览: 49031 次
来自: 北京
(window.slotbydup=window.slotbydup || []).push({
id: '4773203',
container: s,
size: '200,200',
display: 'inlay-fix'}