hadoop - Unable to write file on HDFS -

-

i have installed hadoop-2.6.0 , checked hadoop daemons running. able create or copy directory in hdfs not able copy file hdfs.

command: 

bin/hadoop fs -copyfromlocal /home/130853/hadoop_data/abc /trial/abc

it's giving following exception:

exception in thread "main" java.lang.unsatisfiedlinkerror: org.apache.hadoop.util.nativecrc32.nativecomputechunkedsumsbytearray(ii[bi[biiljava/lang/string;jz)v     @ org.apache.hadoop.util.nativecrc32.nativecomputechunkedsumsbytearray(native method)     @ org.apache.hadoop.util.nativecrc32.calculatechunkedsumsbytearray(nativecrc32.java:86)     @ org.apache.hadoop.util.datachecksum.calculatechunkedsums(datachecksum.java:430)     @ org.apache.hadoop.fs.fsoutputsummer.writechecksumchunks(fsoutputsummer.java:202)     @ org.apache.hadoop.fs.fsoutputsummer.flushbuffer(fsoutputsummer.java:163)     @ org.apache.hadoop.fs.fsoutputsummer.flushbuffer(fsoutputsummer.java:144)     @ org.apache.hadoop.hdfs.dfsoutputstream.close(dfsoutputstream.java:2217)     @ org.apache.hadoop.fs.fsdataoutputstream$positioncache.close(fsdataoutputstream.java:72)     @ org.apache.hadoop.fs.fsdataoutputstream.close(fsdataoutputstream.java:106)     @ org.apache.hadoop.io.ioutils.copybytes(ioutils.java:54)     @ org.apache.hadoop.io.ioutils.copybytes(ioutils.java:112)     @ org.apache.hadoop.fs.shell.commandwithdestination$targetfilesystem.writestreamtofile(commandwithdestination.java:466)     @ org.apache.hadoop.fs.shell.commandwithdestination.copystreamtotarget(commandwithdestination.java:391)     @ org.apache.hadoop.fs.shell.commandwithdestination.copyfiletotarget(commandwithdestination.java:328)     @ org.apache.hadoop.fs.shell.commandwithdestination.processpath(commandwithdestination.java:263)     @ org.apache.hadoop.fs.shell.commandwithdestination.processpath(commandwithdestination.java:248)     @ org.apache.hadoop.fs.shell.command.processpaths(command.java:306)     @ org.apache.hadoop.fs.shell.command.processpathargument(command.java:278)     @ org.apache.hadoop.fs.shell.commandwithdestination.processpathargument(commandwithdestination.java:243)     @ org.apache.hadoop.fs.shell.command.processargument(command.java:260)     @ org.apache.hadoop.fs.shell.command.processarguments(command.java:244)     @ org.apache.hadoop.fs.shell.commandwithdestination.processarguments(commandwithdestination.java:220)     @ org.apache.hadoop.fs.shell.copycommands$put.processarguments(copycommands.java:267)     @ org.apache.hadoop.fs.shell.command.processrawarguments(command.java:190)     @ org.apache.hadoop.fs.shell.command.run(command.java:154)     @ org.apache.hadoop.fs.fsshell.run(fsshell.java:287)     @ org.apache.hadoop.util.toolrunner.run(toolrunner.java:70)     @ org.apache.hadoop.util.toolrunner.run(toolrunner.java:84)     @ org.apache.hadoop.fs.fsshell.main(fsshell.java:340)

can please on this?

what linux system ? 64bit or 32 bit ?

if it's 64bit , suggest recomplie hadoop source code in order support native lib .

if it's 32bit ,suggest switch 64bit system.

try execute command , hadoop checknative -a

enter image description here


Comments

Post a Comment

Popular posts from this blog

python - Healpy: From Data to Healpix map -

-
Image
i have data grid rows represent theta (0, pi) , columns represent phi (0, 2*pi) , f(theta,phi) density of dark matter @ location. wanted calculate power spectrum , have decided use healpy. what can not understand how format data healpy use. if provide code (in python obvious reasons) or point me tutorial, great! have tried hand @ doing following code: #grid dimensions nrows*ncols (subject change) theta = np.linspace(0, np.pi, num=grid.shape[0])[:, none] phi = np.linspace(0, 2*np.pi, num=grid.shape[1]) nside = 512 print "pixel area: %.2f square degrees" % hp.nside2pixarea(nside, degrees=true) pix = hp.ang2pix(nside, theta, phi) healpix_map = np.zeros(hp.nside2npix(nside), dtype=np.double) healpix_map[pix] = grid but, when try execute code power spectrum. specifically, : cl = hp.anafast(healpix_map[pix], lmax=1024) i error: typeerror: bad number of pixels if point me tutorial or edit code great. more specifications: data in 2d np array , can change numrows/...
Read more

c - Bitwise operation with (signed) enum value -

-
i using enumerator values flags: typedef enum { = 0x00, b = 0x01u, // u has no influence, expected c = 0x02u, // u has no influence, expected ... } enum_name; volatile unsigned char* reg = someaddress; *reg |= b; according misra-c:2004 bitwise operations shall not done signed type. unfortunately, compiler iar use signed int (or short or char) underlying type of enums, , option can find relates size, not signedness ("--enum-is-int"). according iar c/c++ development guide arm , pages 169 , 211, can define type of enum s if enable iar language extensions ( -e command-line option, or project > options > c/c++ compiler > language > allow iar extensions in ide). in particular, should define "sentinel" value, make sure compiler chooses correct type. prefers signed types, , uses smallest possible integer type, sentinel should largest positive integer corresponding unsigned integer type can describe. example, typedef enum ...
Read more

xslt - Unnest parent nodes by child node -

-
in xml there items 0-n attributes , item should copied each attribute new item 1 attribute. given xml this: <?xml version="1.0" encoding="utf-8" ?> <items> <item> <name>a</name> <attributes> <attribute> <key>attribute1</key> <value>1</value> </attribute> </attributes> </item> <item> <name>b</name> </item> <item> <name>c</name> <attributes> <attribute> <key>attribute1</key> <value>5</value> </attribute> <attribute> <key>attribute2</key> <value>2</value> </attribute> <attribute> <key>attri...
Read more