org.apache.hadoop.streaming
Class StreamUtil

java.lang.Object
  extended by org.apache.hadoop.streaming.StreamUtil

public class StreamUtil
extends java.lang.Object

Utilities not available elsewhere in Hadoop.


Constructor Summary
StreamUtil()
           
 
Method Summary
static java.lang.String collate(java.util.List args, java.lang.String sep)
           
static java.lang.String collate(java.lang.Object[] args, java.lang.String sep)
           
static java.lang.String dfmt(double d)
           
static java.lang.String findInClasspath(java.lang.String className)
           
static java.lang.String findInClasspath(java.lang.String className, java.lang.ClassLoader loader)
           
static java.lang.String formatBytes(long numBytes)
           
static java.lang.String formatBytes2(long numBytes)
           
static java.lang.String getBoundAntProperty(java.lang.String name, java.lang.String defaultVal)
           
static FileSplit getCurrentSplit(JobConf job)
           
static java.lang.String getSpace(int len)
           
static org.apache.hadoop.streaming.StreamUtil.TaskId getTaskInfo(JobConf job)
           
static java.lang.Class goodClassOrNull(Configuration conf, java.lang.String className, java.lang.String defaultPackage)
          It may seem strange to silently switch behaviour when a String is not a classname; the reason is simplified Usage:
static java.lang.String ifmt(double d)
           
static boolean isCygwin()
           
static boolean isLocalJobTracker(JobConf job)
           
static java.lang.String ljustify(java.lang.String s, int width)
           
static java.lang.String localizeBin(java.lang.String path)
           
static java.lang.String makeJavaCommand(java.lang.Class main, java.lang.String[] argv)
           
static java.lang.String regexpEscape(java.lang.String plain)
           
static java.lang.String rjustify(java.lang.String s, int width)
           
static java.lang.String safeGetCanonicalPath(java.io.File f)
           
static void touch(java.io.File file)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

StreamUtil

public StreamUtil()
Method Detail

goodClassOrNull

public static java.lang.Class goodClassOrNull(Configuration conf,
                                              java.lang.String className,
                                              java.lang.String defaultPackage)
It may seem strange to silently switch behaviour when a String is not a classname; the reason is simplified Usage:
 -mapper [classname | program ]
 instead of the explicit Usage:
 [-mapper program | -javamapper classname], -mapper and -javamapper are mutually exclusive.
 (repeat for -reducer, -combiner) 


findInClasspath

public static java.lang.String findInClasspath(java.lang.String className)

findInClasspath

public static java.lang.String findInClasspath(java.lang.String className,
                                               java.lang.ClassLoader loader)
Returns:
a jar file path or a base directory or null if not found.

dfmt

public static java.lang.String dfmt(double d)

ifmt

public static java.lang.String ifmt(double d)

formatBytes

public static java.lang.String formatBytes(long numBytes)

formatBytes2

public static java.lang.String formatBytes2(long numBytes)

regexpEscape

public static java.lang.String regexpEscape(java.lang.String plain)

safeGetCanonicalPath

public static java.lang.String safeGetCanonicalPath(java.io.File f)

rjustify

public static java.lang.String rjustify(java.lang.String s,
                                        int width)

ljustify

public static java.lang.String ljustify(java.lang.String s,
                                        int width)

getSpace

public static java.lang.String getSpace(int len)

makeJavaCommand

public static java.lang.String makeJavaCommand(java.lang.Class main,
                                               java.lang.String[] argv)

collate

public static java.lang.String collate(java.lang.Object[] args,
                                       java.lang.String sep)

collate

public static java.lang.String collate(java.util.List args,
                                       java.lang.String sep)

getCurrentSplit

public static FileSplit getCurrentSplit(JobConf job)

isLocalJobTracker

public static boolean isLocalJobTracker(JobConf job)

getTaskInfo

public static org.apache.hadoop.streaming.StreamUtil.TaskId getTaskInfo(JobConf job)

touch

public static void touch(java.io.File file)
                  throws java.io.IOException
Throws:
java.io.IOException

isCygwin

public static boolean isCygwin()

localizeBin

public static java.lang.String localizeBin(java.lang.String path)

getBoundAntProperty

public static java.lang.String getBoundAntProperty(java.lang.String name,
                                                   java.lang.String defaultVal)
Parameters:
name - foo where <junit><sysproperty key="foo" value="${foo}"/> If foo is undefined then Ant sets the unevaluated value. Take this into account when setting defaultVal.


Copyright © 2009 The Apache Software Foundation