org.apache.hadoop.streaming
Class StreamUtil
java.lang.Object
org.apache.hadoop.streaming.StreamUtil
public class StreamUtil
- extends java.lang.Object
Utilities not available elsewhere in Hadoop.
Method Summary |
static java.lang.String |
collate(java.util.List args,
java.lang.String sep)
|
static java.lang.String |
collate(java.lang.Object[] args,
java.lang.String sep)
|
static java.lang.String |
dfmt(double d)
|
static java.lang.String |
findInClasspath(java.lang.String className)
|
static java.lang.String |
findInClasspath(java.lang.String className,
java.lang.ClassLoader loader)
|
static java.lang.String |
formatBytes(long numBytes)
|
static java.lang.String |
formatBytes2(long numBytes)
|
static java.lang.String |
getBoundAntProperty(java.lang.String name,
java.lang.String defaultVal)
|
static FileSplit |
getCurrentSplit(JobConf job)
|
static java.lang.String |
getSpace(int len)
|
static org.apache.hadoop.streaming.StreamUtil.TaskId |
getTaskInfo(JobConf job)
|
static java.lang.Class |
goodClassOrNull(Configuration conf,
java.lang.String className,
java.lang.String defaultPackage)
It may seem strange to silently switch behaviour when a String
is not a classname; the reason is simplified Usage: |
static java.lang.String |
ifmt(double d)
|
static boolean |
isCygwin()
|
static boolean |
isLocalJobTracker(JobConf job)
|
static java.lang.String |
ljustify(java.lang.String s,
int width)
|
static java.lang.String |
localizeBin(java.lang.String path)
|
static java.lang.String |
makeJavaCommand(java.lang.Class main,
java.lang.String[] argv)
|
static java.lang.String |
regexpEscape(java.lang.String plain)
|
static java.lang.String |
rjustify(java.lang.String s,
int width)
|
static java.lang.String |
safeGetCanonicalPath(java.io.File f)
|
static void |
touch(java.io.File file)
|
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
StreamUtil
public StreamUtil()
goodClassOrNull
public static java.lang.Class goodClassOrNull(Configuration conf,
java.lang.String className,
java.lang.String defaultPackage)
- It may seem strange to silently switch behaviour when a String
is not a classname; the reason is simplified Usage:
-mapper [classname | program ]
instead of the explicit Usage:
[-mapper program | -javamapper classname], -mapper and -javamapper are mutually exclusive.
(repeat for -reducer, -combiner)
findInClasspath
public static java.lang.String findInClasspath(java.lang.String className)
findInClasspath
public static java.lang.String findInClasspath(java.lang.String className,
java.lang.ClassLoader loader)
- Returns:
- a jar file path or a base directory or null if not found.
dfmt
public static java.lang.String dfmt(double d)
ifmt
public static java.lang.String ifmt(double d)
formatBytes
public static java.lang.String formatBytes(long numBytes)
formatBytes2
public static java.lang.String formatBytes2(long numBytes)
regexpEscape
public static java.lang.String regexpEscape(java.lang.String plain)
safeGetCanonicalPath
public static java.lang.String safeGetCanonicalPath(java.io.File f)
rjustify
public static java.lang.String rjustify(java.lang.String s,
int width)
ljustify
public static java.lang.String ljustify(java.lang.String s,
int width)
getSpace
public static java.lang.String getSpace(int len)
makeJavaCommand
public static java.lang.String makeJavaCommand(java.lang.Class main,
java.lang.String[] argv)
collate
public static java.lang.String collate(java.lang.Object[] args,
java.lang.String sep)
collate
public static java.lang.String collate(java.util.List args,
java.lang.String sep)
getCurrentSplit
public static FileSplit getCurrentSplit(JobConf job)
isLocalJobTracker
public static boolean isLocalJobTracker(JobConf job)
getTaskInfo
public static org.apache.hadoop.streaming.StreamUtil.TaskId getTaskInfo(JobConf job)
touch
public static void touch(java.io.File file)
throws java.io.IOException
- Throws:
java.io.IOException
isCygwin
public static boolean isCygwin()
localizeBin
public static java.lang.String localizeBin(java.lang.String path)
getBoundAntProperty
public static java.lang.String getBoundAntProperty(java.lang.String name,
java.lang.String defaultVal)
- Parameters:
name
- foo where <junit><sysproperty key="foo" value="${foo}"/>
If foo is undefined then Ant sets the unevaluated value.
Take this into account when setting defaultVal.
Copyright © 2009 The Apache Software Foundation