1.
1. redirect all spark log to file, which can be set by -Dbigdl.utils.LoggerFilter.logFile
the default file is under current workspace named bigdl.log
.
2. -Dbigdl.utils.LoggerFilter.disable=true
will disable redirection.
3. -Dbigdl.utils.LoggerFilter.enableSparkLog=false
will not output spark log to file
logger filter, which will filter the log of Spark(org, breeze, akka) to file.