Log Level | Usages |
OFF | This is the most specific, which allows no logging at all |
FATAL | This is the most specific one that shows fatal errors with little data |
ERROR | This shows only the general errors |
WARN | This shows warnings that are recommended to be fixed but not mandatory |
INFO | This shows information required for your Spark job |
DEBUG | While debugging, those logs will be printed |
TRACE | This provides the least specific error trace with a lot of data |
ALL | Least specific message with all data |