E-MapReduce provides a set of universal interface to consume LogHub logs in real time by using Spark Streaming. For more information, see GitHub.