Logs are everywhere: application logs, database logs, server logs, event logs. Managing the volume of logs, and even more important, using the data effectively, can be extremely difficult.

At this month’s DevOps Chicago Meetup, I gave an introduction on how Belly uses Fluentd to deliver its user event logs to multiple sources for both batch and real-time processing.