Anyone who mines their IT data knows that it can be a cumbersome and daunting task. Splunk puts it this way:
- A single server can generate more than 100MB of logging data a day.
- A data center can generate more than a terabyte of logging data a day.
- A typical enterprise application has 25 to 40 logical sources of data.
- 30-70% of an IT person’s day is spent looking through log files and other types of IT data.
- 1 of 10 reported incidents gets escalated for group analysis by a team of four or more people.
Splunk has built the first (that I know of) search engine for IT data. You can search by keyword and you can view it by time. That’s a great idea. Now, when you run into an issue at 1:00 AM on a Tuesday, you can view for what’s going wrong around that time. Splunk includes powerful AJAX features that make it rich. You can sort by event, event type, tags, source types, hosts, and sources.
You can try out the demo online or download the server for free. It runs on any *nix platform. I would be interested to hear from people who are using this.
[tags]Splunk, data mining, log software, event log search engine, searching event logs[/tags]
Interesting statistics. Seems like a great program for those IT guys:)