Kibana

RRDtool - About RRDtool What RRDtool does RRDtool is the OpenSource industry standard, high performance data logging and graphing system for time series data. RRDtool can be easily integrated in shell scripts, perl, python, ruby, lua or tcl applications. Shipping nginx access logs to LogStash — DevOps & Programming Note: this blog post is a bit outdated. Kibana is now part of Elasticsearch, and a pure JavaScript project, no longer dependent on Ruby. Additionally we now run Elasticsearch version 0.9.11 and LogStash 1.3.3. At Commando.io, we’ve always wanted a web interface to allow us to grep and filter through our nginx access logs in a friendly manner. After researching a bit, we decided to go with LogStash and use Kibana as the web front-end for ElasticSearch. LogsStash is a free and open source tool for managing events and logs.

How to set up Semantic Logging: part one with Logstash, Kibana, ElasticSearch and Puppet, Logging today is mostly done too unstructured; each application developer has his own syntax for the logs, optimized for his personal requirements and when it is time to deploy, ops consider themselves lucky if there is even some logging in the application, and even luckier if that logging can be used to find problems as they occur by being able to adjust verbosity where needed. I’ve come to the point where I want a really awesome piece of logging from the get-go – something I can pick up and install in a couple of minutes when I come to a new customer site without proper operations support. I want to be able to be able to search, drill down into, filter out patterns and have good tooling that allow me to let logging be an obvious support as the application is brought through its life cycle, from development to production. And I don’t want to write my own log parsers, thank you very much!

InfoSphere Streams Quick Start Edition Real -time analytic processing at your fingertips Stream processing technology gives you the ability to analyze massive data volumes quickly, often in real-time, and turn data into actionable insight. InfoSphere Streams is an advanced computing platform that can quickly ingest, analyze and correlate information as it arrives from thousands of real-time sources. Because it can handle high throughput rates, InfoSphere Streams can analyze millions of events per second, enabling sub-millisecond response times and instant decision-making. Now you can get your hands on this technology with InfoSphere Streams Quick Start Edition, a free, downloadable, non-production version.

Fathom Mobile Command Center Set alert thresholds for proactive notifications Integrated and comprehensive app performance alerting Why it matters: Be proactively identified about issues. Jeroen Reijn: Real-time visitor analysis with Couchbase, Elasticsearch and Kibana At Hippo we recently started using Couchbase as the storage solution for our targeting/relevance module. Couchbase is a really high performant NoSQL database, which since version 2.0 can be used as a (JSON) document database. Couchbase is really fast when it comes to simple CRUD operations, but does lack some search capabilities like Geo-spatial search (still 'experimental' mode) and free text search, which you might find in other document oriented NoSQL databases like MongoDB. However the lack of these search capabilities can be overcome quite easily by combining Couchbase with Elasticsearch by using the Couchbase-Elasticsearch transport plugin. The plugin uses the Couchbase built-in cross data center replication mechanism (XDCR), which can be used for replicating data between Couchbase clusters. It sort of makes Elasticsearch act just like another Couchbase cluster.

DirectCompute’s unpopularity - Blog - StreamComputing In the world of GPGPU we have currently 4 players: Khronos OpenCL, NVIDIA CUDA, Microsoft DirectCompute and PathScal ENZO. You probably know CUDA and OpenCL already (or start reading more articles from this blog). ENZO is a 64bit-compiler which serves a small niche-market, and DirectCompute is built on top of CUDA/OpenCL or at least uses the same drivers. Edit 2011-01-03: I was contacted by Pathscale about my conclusions about ENZO. The reason why not much is out there is that they’re still in closed alpha. Expect more to hear from them about ENZO somewhere in the coming 3 months.

App Infrastructure Startup Buddy.com Gets Into The Analytics Business Buddy.com today announced a mobile analytics service that’s supposed to give publishers and brands a better sense of who’s actually using their apps and how they’re using them. There’s plenty of competition on this front — Andreessen Horowitz-backed Mixpanel, for example, has increasingly become a mobile analytics company, and it makes a big deal out of not focusing on “bullshit metrics” like downloads. Buddy CEO and co-founder David McLauchlan was similarly dismissive of using downloads as a meaningful way to measure app engagement. “That’s analogous to figuring out TV ratings by looking at how many TVs they sell in Best Buy,” he said. McLauchlan argued that Buddy is in a unique position because it sits in the intersection between companies that offer backend tools for building apps and those that offer mobile analytics. So what can Buddy actually measure?

Build your own data-stream mining NSA in the cloud with “FunnelCake” There's more to "big data" than just lots of bits on disks. Some things you can't just store in the raw; others you need to analyze and process before they ever hit a disk. That way they can be acted upon in near-real time—like trying to pick specific communications sessions from the data stream of a network tap into an Internet backbone, for example. Stream processing, also known as Complex Event Processing, is the real-time querying, analysis, and conversion of information within torrents of live data. It's part of what deep packet inspection and packet capture systems do with network traffic. These tools apply a set of rules to filter out what to capture within Internet packets, then aggregate and transform what's in them into captured content and metadata about the content of those packets.

Localytics Adds Features To Complete The Picture For Mobile App Developers And Marketers Boston-based Localytics is fleshing out its mobile app analytics and marketing platform in a major way today with a variety of new features to help not just with customer acquisition, but also with monitoring and maintaining customer relationships over the lifetime of an app. The three big new areas Localytics now addresses with its platform are Lifetime Value Tracking, Customer Acquisition Management and Real-Time Funnel Management, all of which serve to help determine long-term engagement value. Localytics is introducing these new features based on the theory that most marketers spend all their time and money on the front end of the sales cycle, getting people to download the app, and then aren’t really concerned about whether that person will become a quality user over the long term.

7 A/B Testing Resources for Startups and Solo Developers This post originally appeared on Dyn.com, a world leader in managed DNS, powering the best brands on the web including Gowalla, Mashable, Twitter, Wikia and more. Follow @DynInc on Twitter. If you need a simple, inexpensive way to figure out what's going to make your website's users click on that big, red button, you've come to the right place. errbit.github.io/errbit/ The open source, self-hosted error catcher Errbit is a tool for collecting and managing errors from other applications. It is Airbrake (formerly known as Hoptoad) API compliant, so if you are already using Airbrake, you can just point the airbrake gem to your Errbit server. Errbit may be a good fit for you if: Your exceptions may contain sensitive data that you don't want sitting on someone else's serverYour application is behind a firewallYou'd like to brand your error catcherYou want to add customer features to your error catcherYou're crazy and love managing servers