background preloader

Logstash - open source log management

Logstash - open source log management

http://www.elastic.co/products/logstash

.htaccess snippets to optimize your website All of the snippets below have to be pasted into your .htaccess file, which is located on the root of your Apache server. Waring: Always make sure you have a working backup before editing your .htaccess file! Force trailing slash Many clients of mine asked me for always having a trailing slash at the end of their urls. Looks like it’s great for SEO. olamy open source hacker In the 7.x releases of Apache Tomcat, some maven artifacts are now published which include a nice and fluent embeded api to run a Tomcat instance. So it's a nice opportunity to use it writing units to test servlets, rest api etc..But until 7.0.25 it was only possible to do it with using a barcoding port which can cause some issues on ci servers where you are not sure ports are not used by something else running. I have personally sended a RFC to ITEF to have port allocation for only my personal use on my birthday year or zip code port but strangely this RFC was never approved :-). Now you can use the java ServerSocket port 0 feature to use any free port available on the machine. It has been fixed with the issue 52028. So now you can write a unit test as it (here a test with a REST service provided by Apache CXF).

Heka: Data Collection and Processing Made Easy Data Collection and Processing Made Easy Data Data Everywhere Application servers generate many different types of data: Ops Needs their own TDD: Test -Driven Infrastructure The recently published book "Test-Driven Infrastructure with Chef" is not a proscriptive book as far as tooling, despite having "Chef" in the title. John Arundel a sysadmin and architect just gave an awesome, to-the-point review of the book, which is that even though there's a debate raging over which is better, Puppet or Chef, there's one thing that most people agree on: Operations needs their own TDD. If services are provisioned by programs, then we can - and should - test those programs.

Quick Setup - Persona Adding the Persona login system to your site takes just five steps: Include the Persona JavaScript library on your pages. Add “login” and “logout” buttons. Watch for login and logout actions. A Whole Lot of Heka – Kartar.Net As most people know I am a logging fanboi. I’ve been endlessly fascinated with logs and log management. Last year I even took that a step too far and wrote a book about Logstash. Consequently, I am always looking at new logging tools, tricks and techniques. One of those popped up a while ago: Heka. When I saw Heka last year I made a note to look at it more closely.

Measure Anything, Measure Everything Measure Anything, Measure Everything Posted by Ian Malpass | Filed under data, engineering, infrastructure If Engineering at Etsy has a religion, it’s the Church of Graphs. If it moves, we track it. Sometimes we’ll draw a graph of something that isn’t moving yet, just in case it decides to make a run for it. In general, we tend to measure at three levels: network, machine, and application. Yammer Metrics, A new way to monitor your application When you are running long term applications like web applications, it is good to know some statistics about them, like number of requests served, request durations, or the number active requests. But also some more generic information like the state of your internal collections, how many times some portion of code is being executed, or health checks like database availability, or any kind of connection to an external system. All this kind of instrumentalization can be achieved by using native JMX or using a modular project like Metrics. Metrics provides a powerful way to measure the behaviour of your critical components and reporting them to a variety of systems like, JConsole, System Console, Ganglia, Graphite, CSV, or making them available through a web server.

How To Install Elasticsearch, Logstash, and Kibana 4 on Ubuntu 14.04 Introduction In this tutorial, we will go over the installation of the Elasticsearch ELK Stack on Ubuntu 14.04—that is, Elasticsearch 1.4.4, Logstash 1.5.0, and Kibana 4. We will also show you how to configure it to gather and visualize the syslogs of your systems in a centralized location. Logstash is an open source tool for collecting, parsing, and storing logs for future use.

Related: