Monitoring Docker and a Mongodb Cluster: Part I

Selection_516

Docker has been around for roughly a year,  it was open-sourced by the guys at dotCloud ( the PAAS provider)  and has since caused a revolution in the devops community. It has the backing of industry heavy weights such as Google, Rackspace and Redhat . In this blog post, I will attempt to give an initial look at monitoring docker, with a specific focus on system health. The technology stack under Docker is a large topic so I will not be going into much detail on setting up a docker environment. Before we dig right in let’s find out a bit about docker.

Continue reading

Realtime WebSocket streaming from the cloud to you: Part II

webSocket-AWS-Running

I’ve got the ‘green-light’ and an IP allocated.

In Part 1 I built a Groovy WebSocket
Server  and a Java and HTML Client. In Part 2 I’ll deploy it into AWS, fire up the Clients and add the Github link. With WebSocket Clients, I can run Logscape in the ‘wild’ and make use of the Alert-Feed WebSocket functionality to stream data to my local servers.

AWS Deployment: Before running on the AWS server I need to find the right AMI – one with Java installed. The OpenJDK is installed on most Linux flavours, and I prefer to work with Ubuntu. In the following grab you can see where I’ve fired up the AMI instance.

Continue reading

Realtime WebSocket streaming from the cloud to you: Part I

This is a 2 part post where iwebSocketClientn Part 1 I build the ‘spike’ using Groovy to run a WebSocketServer to stream data to HTML5-WebSocket & JavaWebSocket Clients. The HTML Client uses the elegant smoothie charts (great for streaming). In Part 2 Ill show you how to run it on Amazons AWS.
At the end we have a real-time feed plotting the data from the cloud; it looks something like the grab on the right.

Unix Command Visualization and the 2 minute Analytics Workflow

In this blog post we are going to take a look at visualizing the output of unix commands in Logcape.  Many unix users are familiar with commands like top, free and vmstat and know how useful they can be in identifying system resourcing problems. One draw back with these commands is that it’s a stream of numbers ticking by and it is often easy to miss something.  We’ll take a look at how to visualize commands like vmstat in less than two minutes.

A  bit of background.

Memory, CPU , Network and Disk I/O are the metrics normally checked when the system is under heavy load.  There are many unix utilities out there that will give  report on the health of the operating system.  We’ll take a look at vmstat  since it covers all most of our bases when conducting an initial investigation.  When  we execute

vmstat 1 10000

we get back

Selection_503

We’ll explore the vmstat with different charts. How do we get the data into Logscape? Continue reading

Logscape 2.4 rolls out the door

Preamble:
A quick note to give everyone a heads-up that 2.4 is available for your viewing pleasure (pun intended). [release notes]

Notable things

  • Workspaces UI niceties

    We ran user labs to find out who stumbled where and on what. There are a long list of tweaks so I suggest you view the workspace video to see whats changed (link on the workspace page). A quick preview on Search Panel editing (video):
    neWorkspaceChartPopup

  • Continue reading