in Tech

Citrix NetScalers and the netscaler-tool

The netscaler-tool is a Python script that leverages the Citrix NetScaler Nitro API. If you need to easily discover when something goes wrong with either the NetScaler or its services, you can use netscaler-tool to integrate NetScaler statistics into your existing open source monitoring and alerting projects.

In most large-scale web companies, load balancers (such as the Citrix NetScaler) allow for server failure and traffic increases without any harm to services or the need to page anyone. Keep in mind that this is only true when capacity planning was done correctly, to allow for absorption in these types of events. Eventually, the dead servers will get fixed and/or more capacity will be added to tiers if they are running hot, but that can all be addressed at leisure.

Before the netscaler-tool, monitoring and managing of NetScalers might have consisted of using SSH with an empty passphrase for the private key, creation of a Linux system role user, and parsing output. Some maybe even utilized SNMP. But these are old methods that have been superseded by APIs. Why live in the past and make things harder than they should be?

The NetScaler offers a few management methods, including several APIs (SOAP and Nitro). The SOAP API seemed like an improvement over SSH, but usability was not trivial. Even if you figured out how to code around the API, you might need to generate new NSConfig.wsdl or NSStat.wsdl files from time to time, in order to add a new feature and/or decrease compilation time and program size. Luckily, the Nitro API is much more user-friendly, where messages are in JSON format and there is no need to tweak anything on the NetScaler.

Using the netscaler-tool, anyone can currently monitor/alert on:

  • Node failovers
  • SSL certificate expirations
  • Differences between running and saved configurations
  • Surge queuing on backend services
  • Critical events (e.g. Packet CPU increase, hardware failure)

Feature releases will also allow fetching any of the NetScaler node statistics, which include:

  • HTTP request/s
  • Inbound/outbound IP packets/s
  • Inbound/outbound throughput
  • Current client connections

Here are some statistics from one of our NetScaler pairs that would benefit from this future release. Note: these statistics are based on both internal and external traffic:

  1. HTTP requests/s: ~76k
  2. Inbound IP packets/s: ~990k
  3. Outbound IP packets/s: ~920k
  4. Outbound throughput: ~4.8Gb/s
  5. Inbound throughput: ~4.8Gb/s

Although the tool is currently geared toward fetching data from NetScalers, it can also change a few NetScaler objects; for example, services and load-balancing virtual servers. These abilities enable operators to gracefully stop and start tiered services without affecting clients. One use case could be new web releases. Assuming orchestration code has already been written for code deployment and bouncing of web servers, one could leverage the tool to:

→ disable a web service with a delay to give clients enough time to complete their current request,

→ stop the web server,

→ start the web server,

→ make another call to the tool to enable the service,

→ and then move onto the next web server.

If, for whatever reason, you decide to write your own tool instead of using the netscaler-tool, and don’t want to deal with the Nitro API, you can use the included netscalerapi module.

For more information and source code, see the <a href=”https://github.com/tagged/netscaler-tool”>Github</a> repository.

Using netscaler-tool, we’re able to submit data to Graphite and manipulate NetScaler performance statistics to build better monitoring and alerting.

The netscaler-tool allows us to keep tabs on the largest traffic generators that impact our backend and frontend services.

Alex Kaplan contributed to this post.

Brian Glogower

Brian Glogower is a senior systems administrator on the site operations team at Tagged

More Posts

GraphLab Conference 2014

This year, my colleague Shobeir and I attended the GraphLab Conference to learn more about GraphLab and data science in general. The event began with a really great introduction by Carlos Guestrin, which illustrated GraphLab’s strategy, vision and practices. After this we attended a few more high-level talks about GraphLab before delving into sessions specifically around data science, data engineering and deployment.

The GraphLab team introduced many exciting new features for GraphLab Create since its last release, including gradient-boosted trees for regression and classifications, deployment capabilities, hyper-parameter tuning, higher capacity SFrames, access to latent factors of matrix factorization methods and much more.
Continue Reading

Lester Kakol

Lester Kakol is a Data Engineer II on the relevance team at Tagged.

More Posts

Follow Me:
Twitter

Takeaways from Google I/O 2014

Like many others, I was excited that this year’s Google I/O tickets would be distributed on a lottery basis. Also like many others, I was not lucky enough to win one of the lottery tickets.

So when I heard that Women Who Code had discounted tickets for women in tech, I signed up immediately. Apparently Google made a big effort this year to get more women to participate in the conference, and as a result the number of women attendees rose from 7 percent last year to 20 percent this year!
Continue Reading

Caren Chang

Caren Chang is a Software Engineer I on the QA Team at Tagged.

More Posts - Website

Follow Me:
GitHub

Lessons from php[tek] 2014

I recently had the opportunity to attend php[tek] 2014 in Chicago. As Tagged is a site primarily powered by PHP, it was a good opportunity to learn about upcoming features in unreleased versions of PHP, some of the newer features that are underutilized and not as well known, and just how far the language of PHP has evolved since it was released many many years ago.

Continue Reading

Nick Moore

Nick Moore is a Senior Software Engineer I on the web team at Tagged.

More Posts

Follow Me:
GitHub

Interface Design Bootcamp at Smashing Conference

As an engineer, learning about everything that goes into designing a product is a fascinating lesson for me. In the Interface Design Bootcamp at Smashing Conference, Aarron Walter walked through the steps he takes to go from idea to production.

His analogy to describe the process was the game of golf: start with strong, broad strokes, then use smaller strokes to get to the final point. The five steps he outlined, in increasing levels of granularity, were 1) research, 2) flow, 3) interaction, 4) personality and 5) aesthetics.
Continue Reading

bcook@tagged.com'

Barrett Cook

Barrett Cook is an engineering manager on the web team at Tagged.

More Posts

Follow Me:
Twitter