Web Server Load Balancing with NGINX Plus

NGINX Amplify is a tool for monitoring NGINX and alerting you to misconfiguration so you can analyze and take control of your applications

This post is adapted from a webinar by Faisal Memon and Nick Shadrin. This post covers the first part of the webinar, an overview of the features and capabilities of NGINX Amplify. To see the second part, a live demo, watch the complete webinar on demand (the demo begins at 13:20).

Also check out the many other posts about NGINX Amplify on the blog.

Table of Contents

0:00 Introduction
0:39 About NGINX and NGINX Plus
2:04 Why Visibility Matters
3:48 NGINX Amplify Monitors NGINX in Real Time, Analyzes Configuration, and Sends Alerts
5:54 The NGINX Amplify Agent and UI
7:07 NGINX Amplify Is in Free Public Beta
8:40 NGINX Amplify Recommends Configuration Improvements
10:12 Detailed Metrics for Monitoring NGINX
11:55 NGINX Amplify Sends Customized Alerts

0:00 Introduction

Webinar presenters Faisal Memon and Nick Shadrin work for NGINX, Inc. and in this webinar explain how to monitor NGINX

Faisal: Today we’ll be talking about NGINX Amplify, our new tool for monitoring NGINX.

My name is Faisal Memon and I do product marketing here at NGINX. I’ve been doing this job for about a year now, and prior to this role I worked as a technical marketing engineer at Riverbed. Prior to that I spent about eight years at Cisco writing software.

Here with me today is Nick Shadrin and he’ll be on later on to do a live demo.

00:39 About NGINX and NGINX Plus

NGINX Open Source was first released in 2004 and now powers 200 million websites; NGINX, Inc. was founded in 2011 to commercialize NGINX Plus and now has 800 customers

Both Nick and I work for NGINX, the company behind the popular open source web server, load balancer, content cache and just all‑around great multipurpose tool that today is used by more than 400 million websites worldwide. NGINX has seen tremendous growth over the last few years. In the past year alone it has grown 37% in usage as a web server.

NGINX was originally created by Igor Sysoev back in the late 1990s/early 2000s to handle the onslaught of new users that he and other website owners were experiencing as the Internet became much more mainstream during that timeframe. The late 1990s/early 2000s is the time when my parents first went online, and I think the time that many people first really discovered the Internet and first really started using it on a day‑to‑day basis.

The company NGINX, Inc. was founded in 2011 by Igor and a few other colleagues. Since then, we have put out a commercial product, NGINX Plus, and we have secured over $40 million in total funding.

2:04 Why Visibility Matters

NGINX sits between clients and backend applications, the ideal vantage point for tracking application health and application performance in this example of how to monitor NGINX

I want you guys to imagine yourself in charge of a website that has crashed.

As the person responsible, you are under the gun. Customers are unhappy because they’re not able to get the functionality that they rely on. Management is unhappy because they’re losing money – they’re losing customers every single second that the website is down.

The only thing that can help you, in that crisis situation, is having visibility into your infrastructure and having ready access to data in a way that you can easily consume. That’s why NGINX is one of the most critical components within the infrastructure of a lot of organizations today.

You can see in this diagram of a microservices‑based architecture, the microservices as well as the clients are all connected to NGINX.

This unique vantage point means NGINX sees all traffic going in and out of the application. This allows for a lot of insights on application health as well as application performance.

There are a lot of monitoring tools out there that organizations are using, and a lot of organizations are using multiple monitoring tools. We think that NGINX Amplify is a nice complement to that, providing additional functionality and additional visibility that you might not get with those tools.

3:48 NGINX Amplify Monitors NGINX in Real Time, Analyzes Configuration, and Sends Alerts

NGINX Amplify provides realtime monitoring of NGINX, customizable dashboards, configuration analysis, and alerting

This is a screenshot of NGINX Amplify. You can see it provides interesting functionality and useful features that I think help not just with debugging applications when they’re down, but also with day‑to‑day monitoring of performance and health as well.

NGINX Amplify provides real‑time monitoring of all NGINX instances. That lets you view metrics from every NGINX server or server instance that you have deployed within your organization and within your infrastructure, all under a single pane of glass.

You can monitor NGINX performance in terms of requests per second and various other metrics, as well as errors that NGINX has seen coming from the backend application service.

You can create customizable dashboards with NGINX Amplify, so you can combine all the metrics that are important to you, and to your organization and to your job, and put them all on a single page for easy access. For example, if your website is down, you can have all your errors on one page to let you easily get to that.

NGINX Amplify also performs static configuration analysis. This is where NGINX Amplify monitors NGINX, analyzes the configuration – searching for potential gaps in terms of performance, security, and reliability – and then makes recommendations to improve and fill in those gaps.

Finally, NGINX Amplify provides alerting. So, it can alert you, for example, if you’re seeing a high volume of 404 errors or 500‑series errors. NGINX Amplify, at that point, can send you an alert.

5:54 NGINX The NGINX Amplify Agent and UI

The NGINX Amplify agent is a Python program installed alongside NGINX; the frontend is built on React.js and Node.js and talks to the proprietary core API; everything is hosted on AWS in this example of how to monitor NGINX with Amplify

NGINX Amplify is a highly scalable service built on modern components. It works by way of a small Python‑based agent that you install alongside NGINX. That can be on a bare metal server, or that can be within a container, however you have NGINX deployed. You install the agent alongside it.

The agent itself is fully open source and is available on the NGINX, Inc. GitHub site. The agent feeds into a receiver which collects all the data and then stores it into a database, and that’s how the backend of the data collection works.

On the frontend, our UI is composed of React.js and Node.js, and it talks to a proprietary core API which pulls the data from the database that was populated by the agent.

Our infrastructure is hosted entirely on AWS.

7:07 NGINX Amplify Is in Free Public Beta

NGINX Amplify is in a free public beta; you can sign up at after learning how to monitor NGINX with NGINX Amplify

How much does NGINX Amplify cost? Right now, it’s free. We are currently in a free public beta of NGINX Amplify and we are making it available to all users of open source NGINX as well as our commercial NGINX Plus customers.

NGINX Amplify is something that we have been working on internally for a very long time and we are thrilled that we were able to announce it last September at our annual user conference, nginx.conf 2015.

From that time until last month, NGINX Amplify was in private beta.

During the private beta, the users who tried it out really liked it. They were able to instantly and immediately gain value from it and use it to solve immediate issues that they were having.

Seeing this valuable feedback from those who tried it out early gave us the confidence to release NGINX Amplify as a public beta last month. Now it’s at a point where we are encouraging all users to try it.

It’s extremely easy to get started monitoring NGINX with NGINX Amplify. It only takes 5 minutes, really, to get started. Just check a few things, then install the agent on your servers. Once that’s installed, you’ll start to see metrics populate within a few minutes.

8:40 NGINX Amplify Recommends Configuration Improvements

NGINX Amplify not only monitors NGINX in real time, it analyzes your configuration and recommends change to improve performance, security, and reliability

Let’s dive a little bit more into the features of NGINX Amplify.

As I mentioned earlier, NGINX Amplify does static analysis of your configuration as well as monitoring NGINX in realtime. As you can see on the screenshot, it provides a nice, very detailed analysis and gives recommendations. It gives you a detailed description of the problem as NGINX Amplify sees it, as well as a line number in the configuration to go and look at.

In this particular case, NGINX Amplify is pointing out that the default_server parameter to the listen directive is not set, which is something that’s very easy to skip over during your development, but something that can cause problems later on.

If that default_server parameter is not included and NGINX gets a request for a server that is not configured, it will just take the first server configuration file – which may or may not be what you want – and so having that parameter set is really good for predictability.

While monitoring NGINX, NGINX Amplify also provides recommendations around performance. If you are, for example, disabling buffering or doing other things that might impact performance, it will point that out along with what you may have intended to do.

It also provides security recommendations. For example, if you’ve opened up your metrics to the general internet, NGINX Amplify will catch that and point it out.

10:12 Detailed Metrics for Monitoring NGINX

While monitoring NGINX, NGINX Amplify collects dozens of metrics and displays them on its dashboard

As we mentioned earlier, NGINX Amplify collects metrics from all of your NGINX instances and provides it to you within a graphical dashboard.

Those metrics can be aggregated. You can see, for example, overall throughput, overall requests per second, or just in general, overall performance across your entire application. Or you can kind of drill down and see how each of your API endpoints are performing. You can also see graphs of errors, you can see graphs of 404 errors, you can see graphs of 500‑series errors.

So, you can really drill down and find out what’s really going on within your application from the point of view of NGINX.

You can build custom graphs in NGINX Amplify by filtering metrics, for example by user agent, client IP address, and data from log files

NGINX Amplify has a very powerful interface for designing graphs. In this particular instance, we are defining a graph to monitor particular API endpoints. You can see here a bunch of drop‑downs so you can, for example, filter that by user agent, filter that by the original IP address of the client, and a bunch of other data that is collected from NGINX, as well as from the log files that NGINX outputs. That means that NGINX Amplify is able to parse NGINX logs and pull out the data in those logs, and present that to you in a graphical format.

So, this is a very nice alternative to actually going in there and digging into the log files. Now, you can use NGINX Amplify to do that instead.

11:55 NGINX Amplify Sends Customized Alerts

NGINX Amplify alerts you to problems it finds while monitoring NGINX, according to thresholds you configure

NGINX Amplify also does alerting. So rather than polling and constantly checking the UI, it’s great to have something that alerts you when something is wrong. NGINX Amplify is able to do that.

You can see here on the screenshot that – if we are seeing, for example, a large number of 500‑series errors, over 200 within a 10‑minute time frame, NGINX Amplify will send a notification to the email specified.

And you can define metrics across all kinds of conditions. The other one that’s here is if your CPU is at 95% for more than 10 minutes, your server’s probably overwhelmed, maybe handling too much traffic, and NGINX Amplify will send you an alert.

After the initial alert that NGINX Amplify sends you, it will send a digest of active alerts on a 30‑minute basis so that you’re not constantly flooded in your inbox with alerts.

If an alert is not important to you, you can of course go to the UI and mute that alert.

That’s a very high‑level overview of how to monitor NGINX with NGINX Amplify.

This post is adapted from a webinar by Faisal Memon and Nick Shadrin. This post covers the first part of the webinar, an overview of the features and capabilities of NGINX Amplify. To see the second part, a live demo, watch the complete webinar on demand (the demo begins at 13:20).

Also check out the many other posts about NGINX Amplify on the blog.

Try out NGINX Amplify for yourself and let us know what you think – sign up for the free beta today.

Monitoring Highly Dynamic and Distributed Systems with NGINX Amplify

Cover image

Overcome challenges in collecting logs and metrics and acting on the results.


Faisal Memon



F5, Inc. 是备受欢迎的开源软件 NGINX 背后的商业公司。我们为现代应用的开发和交付提供一整套技术。我们的联合解决方案弥合了 NetOps 和 DevOps 之间的横沟,提供从代码到用户的多云应用服务。访问 了解更多相关信息。