Elasticsearch pricing

ElasticSearch Pricing

 

, ElasticSearch PricingThinking of using the ElasticSearch engine to increase your search efforts? ElasticSearch is suited to multiple use cases, offering rapid search across a variety of data types (including structured, unstructured, geo and metric), detailed indexing and scalable, in-depth analytics features whilst centrally storing your data.

Find out more about ElasticSearch

 

ElasticSearch Pricing: How much will ElasticSearch cost?

As with all software, both features and pricing are primary concerns when choosing a new product. Here we will discuss ElasticSearch, its features and what it will cost. 

ElasticSearch runs on a resource-based pricing model in which the cost of each subscription is calculated based on a number of components and with each component charged based on GB of Ram per hour. 

The cost of the subscription is based on the following:

  • Cloud provider
  • Cloud region
  • Elasticsearch nodes
  • Data nodes
  • High I/O
  • High storage
  • High CPU
  • High memory
  • Master node
  • Ingest node
  • Machine learning nodes
  • Kibana nodes
  • APM server
  • Instance size of each node (GB of RAM)
  • Number of availability zones

 

ElasticSearch provide a calculator tool in which you can work out an approximate cost of your desired plan


The amount of data in your system

Additional costs are also applied based on data storage and transfer. These costs are based on; Snapshot and Cloud Storage, Storage API requests and Data transfer – both in and out as well as between nodes. 

Some free allotment is included (up to 100GB per month) but additional charges are applied to the monthly billing automatically based on metered usage (in GB) over this limit. 

Does ElasticSearch store data long term?

When using ElasticSearch to store data, the data will be retained for as long as you need until you delete it. If you want to purge data from indices, you can easily manage this through using ElasticSearch’s Index Lifecycle Policies which will select indices that match your desired criteria (e.g how old they are or how much space it uses) and delete accordingly.

, ElasticSearch Pricing

ElasticSearch Packages

ElasticSearch is available in 4 different package options – all available on a monthly or annual basis. 

Each Elastic Cloud Managed Service option is catered to the user needs – with more premium packages offering more advanced features and functionality. The Managed Service Accounts can be deployed on; Google Cloud, Microsoft Azure and AWS.

The Standard, Gold and Platinum Packages also come with a 14 Day Free Trial option so users can try the product without committing to a paid account.

Here we will discuss the individual packages, their benefits and pricing. 

ElasticSearch Standard Package

Price: From $16 per month

The ElasticSearch Standard Package is the most basic package of the 4. A starting point for small projects, the package includes: 

  • Core Elastic Stack Security Features
  • Elastic APM
  • App Search
  • Workplace Search
  • Canvas & Lens
  • Analytics including Searches, Clicks and Insights

The package includes Base Layer maps and 10 Raster Tile Zoom Level but does not include Vector Tile Zoom.  

In terms of collaboration, the Standard package offers Multi-user collaboration and Signed Search Keys as well as User Management features including Organizational groups and Native User Management. 

The Standard Package offers basic support in the form of 2 Support contracts and ticket-based support but does not include support coverage.

There are limited Machine Learning features included in this option but there are File Import Wizard and Data Visualiser included in the package as well as language identification.

What isn’t included?

As with any basic package, there are some features not included in the Standard Package that you will find in more premium packages. These include; Single Sign-on, Attribute-Based Access Control, Field and Document-level security and Custom Authentication/Authorisation. The package also excludes Stack Monitoring  Configurable retention policy and some client options including JDBC, ODBC and Tableau Connector. Custom Plugins are also not included in the package so anyone looking for higher levels of customization may need to consider a more advanced option. 

ElasticSearch Gold Package

Price: From $19 

The Gold Package option is suited to more advances and larger projects and offers an improvement on the Standard Package due to the additional features and dedicated support included. 

Whilst including all of the features of the Standard Package, the Gold Package option means Business Hour Support, with critical support response being as little as 4 hours up to 2 days for level 3 support queries. The Gold Package also offers 6 Support Contacts for users.

This option offers higher levels of customisation through custom plugin integration. The integration of Atlassian Jira is also available with the Gold Package for users who require this. 

There is also the extra inclusion of a Configurable Retention Policy as well as Alerting features including Kibana Actions (Email, Pager Duty, ServiceNow, Slack and Webhook).

In terms of Search and Analysis features, the Gold Package offers the addition of GeoShape Aggregation as well as extra data visualization options in the form of PDF and PNG reports. 

Elastic Maps Service features include Level 18 Raster Tile Zoom Level and Level 14 Vector Tile Zoom Level. 

ElasticSearch Platinum Package

Pricing: From $22 per Month

The Platinum Package again encompasses everything included in the Gold package but benefits from advanced functionality, increased security, machine learning and round the clock support. 

Increased security features of this option include Simple Sign-On (SAML, OpenID Connect, Kerbernos) as well as Attribute-based access control, field and document level security and custom authentication/authorisation realms.

The Platinum Package includes all alerting features plus the addition of ServiceNow ITSM Integration as well as extra client options including JDBC and ODBC clients as well as Tableau Connector. There are also additional content sources available including Document Level Permission Support and Private Sources. 

Increased Support: Increased support from Elastic Stack included in the Platinum package includes 24/7/365 support with up to 8 support contacts as well as much more rapid response times (1 hour for critical queries and up to 1 day for level 3 queries). 

Enhanced Security and Collaboration: Added features for security and collaboration within the Platinum option include; Engine Scoping, Role-Based Access control, Engine Scoped API keys, SAML and Meta Engines. 

Machine Learning: Another standout of this more advanced package is the option of several additional  machine learning features including: 

  • Anomaly Detection and alerting, 
  • Outlier Detection
  • Regression
  • Classification
  • Log Message Categorization
  • Root Cause Indication
  • Forecasting on time series
  • Inference
  • Feature Importance
  • Model Snapshot Management

ElasticSearch Enterprise Package

Price: On-Demand (Available only through an annual subscription) 

The ElasticSearch Enterprise Package is advertised as the ‘fully loaded package’. This package includes everything included in the other package options plus default endpoint protection and access to Elastic Endgame as well as integration options with Elastic Security and Logtash.

The Endgame features add many more features to the package including Server features such as; Role-based access control, LDAP authentication, Single sign-on (SAML 2.0), Mutual authentication between the platform and endpoint, RESTful API, Policy-based management. 

The Endgame feature also offers benefits including; 

ElasticSearch subscription changes

ElasticSearch subscriptions can be upgraded or downgraded to correspond with user needs. Those on monthly subscriptions can alter their subscription through their billing page  – with upgrades becoming effective immediately and downgrades taking place at the next invoice date. Those on annual subscriptions can alter their subscription by contacting their sales representative. 

Thinking of using ElasticSearch for your business?

Mobilise Cloud can work with you to design and build a bespoke ElasticSearch package to suit your needs.
For more information Contact Us. 

Sours: https://www.mobilise.cloud/elasticsearch-pricing/

Elastic Pricing FAQ

Frequently asked questions

Can I try Elastic products and services for free?

Elastic Cloud: Yes. We offer a free 14-day trial of Elastic Cloud that starts the moment you create a cluster. It's simple to get up and running and includes a cluster with 8GB of RAM and 240GB of storage across our supported cloud providers.

Elasticsearch Service on Elastic Cloud is available on Amazon Web Services (AWS), AWS GovCloud (US), Microsoft Azure, and Google Cloud. The official Elasticsearch Service gives you access to:

  • Elastic solutions for enterprise search, observability, and security
  • Exclusive features such as cross-cluster search, machine learning, and index lifecycle management
  • Intuitive and creative visualization tools like Kibana Lens and Canvas

Just select the cloud provider of your choice for your deployment and you're on your way to simple management and powerful customization.

Self-Managed: Yes. From the very beginning, the Elastic Stack — Elasticsearch, Kibana, Beats, and Logstash — has been free and open. Our approach is not only to make our technology stack available for free, but to make it open — housed in public repositories and developed through a transparent approach with direct involvement from the community.

You can download Elastic software and get access to both the OSS features as well as the free Basic features of our software at no cost. Free and open principles are ingrained into who we are and how we progress. We want our products to be used to learn, to develop, and to be run in production at scale. And that’s why many of our core features, products, and solutions are free, including free security features developed natively in the stack that are critical to ensure that every cluster is protected. But we go far beyond that, providing role-based access control and true multitenancy for Kibana, all for free. We believe that products developed in the open are more secure.

If you are interested in trying out features in the Gold, Platinum, or Enterprise subscription tiers, consider a free 14-day trial of Elastic Cloud or contact us.

Yes. Elastic Cloud Standard, Gold, Platinum, Enterprise, and Private subscriptions include varying levels of support for our Elasticsearch Service. See the Support section in the comparison table on the pricing page.

For self-managed customers, Gold, Platinum, and Enterprise subscriptions include varying levels of support for the Elastic Stack. See the Support section in the comparison table on the pricing page.

Can I change my subscription level once I start using a paid Elastic subscription tier?

If you purchased an Elasticsearch Service monthly subscription, you can change your subscription level at any time from the Billing page in the Elastic Cloud console. Any upgrade to a higher subscription level (e.g. from Standard to Platinum) takes place immediately. Any downgrade to a lower subscription level takes place at the next invoice date. If you purchased an annual subscription, get in touch with your sales representative to change your subscription level.

For self-managed subscriptions, get in touch with your sales representative to change your subscription level.


Elastic Cloud Specific Questions

How is pricing for Elasticsearch Service on Elastic Cloud calculated?

Pricing for Elasticsearch Service is primarily based on the instance size of each component of the Elastic Stack, such as Elasticsearch nodes, Kibana nodes, APM server, etc. Each component that is running is charged per GB of RAM/hour. You can estimate your costs using our pricing calculator. This rate is based on the following dimensions:

  • Cloud provider
  • Cloud region
  • Elasticsearch nodes
    • Data nodes
      • High I/O
      • High storage
      • High CPU
      • High memory
    • Master nodes
    • Ingest nodes
    • Machine learning nodes
  • Kibana nodes
  • APM server
  • Instance size of each node (GB of RAM)
  • Number of availability zones

Additionally, snapshot storage costs and data transfer costs also apply:

  • Snapshot storage
    • Cloud storage costs
    • Storage API requests
  • Data transfer costs
    • Data transfer in
    • Data transfer out
    • Data transfer between nodes

How do I purchase Elasticsearch Service on Elastic Cloud?

There are a few ways to purchase Elasticsearch Service. The best place to start is with a free 14-day trial. Once you're ready to commit, we have several subscription options available:

  • Monthly subscription: At any time during the trial or when your trial expires, submit your credit card information to begin your monthly subscription. You can choose between Standard, Gold, Platinum, and Enterprise subscription levels.
  • Annual subscription: When your free trial expires, contact us to sign up for your annual term (and get a discount). You can also obtain a multiyear subscription to save even more. To learn more, please contact us.
  • Enterprise subscription: Please contact us.

You may also purchase Elasticsearch Service through the AWS Marketplace, Microsoft Azure Marketplace, and Google Cloud Marketplace. A minimal configuration can cost as low as $16 a month.

Is Elasticsearch Service on Elastic Cloud available for purchase via the AWS Marketplace?

Yes. The AWS Marketplace allows SaaS vendors like Elastic to bill customers directly through their AWS account, meaning you don’t have to set up a separate billing relationship with Elastic. Instead, existing AWS customers can subscribe to Elastic Cloud through our AWS Marketplace listing page. Simply click “Continue to Subscribe” and follow the instructions. Once you approve the subscription, you will be routed to the Elasticsearch Service on Elastic Cloud welcome page to begin creating Elasticsearch clusters.

All usage charges will be billed directly to your AWS account. Pricing information is available on our AWS Marketplace page. Going through the AWS Marketplace is a good option for customers wanting a single point of billing for their SaaS services or customers who are unable to establish a direct billing relationship with Elastic.

Is Elasticsearch Service on Elastic Cloud available for purchase via the Google Cloud Marketplace?

Google Cloud customers can provision Elasticsearch Service's Standard, Gold, and Platinum monthly and annual subscriptions through the Google Cloud Marketplace. Elastic will show up as a line item on your consolidated monthly bill. Best of all, your investment in Elastic counts toward your committed spending agreement with Google Cloud.

Is Elasticsearch Service on Elastic Cloud available for purchase via the Azure Marketplace?

Microsoft Azure customers can provision Elasticsearch Service’s Standard, Gold, and Platinum monthly subscriptions through the Azure Marketplace, consolidate their bill with spending on other Azure services, and have it drawn down 100% from existing MACC contracts.

Elastic on Microsoft Azure is a fully managed SaaS service that provides managed Elasticsearch and Kibana. The Elastic Stack ARM Template marketplace entry is a self-managed, bring-your-own-license solution template for the entire Elastic Stack that installs with a 30-day trial license for Elastic Platinum subscription.

Is Elasticsearch Service on Elastic Cloud available in the FedRAMP Marketplace?

Yes, but think of our listing more as a directory of certified Cloud Service Offerings (CSO) that are FedRAMP authorized, versus a cloud provider marketplace where existing customers transact with the cloud provider.

Is the free Elasticsearch Service on Elastic Cloud trial available on the AWS, Google Cloud, or Azure Marketplaces?

No. The free trial is only available through the Elastic website on our free trial page.

Can I use Elasticsearch Service features that belong to a higher subscription level?

To use features that belong to a higher subscription level, you must upgrade your subscription. Additionally, you can’t downgrade to a lower subscription level if you are using features specific to your current level.

What is the free allowance on Elasticsearch Service?

The free allowance provides each Elasticsearch Service deployment with the ability to enable the following:

  • 1GB Kibana instance
  • 1GB machine learning node
  • 2GB Enterprise Search instance
  • 1GB APM server

Increasing the size of the Kibana instance or machine learning node along with changing the amount of availability zones will incur additional cost.

Does Elasticsearch Service come with commercial features such as security and machine learning?

Yes. Depending on your Elastic Cloud subscription level, customers can access different features across our solutions for enterprise search, observability, and security.

Is Elastic’s Elasticsearch Service the same as Amazon’s Elasticsearch Service?

No. Our Elasticsearch Service is the only managed Elasticsearch offering built and supported by the company behind Elasticsearch, Kibana, Beats, and Logstash. There is no formal partnership between Elastic and Amazon Web Services (AWS), and Elastic does not provide any support on the Amazon Elasticsearch Service.

Our service is built on best practices and years of experience hosting and managing thousands of Elasticsearch clusters in the cloud and on premises. We support custom scripts and dictionaries, and our Elastic Cloud Gold and Platinum customers can upload and run custom plugins with the service. We are the only managed Elasticsearch offering that provides access to our solutions for enterprise search, observability, and security, including commercial features and custom plugins. Read our AWS Elasticsearch Service comparison for more information.

Lastly, Elasticsearch Service on Elastic Cloud is available on Google Cloud, Microsoft Azure, AWS, and AWS GovCloud, which gives you more flexibility for deployment location.

What do I do if I need to change the size of my cluster at a later time?

You can scale your clusters both up and down from the Elastic Cloud user console or our REST API whenever you like. Resizing of your cluster is transparently done in the background without any downtime. However, please note that if you scale your cluster down, you must ensure that the downsized cluster can handle your Elasticsearch memory and disk quota requirements.

Are REST API calls rate-limited or limited to a maximum number of requests?

While REST API calls are rate-limited, there is no maximum to the number of requests.

Can I spin up any capacity I want?

Yes. We support large deployments, but we do have service limits in place. If you find you need more capacity enabled, please contact us. The default service limit is 976GB of RAM to protect users from spinning up excessive capacity by mistake. These can be removed by contacting support.

What cloud provider platforms and regions do you support?

Elastic Cloud is available on Amazon Web Services (AWS), Google Cloud, and Microsoft Azure. Check our documentation for a complete list of supported regions.

Am I charged differently depending on the deployment template?

Yes, deployment templates are predefined with specific virtual hardware that the Elastic Stack runs on. The virtual hardware can be priced differently depending on the deployment template. See our pricing calculator for more details.

How does my price change as I scale my deployments?

Elasticsearch Service on Elastic Cloud has a linear pricing model that makes it easy to understand what the new costs are going to be as you scale. This means a high-I/O configuration with 8GB of RAM will cost eight times as much as a high-I/O configuration with 1GB of RAM. Additionally, if you deploy across three availability zones, your cost is three times as high compared to a single availability zone.

You can estimate the cost of your deployment using our interactive pricing calculator.

What are snapshot storage and data transfer costs?

Snapshot storage and data transfer costs are automatically added to your bill based on metered usage in GB. These include the following:

  • Snapshot storage (cloud storage costs)
    • Based on how much data your snapshots consume on Amazon S3, Google Cloud Storage, or Azure Blob Storage: $0.0330 per GB/month, 100GB/month free allotment
  • Snapshot storage requests (snapshot API requests)
    • Based on snapshot frequency and how many requests are being made to Amazon S3, Google Cloud Storage, or Azure Blob Storage: $0.0018 per 1,000 requests, 100,000 requests free allotment
  • Data transfer into the cluster: Free
  • Data transfer out of the cluster: $0.0320 per GB, 100GB free allotment
  • Data transfer between nodes in the cluster: $0.0160 per GB, 100GB free allotment

Is data transfer less expensive using an AWS PrivateLink connection?

Currently Elastic Cloud supports AWS PrivateLink. Elastic does not add any additional charges above standard AWS PrivateLink pricing. We believe that the primary reason you should choose AWS PrivateLink is for security reasons. Please contact your AWS representative for pricing questions or more information.

What do the i3, 1, l32sv2, and other prefixes mean on my Elasticsearch Service on Elastic Cloud bill?

These prefixes represent the underlying virtual hardware that your deployments are provisioned on. We deploy each component of the Elastic Stack on optimized hardware to ensure optimal performance.


Sours: https://www.elastic.co/pricing/faq
  1. Like that chords
  2. Gravity heights
  3. Bernina quilting frame
  4. Tahoe headliners

Posted On: May 14, 2021

Amazon Elasticsearch Service now supports cold storage, a fully-managed storage tier that makes it easy for customers to securely store and analyze their infrequently accessed data on-demand, at a lower cost than other storage tiers. You pay for compute only when you need it. Cold storage allows you to retain any amount of data in your Amazon Elasticsearch Service domain while reducing cost per GB to near Amazon S3 storage prices.

Based on your data retention, query latency, and budgeting requirements, you now have a selection of hot, UltraWarm, or cold storage options to choose from. By decoupling compute resources from storage, cold storage allows you to detach historical or infrequently accessed data and help significantly reduce your data storage costs. Cold storage enables you to cost effectively expand the data you want to analyze on Amazon Elasticsearch Service and gain valuable insights on data that previously may have been deleted or archived.

Cold storage builds on UltraWarm, which provides specialized nodes that store data in Amazon S3 and uses a sophisticated caching solution to provide an interactive experience. With cold storage, you can now detach indices from UltraWarm while not in use and free up compute to help lower costs. In order to be queried, cold indices must be attached to your Amazon Elasticsearch Service domain’s UltraWarm nodes. Easy-to-use APIs and a Kibana interface enable you to discover and selectively attach your data in seconds. Once attached, queries are powered by your UltraWarm nodes and offer the same performance as with your warm data. Additionally, index state management policies can be used to automate the lifecycle of your data across all storage tiers.

For more information on configuring and using cold storage, please see this documentation. For more information on pricing, please refer to the service pricing page.

Cold storage is now available for all Amazon Elasticsearch Service domains version 7.9 or higher across 25 regions globally: US East (N. Virginia, Ohio), US West (Oregon, N. California), AWS GovCloud (US-Gov-East, US-Gov-West), Canada (Central), South America (Sao Paulo), Africa (Cape Town), Middle East (Bahrain), EU (Ireland, London, Frankfurt, Paris, Stockholm, Milan), Asia Pacific (Singapore, Sydney, Tokyo, Osaka, Seoul, Mumbai, Hong Kong), and China (Beijing – operated by Sinnet, Ningxia – operated by NWCD). Please refer to the AWS Region Table for more information about Amazon Elasticsearch Service availability.

Sours: https://aws.amazon.com/about-aws/whats-new/2021/05/amazon-elasticsearch-service-announces-a-new-lower-cost-storage-tier/

On-Demand Instance Pricing

Except as otherwise noted, our prices are exclusive of applicable taxes and duties.

Reserved Instance pricing

With Amazon OpenSearch Service Reserved Instances, you can reserve instances for a one- or three-year term and realize significant savings on usage costs compared to On-Demand instances. Functionally, On-Demand and Reserved Instances are identical. From a billing perspective, however, Reserved Instances can provide significant cost savings.

Reserved Instances have three payment options:

  • No Upfront Reserved Instances (NURI) – NURIs offer significant savings compared to On-Demand Instance pricing. You pay nothing upfront, but you commit to pay for the Reserved Instances over the course of a one- or three-year term. One-year NURIs offer a 31% discount and three-year NURIs offer a 48% discount. For T3.medium, one-year NURIs offer a 18% discount and three-year NURIs offer a 28% discount
  • Partial Upfront Reserved Instances (PURI) – PURIs offer higher savings than NURIs. This option requires you to pay a portion of the total cost upfront and pay the remainder of the cost on an hourly basis over the course of the term. One-year PURIs offer a 33% discount and three-year PURIs offer a 50% discount. For T3.medium, one-year PURIs offer a 20% discount and three-year NURIs offer a 30% discount
  • All Upfront Reserved Instances (AURI) – AURIs offer the highest savings of all of the Reserved Instance payment options. You pay for the entire reservation with one upfront payment and pay nothing on an hourly basis. One-year AURIs offer a 35% discount and three-year AURIs offer a 52% discount. For T3.medium, one-year AURIs offer a 22% discount and three-year NURIs offer a 32% discount
  • Reserved Instance pricing is specific to each region and depends on the payment option and term that you select. When you purchase a Reserved Instance, you will be charged the associated upfront (if applicable) and hourly fees (if applicable), even if you are not currently running Amazon OpenSearch Service.

* Effective hourly pricing helps you calculate the amount of money a Reserved Instance will save you over On-Demand pricing. When you purchase a Reserved Instance, you are billed for every hour during the entire Reserved Instance term you select, regardless of whether the instance is running or not. The effective hourly price shows the amortized hourly instance cost. This takes the total cost of the Reserved Instance over the entire term, including any upfront payment, and spreads it out over each hour of the Reserved Instance term.

Amazon EBS volume pricing (applies if you choose EBS volumes)

Amazon OpenSearch Service allows you to choose the type of Amazon EBS volume. If you choose Provisioned IOPS (SSD) storage, you will be charged for the storage as well as the throughput you provision. However, you will not be charged for the I/Os you consume.

UltraWarm and cold storage pricing

UltraWarm is am Amazon OpenSearch Service tier allowing you to economically retain large amounts of data while keeping the same interactive analysis experience. Learn more »

Cold storage is the lowest cost storage tier for Amazon OpenSearch Service, which lets you detach and store infrequently accessed data in Amazon S3 and only pay for compute when you need it. Learn more »

On-Demand UltraWarm Instance pricing

* Only primary shards count towards total managed storage usage.

Managed Storage Pricing

Note: Managed storage pricing is applicable to both UltraWarm and cold storage data.

Standard Amazon Web Services data transfer charges

You need to pay standard data transfer charges for the data transferred in and out of Amazon OpenSearch Service. You will not be charged for the data transfer between nodes within your Amazon OpenSearch Service domain.

Free automated snapshot storage

Amazon OpenSearch Service offers added data durability through automated and manual cluster snapshots. The service provides storage space for automated snapshots free of charge for each Amazon OpenSearch Service domain, and retains these snapshots for a period of 14 days. Manual snapshots are stored in Amazon S3 and incur standard Amazon S3 usage charges. Data transfer for using the snapshots is free of charge.

Sours: https://www.amazonaws.cn/en/opensearch-service/pricing/

Pricing elasticsearch

Let’s say you are creating a new production-grade domain with three Availability Zones in the US East (N. Virginia) region with the following configuration: three data nodes of type r6g.xlarge.search with 500 GB EBS storage (General Purpose SSD) each, three master nodes of type c6g.large.search, and two UltraWarm nodes of type ultrawarm1.medium.search with 1.5 TB storage each. In one month, the eight instances on your domain (three data nodes, three master nodes, and two UltraWarm nodes) will run for 730 hours each, totalling 5,840 instance hours. Based on the price of these individual instance types, your total cost for instance hours is $1,328.60. Your total storage cost for the month includes the cost of EBS storage for the three data nodes and the cost of storage for the UltraWarm nodes. With 500 GB EBS storage on each of the three instances, you will be charged for 1,500 GB at $0.135 per GB per month, which amounts to an EBS storage cost of $202.50 for the month. For storage for the two UltraWarm nodes, you will be charged for 3 TB (1.5 TB per instance), which amounts to $73.728 (at $0.024 per GB per month). 

Please see below for a breakdown of the monthly costs (USD) you are likely to incur.

Sours: https://aws.amazon.com/opensearch-service/pricing/

AWS Elasticsearch Pricing: Getting Cost Effective Logging as You Scale

AWS Elasticsearch is a common provider of managed ELK clusters., but does the AWS Elasticsearch pricing really scale? It offers a halfway solution for building it yourself and SaaS. For this, you would expect to see lower costs than a full-blown SaaS solution, however, the story is more complex than that.

We will be discussing the nature of scaling and storing an ELK stack of varying sizes, scaling techniques, and run a side by side comparison of AWS Elasticsearch and the full ELK Coralogix SaaS stack. It will become clear that there are lots of costs to be cut – in the short and long term.

Scaling your ELK Stack

ELK Clusters may be scaled either horizontally or vertically. There are fundamental differences between the two, and the price and complexity differentials are noteworthy.

Your two scaling options

Horizontal scaling is adding more machines to your pool of resources. In relation to an ELK stack, horizontally scaling could be reindexing your data and allocating more primary shards to your cluster, for example.

Vertical scaling is supplying additional computing power, whether it be more CPU, memory, or even a more powerful server altogether. In this instance, your cluster is not becoming more complex, just simply more powerful. It would seem that vertically scaling is the intuitive option, right? There are some cost implications, however…

Why are they so different in cost?

As we scale horizontally, we have a linear price increase as we add more resources. However, when it comes to vertically scaling, the cost doubles each time! We are not adding more physical resources. We are improving our current resources. This causes costs to increase at a sharp rate.

AWS Elasticsearch Pricing vs Coralogix ELK Stack

In order to compare deploying an AWS ELK stack versus using Coralogix SaaS ELK Stack, we will use some typical dummy data on an example company:

  • $430 per day going rate for Software Engineer based on San Francisco
  • High availability of data
  • Retention of data: 14 Days

We will be comparing different storage amounts (100GB, 200GB, and 300GB / month). We have opted for a c4.large and r4.2xlarge instances, based on the recommendations from the AWS pricing calculator.

Compute Costs

With the chosen configuration, and 730 hours in a month, we have: ($0.192 * 730) + ($0.532 * 730) = $528 or $6,342 a year

Storage Costs with AWS Elasticsearch Pricing

The storage costs are calculated as follows, and included in the total cost in the table below: $0.10 * GB/Day * 14 Days * 1.2 (20% extra space recommended). This figure increases as we increase the volume, from $67 annually to $201.

Setup and Maintenance Costs

It takes around 7 days to fully implement an ELK stack if you are well versed in the subject. At the going rate of $430/day, it costs $3,010 to pay an engineer to implement the AWS ELK stack. The full figures, with the storage volume costs, are seen below. Note that this is the cost for a whole year of storage, with our 14-day retention period included.

In relation to maintenance, a SaaS provider like Coralogix takes care of this for you, but with a provider like AWS, extra costs must be accounted for in relation to maintaining the ELK stack. If we say an engineer has to spend 2 days a month performing maintenance, that is another $860 dollars a month, or $10,320 a year.

The total cost below is $6,342 (Compute costs) + $3,010 (Upfront setup costs) + Storage costs (vary year on year) + $10,320 (annual maintenance costs)

Storage SizeYearly Cost
1200 GB (100 GB / month)$19,739
2400 GB (200 GB / month)$19,806
3600 GB (300 GB / month)$19,873

Overall, deploying your own ELK stack on AWS will cost you approximately $20,000 dollars a year with the above specifications. This once again includes labor hours and storage costs over an entire year. The question is, can it get better than that?

Coralogix Streama

There is still another way we can save money and make our logging solution even more modern and efficient. The Streama Optimizer is a tool that allows you to organize logging pipelines based on your application’s subsystems by allowing you to structure how your log information is processed. Important logs are processed, analyzed and indexed. Less important logs can go straight into storage but most important, you can keep getting ML-powered alerts and insights even on data you don’t index.

Let’s assume that 50% of your logs are regularly queried, 25% are for compliance and 25% are for monitoring. What kind of cost savings could Coralogix Streama bring?

Storage Size AWS Elasticsearch (yearly)Coralogixw/ Streama (yearly)
1200 GB (100 GB / month)$19,739$1,440
2400 GB (200 GB / month)$19,806$2,892
3600 GB (300 GB / month)$19,873$4,344

AWS Elasticsearch Pricing is a tricky sum to calculate. Coralogix makes it simple and handles your logs for you, so you can focus on what matters.

Sours: https://coralogix.com/blog/elasticsearch-pricing-is-aws-really-cost-effective/

You will also be interested:

Standard

As low as

$16/month on Elastic Cloud

Try free

A great place to start

  • Core Elastic Stack features, including security

    icon-info-24-gray.svg

    Clustering & high availability
    Powerful search and analysis
    Data visualization and dashboarding
    Stack security

  • Kibana Lens, Elastic Maps, and Canvas

  • Alerting and in-stack Actions

Security

  • Alerting including detection engine and prebuilt detection rules for SIEM and endpoint

  • Centralized ingest and Agent management

  • Malware prevention and deep data collection on hosts

Observability

  • Apps for APM, logging, and metrics

  • Hundreds of out-of-the-box integrations

  • Centralized ingest and Agent management

Enterprise Search

  • Apps for website, mobile app, and workplace search

  • Workplace Search out-of-box content sources and search applications

  • Customizable relevance & search analytics

Support

  • Web-based support, 3-business day target response time (Elastic Cloud only)

Gold

As low as

$19/month on Elastic Cloud

Try free

Everything in Standard plus:

  • Third-party Alerting Actions

Security

  • Optimized workflows including third-party incident response workflows

  • Detection alert external notifications and actions

  • Advanced host management configuration

Support

  • Phone- and web-based support

  • Support response time SLAs (Urgent: 4 hrs; High: 1 day; Normal: 2 business days)

Platinum

As low as

$22/month on Elastic Cloud

Try free

Everything in Gold plus:

  • Advanced Elastic Stack security features

  • Machine learning - anomaly detection and supervised learning

  • Cross-cluster replication

Security

  • Machine learning anomaly detection and prebuilt jobs for SIEM

  • Behavioral ransomware protection (beta)

Observability

  • Domain-specific machine learning rules

Enterprise Search

  • SAML support and App Search RBAC

  • Workplace Search document-level permissions

Support

  • Phone- and web-based support

  • Enhanced support response time SLAs (Urgent: 1 hr; High: 4 hrs; Normal: 1 business day)

Enterprise

As low as

$30/month on Elastic Cloud

Try free

Everything in Platinum plus:

  • Support for searchable cold and frozen tiers

Security

  • Searchable snapshots for longer retention of security-related data

Observability

  • Searchable snapshots for more log, metrics, and APM data

Enterprise Search

  • Searchable snapshots for more application content data and historical workplace records

Support

  • Phone- and web-based support

  • Enhanced support response time SLAs (Urgent: 1 hr; High: 4 hrs; Normal: 1 business day)

Additional resources

Want to learn more about our features, support, and more? See exactly what we have to offer with the Elastic Stack and our solutions.

Feature and platform support

Peruse our comprehensive feature list, read about supported platforms and software configurations, and learn what’s covered in our managed service offering.

Pricing and value calculators

Estimate your total Elastic Cloud spend, look up detailed Elastic Cloud pricing by provider, region, and instance type, and calculate your return on investment.

Licensing and FAQ

Still have queries? Want to see our licensing? Check out some of our frequently asked questions on licensing, support, pricing, and more.

Sours: https://www.elastic.co/pricing/


427 428 429 430 431