Category Archives: Cloud

The Hidden Costs of Cloud Services

Azure and Email Marketing
Have you considered moving computer workloads to the cloud? You probably have. In the studies we’ve seen, over 90% of companies are now using cloud computing services.1 If you are considering moving your infrastructure to Amazon Web Service (AWS), or Azure, or some other cloud computing service, there are a few things you should know before taking the plunge. We’ll look at these potential pitfalls and give you the information you’ll need to make an informed decision.

Moving to Azure: A Case Study

Recently, a customer decided to move their databases from a managed IT provider to Microsoft’s Azure. They had a large, home-grown CRM-style database to move, plus several more databases that we helped manage for their email marketing purposes. They carefully studied the Azure website to determine which package would meet their needs, and how the cost compared to that of their current provider. They concluded it would be cheaper and more reliable to switch to Azure. However, things didn’t go as planned.

The first question everyone asks is how much will it cost, but that’s difficult to estimate. Even careful scrutiny of the configuration pricing using Azure or AWS won’t necessarily answer this question. When you buy a server from Dell or others, many factors determine the performance, but the cost is relatively upfront. The speed and number of cores determines the base speed and how much RAM can have a significant impact. In the case of a database server, the speed and size of the storage system is critical. There are other factors but these are the main considerations. It’s a relatively straightforward process.

Compare that with the purchase of a cloud database. For Azure, you start by determining if you want a managed instance, an Elastic Pool, or a single database. Go down the route of a managed instance, and you choose from Windows Virtual Machines, SQL Database Managed Instance, or a SQL Server virtual machine. The Elastic Pool is closest to owning your own server that hosts multiple databases and that pricing path has you choose between the vCore (virtual core) and the Database Transaction Unit (DTU) model. Choosing the DTU model has you then select your elastic Database Transaction Units (eDTUs) per pool, which determines the per-hour pricing. But what is an elastic Database Transaction Unit, and how many units do you need for a viable database? Microsoft defines a DTU as “…a blended measure of CPU, memory, and data I/O and transaction log I/O in a ratio determined by an OLTP benchmark workload designed to be typical of real-world OLTP workloads,” but they provide little information on how these factors are “blended” or the specifications of the OLTP numbers used. Microsoft does offer a DTU calculator, but it involves running either a Command Line Utility or a PowerShell script to capture CPU and IOPS at the server level and create a CSV file, which is then uploaded to the Azure website.

It’s also tricky to verify that the configuration you’ve chosen will actually work. The customer initially picked a mix of a single vCore and the other databases in an Elastic Pool. However, they learned later that this setup does not allow SQL jobs to run or cross-database joins, things that their current database allowed and were fundamental to their design. There were also resource limits that Azure imposed that caught them by surprise. An estimated nine-hour overnight transfer of the data ended up taking thirty hours because of Azure-imposed resource limits.

Azure vs. AWS

Although Microsoft’s Azure cloud offering is growing in popularity, Amazon’s AWS is still the market leader. How would you estimate the costs for their system? To us, AWS pricing seems more straightforward than Microsoft’s. You still get these cryptic descriptions like db.m5.xlarge and db.r5.8xlarge that you must individually look up, but when you do, the abbreviation stands for a computer with a certain number of cores running at a specific speed, and an amount of RAM. Much more like what you get when buying your own computer. You must also estimate costs for data transfers and database and backup storage, which can be hard to determine.

The customer ran into several issues in attempting to migrate their databases to Azure that further increased their costs, but once they worked through those technical issues the migration was performed overnight. However, when they brought their systems back online the next day, they found the performance was unacceptably slow. They rolled back to their existing managed provider and looked over the website pricing options again. With their increased knowledge of the requirements, they recalculated the monthly pricing. Now they estimated a figure that was twelve times their initial cost!

Needless to say, this was unacceptable, so they’ve stayed with their current managed provider. But how could the price be so far off? We looked over the options they had initially selected. In our opinion, the eDTUs for the Azure DTU model was a bit low, but not unreasonably so. It’s easy to see how someone performing a diligent and thoughtful analysis of the pricing could come up with this price.

If you’re considering moving your infrastructure to the cloud, you need to be aware that the benefits don’t always outweigh the costs. Goolara’s Symphonie email marketing solution can use a database hosted by a cloud provider, or with AWS, the entire system can be installed on their computers. If you are considering a cloud provider for your database or entire email marketing system, contact us, and we’ll be happy to help you estimate the costs.

Go to Goolara website


1. According to Flexera’s 2020 State of the Cloud Report.

© Goolara, LLC, 2020. Unauthorized use and/or duplication of this material without express and written permission from this site’s author and/or owner is strictly prohibited. Excerpts and links may be used, provided that full and clear credit is given to Goolara, LLC and the Goolara Blog with appropriate and specific directions (i.e., links) to the original content.

Amazon and Email Marketing: Servers in the Ether

Email marketing and AWS
For anyone interested in migrating an in-house server to Amazon Web Service (AWS), the question remains: How do I migrate my email marketing system and send email from an Elastic Compute Cloud (EC2) instance? If you don’t know what that means, don’t worry, we’ll explain it all. The important thing to remember is this: Goolara Symphonie can be run from AWS, giving cloud users a powerful tool to perform email marketing from their own environment.

Amazon’s Cloud

Several companies are battling for King-of-the-Hill status as the best cloud provider, with Amazon and Microsoft being the top competitors for this market. As of this writing, the apparent winner for email marketing is Amazon, whose AWS solution allows for email sending, unlike Microsoft’s Azure. (for more on this topic, see Cloud Based Infrastructure and Your Email Marketing Solution).

When most people think of AWS and email, they think of Amazon’s own Simple Mail Solution (SES). While this may be fine for some, its limitation is right in its name: it’s Simple. Try to add features such as full automation, dynamic content, and content blocks, and you’ll hit a brick wall pretty quickly. While there are third party add-ons that can enhance the features of SES, they still work off Amazon’s basic “batch-and-blast” approach. That’s fine for the email marketer who thinks in those terms, but for someone looking for a more sophisticated approach to strategic email marketing, this won’t work at all. Fortunately, there is a solution.

Best of Both Worlds

Many companies that have moved their infrastructure to the cloud have had to keep some of their own data centers to operate their on-premise email marketing programs, or have switched to hosted solutions. An on-premise version has many advantages over a hosted solution in connectivity to corporate resources like CRMs or Point-of-Sales systems, the control and security of maintaining your own data, cost savings for high volume users, and much more. With Goolara’s Symphonie solution installed in AWS, you get the best of both worlds – all the power of Symphonie, but installed in your AWS environment.

Assessing the Cost

If you are familiar with AWS you’ll already know there are many cost points, and determining how much a service will eventually charge can be a bit challenging. Symphonie can be run with just two AWS services, EC2 and Amazon’s Relational Database Service (RDS), simplifying some of the calculations. The Symphonie license is perpetual, meaning you can use it forever to send an unlimited amount of email, for the one-time purchase price. For large volume senders this can mean significant savings over hosted providers.

To better understand what’s involved in using Goolara’s on-premise email marketing software via AWS, we’ve created this guide, which detail the process and outlines the various AWS components you’ll to make it work. Feel free to contact us to learn more about the process and to see if your company could benefit from moving its email marketing system into AWS.

Go to Goolara website

Privacy, ESPs, Protecting Your Data, and the Law

Who's watching your data?The NSA revelations of last year, the enactment of the Canadian Anti-Spam Law (CASL) in June, and recent European Commission meetings have brought issues of privacy and national data control to the forefront of the minds of IT professionals and technology users around the world. Although many countries, such as Egypt, UAE, and Malaysia, still have no data privacy laws, most industrialized nations are looking to beef up their data protection regulations as soon as possible. In some cases, this is the result of Edward Snowden’s revelations about the NSA. Brazil didn’t worry much about its data protection policies until President Dilma Rousseff found out that the NSA was tapping her phone. Then the Brazilian Internet Law (Marco Civil da Internet) was quickly passed.

Another trend we’re seeing is the shift in data policies and country borders. In Russia, for instance, a new law was passed by the Duma requiring that the “systematization, accumulation, storage, updating and retrieval of personal data of citizens of the Russian Federation, [must be] held on databases located in the territory of the Russian Federation.” This law takes effect in 2016. Even countries, such as Germany, that already have stricter than average data privacy laws, continue to tighten their laws with new legislation.

International privacy laws

Where’s My Data?

Where once there was very little legislation governing things such as email lists and opt-in verification, countries and states are looking to get tough on data breaches and information mis-use, but this gets a lot harder to do when you don’t know where the data resides.

As anti-spam laws become more stringent, countries such as Canada require that businesses keep subscriber records secure, well-verified, and up-to-date. Recent trends indicate that, if anything, this trend toward great accountability is growing. New York Times Business Correspondent Danny Hakim recently observed that the words “cloud computing” did not appear in the European Commission’s general data protection regulation when it was introduced in 2012, but they do now. “The European Union wants to regulate the cloud even if that makes its use more complicated,” Mr. Hakim wrote. Not everyone in the European Commission supports these regulations, but it demonstrates the extent to which governments are willing to become involved if businesses don’t do a better job of securing their data.

For this reason, a stronger emphasis is being placed on the use of location specific data sources. After all, it’s hard to comply with the laws when you don’t know exactly where your files reside. Armed with this information, country and state authorities can better determine where the problems in the information chain occur, and companies can avoid potential problems by keeping control over the information, rather than turning it over to third parties.

Hopping Off the Cloud

One side effect of this is a decreased interest in cloud-based solutions. In Germany, for instance, cloud grew only three percent in 2013, compared with nine percent the previous year. Oracle, a company that relies heavily on cloud-based solutions, saw a dip in its orders between 2013 and 2014 everywhere except the Americas. In an NPR report, Cisco senior vice president of security Christopher Young acknowledged that this was an issue, especially outside the U.S. “[Y]ou can go to Latin America, you can go to Europe, to Asia, and there’s many examples of customers asking those questions.”

This is quite a change from two years ago, when all the chatter on Internet was about doing things “in the cloud.” Companies bent over backwards to promote their “cloud-based” solutions. Now, we are seeing a shift away from this everything-in-the-cloud approach to a more thoughtful approach. For the low security needs, people still use cloud solutions, but when data security and national laws enter the picture, on-premise (“on-prem”) platforms clearly have an edge.

Keeping the Borders Closed

As Symantec pointed out in a recent article on their site, “[a benefit of] an on-premises delivery model, particularly for organizations with regulatory requirements, would be the twin needs of identifying and securing an organization’s sensitive information. On-premise deployment of these technologies offers capabilities that meet the needs of finding sensitive information where it lives and allowing appropriate access to authorized users. …[On-premise email solutions] permit complete control over the custody of data. … This is a critical consideration in a variety of situations.”

Locked Countries

Hey You, Get Off of My Cloud

On the Journal of International Law and Politics New York Forum (JILP), an Australian author explaining why Australians should use Australian-based cloud system inadvertently explains exactly why people are opting for on-premise systems: “[W]hen you take advantage of locally (in an international sense) based service here in Australia, you’re getting an extra layer of protection. [These] solutions will be governed by Australian law (and not the laws of some other nation)….You’ll never be at the mercy of a foreign government or foreign agent or the changing winds of their security policies – and as an Australian citizen using Australian-based cloud solutions you’ll have a voice in the rules, regulations, and laws governing the security and protection (as well as the enforcement of) those policies moving forward.”

While the JILP author is correct that a cloud-based system within a country’s borders affords that extra layer of state protection, it doesn’t address the problem that comes with any cloud-based system, and that is, you never really know where it is. The service might say it is local, but it could be anywhere. If asked where you data is, the best you can do is wave your hand and say, “It’s out there somewhere.” On-premise has no such limitations. When asked where your data is, you can point directly at your servers and say, “It’s right there.” This kind of locality is hard to beat.

spies in the cloud

Compliance is Not Negotiable

The key here is compliance, legal compliance, that is, and in email marketing, compliance is non-negotiable. As Bill Claybrook points out on TechTarget: “Compliance is viewed as a big obstacle toward widespread cloud adoption, and rightly so. It is driven by law and legislation so there is no choice but to comply.” He also points out that “Some regulations stipulate where sensitive information can and cannot reside.” If that information must reside in the country of origin, then an on-premise email marketing system will settle the matter.

At Goolara we offer both solutions—hosted and on-premise—so we don’t have a dog in this fight. We see the advantages of each system for different purposes. For many companies, particularly those with minimal or shaky IT departments, a hosted solution is usually a better choice, but a company with a strong IT Department and tight security is better keeping things in-house. If you are not sure which solution is best for you, give us a call. We can assess your needs quickly and accurately and give you our recommendation based on your individual business factors.

Go to Goolara website