Thursday, November 17, 2011

Is SAP HANA Right for You (Now)?

Sunrise over Hana BayAs mentioned in my previous post, SAP HANA has been the focus of much of SAP's technical and marketing communications of late, and has been of great interest to the influencer community (see these excellent posts by John Appleby (@applebyj) and Vijay Vijayasankar (@vijayasankarv) for example). Many SAP customers with whom I spoke recently are also interested in HANA for a number of reasons. Strategically, HANA is very important to SAP – it can deliver a substantial new revenue opportunity for SAP and its ecosystem, provide customers with game-changing benefits, and at the same time change the competitive market dynamics relative to Oracle in SAP's favor. Still, it is very early days for SAP HANA, and SAP's customers are not always willing to jump on a new technology until it has been proven to provide a real business benefit. How can you determine if SAP HANA is right for you (now)?


SAP HANA Benefits


Let’s start by taking a look at the benefits of SAP HANA. HANA can provide significant improvements in query performance, low latency between operational and analytical data stores, reduced administrative overhead, and both better TCO and price/performance ratios as compared to traditional data warehouses. Each of these bears some explanation; however, my explanation has run into several thousand words, so I will cover the details in my next blog.

Recently, SAP announced that SAP BW now runs on SAP HANA as a supported configuration, and the product is in a controlled release. SAP also announced an intention to deliver pre-built applications on SAP HANA, but these are not available yet. While I believe that BW on HANA is a "killer app" for HANA, others have urged SAP to focus on applications. According to Michael Krigsman, CEO of Asuret and an expert in achieving successful enterprise projects, "SAP's challenge is to humanize HANA, focusing on line of business use cases while de-emphasizing the underlying technology, at least from a marketing perspective. If line of business customers see huge value, they will demand that their IT departments purchase HANA."


Given the lack of availability of other packaged apps on HANA, I think the only real appeal of HANA can be – at this point – to SAP BW customers. Fortunately, given the benefits mentioned above (wicked fast query performance, reduced loading and preparation time, no latency between operational and analytical systems, and reduced complexity and cost), BW appears to be the perfect killer app for HANA – this will bring HANA in the door at many customer accounts, and then customers will find other uses for it.


Customers: Is SAP HANA Right for You (Now)


If you don't get on that plane ...If you are a customer of SAP, chances are you will adopt HANA – maybe not today, maybe not tomorrow, but soon, and for … oh, wait, this is not that movie, and I don’t think you'll regret leaving your expensive and slow databases behind for HANA. Seriously, more than 13,000 SAP customers use BW today, and somewhere in the neighborhood of 35,000 customers use SAP Business Suite. In time, HANA will become so integrated with the Business Suite that customers will likely move to HANA, though this migration is some years out.


So, if you're planning on continuing to use SAP Business Suite, chances are you will adopt HANA. This means that the question for SAP customers is more "should I begin my adoption of SAP HANA now, or should I wait?" And the answer is quite simple: you should begin your adoption of HANA if there is a good business case for this adoption in your organization. After all, the price of a HANA appliance (assuming you already own your BW license but not the HANA software) is going to run you up to a couple of hundred thousand dollars. If you are not currently (or planning to start) using BW, then this might not be the right time for your enterprise to use HANA. However, a number of HANA-native applications are in the works from SAP, such as the famous CO-PA accelerator; as these applications come out, you may find a good business case for their use in your organization.


You should strongly consider using BW on HANA if your organization has:


  • ... some reports or analytic applications that simply run too slowly to provide optimal business benefit, and a 5x to 1000x performance improvement would be material to your business,

  • ... unacceptable downtimes, where your data warehouse is not available due to the need to load data,

  • ... a need to see current, up-to-the-moment data, and/or

  • ... a frequent need to create new reports or analytical applications, but IT struggles to maintain BW and keep it performing under changing user demands.


Note: even Business Warehouse Accelerator (BWA)BWA customers may find that they have some reports or analyses that cannot be made to perform well in BWA, or there are long loading times, and users cannot see near-real-time data.


Many BW customers with whom I’ve spoken are happy with BW, but most have a few reports that run in hours instead of seconds, or IT can’t respond quickly enough to user requests, or the system is offline during the business day in one of their regions, or the data in the warehouse is "stale." If any of those issues sound like I’m describing your BW data warehouse, you might have a strong business case to move BW off Oracle (or whatever database you are using) and deploy it on HANA instead.


Even if you don’t think you need HANA (now), you could still benefit from HANA. Just go to your Oracle (or IBM, or Microsoft) sales rep and say that you are thinking about moving to HANA, and see if you can use that for leverage to get a better price on licenses and maintenance for your current database!


Systems Integrators: Is SAP HANA Right for You (Now)


Fujitsu Pimergy SAP HANA applianceSAP Systems Integrators range from IT mega-vendors like IBM and HP, to "pure play" consulting and integration companies like Wipro and Accenture, to boutique consultants like Bluefin Solutions and Jon Reed (@jonerp). The question these shops are all asking themselves right now is whether now is the right time to invest in developing SAP HANA skills. I can think of a single question that should help clarify the answer: does your firm do a lot of BW engagements?


If you answered "No" to this question, then this is a good time to keep an eye on HANA, but not a good time to invest in it. On the other hand, if you answered "Yes," then ask two more questions:


  • Is SAP going to invest to make HANA important to my customers in the next twelve months?

  • Can I develop HANA skills in-house or do I have to look outside?


Judging from the response HANA has been getting from SAP customers, and from the emphasis SAP senior management is placing on this technology, it is clear that SAP is going to invest to make HANA work, to develop more and more applications on the technology, and to drive the technology deep into the Business Suite. The marketing effort around HANA, combined with a working solution, is sure to drive a lot of customer interest in this technology.


A quick glance at the job boards shows that several consulting firms and integrators, SAP included, are looking outside for HANA skillsSAP HANA jobs on Dice.com. There are about 50 job posts for HANA skills on Dice.com and Monster.com, posted by firms like SAP, IBM, Fujitsu America, and PwC. The good news is that – if you already have BW (or even better, BWA) skills in-house, you can easily upgrade these skills to HANA. SAP is making it easier and easier to learn HANA, from the information and test software available on http://ExperienceSAPHANA.com/ to new and simple utilities like the Information Composer in HANA SPS3.


In fact, if you have an in-house data warehouse built on SAP BW, it should be a matter of days to migrate it to HANA, assuming you have the budget for a system (which could run between $50,000 and $300,000). Think about trying hard to get a test system from IBM, Cisco, Dell, HP, Fujitsu, or Lenovo. Also, think about splitting the cost of this system with your marketing department, because nothing should help you close your first HANA client faster than saying "we've done the migration for our own data warehouse, and let me share our experiences with you."


Independent Consultants: Is SAP HANA Right for You (Now)


Do you consult on data warehousing and/or BW? If so, you really should get started on HANA right now. The benefits of HANA are so compelling for BW customers, that you can really increase your business by demonstrating HANA to your clients.


Alternatively, if you are consulting in another area of SAP, and are looking to learn a little about HANA, you don’t have to go to the expense of buying your own HANA system. SAP has a HANA system running in the cloud, which you can access at http://ExperienceSAPHANA.com/, where you can study HANA and even implement your own systems to test out the software and develop your skills. Also check out this blog for information about another program SAP has created to get you hands-on with HANA.


ISVs: Is SAP HANA Right for You (Now)


Sadly, I don't think this is the right time for ISVs to think about developing custom applications on HANA. The tools are not really there, and the HANA platform team has other priorities right now. If your product uses BW, then by all means get some HANA experience, and think about how your application could evolve for a world of high performance analytics. If your solution includes BW content, then definitely begin testing HANA with your solution, so you can support your customers. But, unless you’re an SAP Demo Jam master, this may be too soon for you to adopt HANA for new, HANA-native applications.


Summary


Given the substantial performance improvements, up-to-the-moment data in the warehouse, reduced operating costs and complexity, and other significant benefits HANA offers to SAP BW customers, it seems likely that SAP HANA will have substantial appeal – and uptake – in the SAP customer base by the end of 2012. SAP BW customers should look at SAP HANA as the optimized database appliance for HANA, and most SAP BW customers should begin planning or piloting an adoption of HANA soon. SAP consultants and integrators should expect a great deal of demand for SAP HANA skills both in the short- and long-term, and should begin preparing now. It may be too early for ISV's to benefit from HANA, other than as it improves any BW components in the ISVs' solutions.

Note: SAP is a client, and former employer, of mine.

Tuesday, November 15, 2011

SAP HANA – the strategic context

This is part one of a three part series on SAP HANA.

Many years ago, SAP’s founders had the dream of implementing accounting and finances in real-time. They believed this could revolutionize business, making it possible for enterprises to have a clear picture of their financial positions at all time, enabling companies to make better decisions. Ultimately, this vision grew to include business processes across the enterprise, supporting real-time integration across all business processes in the enterprise. Over the years, SAP and other vendors have not always accomplished this level of real-time integration, but the days of batch processing of invoices, receipts, inventory updates, and other crucial enterprise information are largely behind us.

Except in business intelligence. Most enterprises today extract data periodically from their operational systems, transform that data into unified units and schema, cleanse the data of errors and gaps, aggregate the data to support faster queries, and then deploy that data into the enterprise data warehouse for reporting and analytics use. This process generally introduces a lag between when data are entered into the operational system, and when that same data are available in the data warehouse. This lag can be as short as a few minutes, or as long as a month, but is rarely less than an hour. Many enterprises “refresh” their data warehouse nightly (although when is “nightly” in a global enterprise?) or even weekly. One CRM system I used recently had a caveat on its reports, stating that “the data in this report may be 24 hours out of date.” In other words, on the last day of the quarter, a sales manager could not use the system’s reporting capabilities to determine if she had made her quota or still needed to make some more calls. For some applications, this lag time is unavoidable, but eliminating this gap between action and insight should be a goal of every IT organization.

For many enterprise topics, new ideas come from the consumer world – this trend is known as “the consumerization of IT” (or #CoIT, to insiders on Twitter). Consumer-facing companies (like Apple and Facebook) hear more clearly from their users and customers than Enterprise Software and Solutions companies (#EnSW on Twitter), and so they are often the source of innovation in the IT space. CoIT gives us many ideas about user experience (iPad!), social capabilities (Facebook!), mobility (iPad!), and scaling to massive data volumes (Facebook!). However, the consumer world does not offer us many good examples of real-time integration of operational and analytical data.

Into this critical need – powerful analytics on current data with real-time response – stepped SAP recently with SAP HANA. SAP aimed to bring the same real-time advantages to analytics that they brought to transactions. HANA is an extremely ambitious undertaking for SAP, which is not known for its leadership in the worlds of databases or analytics.

Over the years, SAP has offered its own database (SAP DB), which did not have a great deal of success in the market despite the obvious pricing advantages in comparison to commercial database products. Most notably, Oracle has been adopted by most large SAP customers, both for their operational databases and their data warehouses; Oracle has focused on the needs of large customers, and has achieved scalability, stability, and operational reliability not generally available from other commercial databases. Open Source databases have lagged far behind in these areas.

Additionally, SAP has offered first reporting and then generalized business intelligence solutions of its own (e.g., SAP BW), but these products have achieved only limited success, and that only in the SAP installed base. SAP BW has about 13,000 customers, but many of these customers use other analytical products alongside their SAP BW environments.

Recent years have seen SAP begin to make some serious moves to improve their position in the database and business intelligence spaces, specifically through the acquisition of Business Objects and Sybase. SAP has vaulted to a real leadership position in the BI world with the combination of its BW and “BOBJ” products, although it is still a distant #5 in the database market according to IDC.

IDC 2010 Database Market Share, Top 5 Vendors






























Vendor2010 Database Market Share
Oracle45.2%
IBM20.7
Microsoft20.4
Teradata3.3
SAP3.0

If SAP could offer a discontinuous breakthrough, a game-changing technology, it might be able to capture a much larger share of this lucrative market, bringing some real benefits to the SAP shareholders and employees. Further, with Oracle's large share of the databases in SAP environments, a large increase in SAP’s share of this market would likely most hurt Oracle, SAP’s largest competitor in the applications business, reducing Oracle’s ability to fund its competing applications products through database profits, while simultaneously reducing Oracle’s insight into applications customers’ needs. Finally, if SAP could come up with a technology that provided real, new benefits to its customers, such as dramatic reductions in TCO, dramatic improvements in performance, or unification of the operational and analytical data stores for real-time data analysis, then SAP would be providing its customers with the kinds of benefits that could bring new levels of performance to their enterprises. This is precisely what SAP has set out to do with SAP HANA.

SAP HANA has no entered ramp-up, where SAP will take it from the first handful (or, technically, two handfuls) of customers up to several dozen, and then on to hundreds and thousands. Notably, SAP is using HANA internally, to speed insight for top management. At this point, HANA is primarily being used as a high-performance data store for BW, but stand-alone applications (such as “CO-PA Accelerator”) are not far behind, and eventually SAP plans to run their full suite of applications on HANA. Yes, that would mean a great potential savings for customers, and a significant reduction in business for Oracle, but this is years away from reality. In the meantime, SAP HANA looms as a potential boon to SAP shareholders, employees, customers, and partners.

The next blog in this series will discuss how to tell if SAP HANA is right for your organization – or for you.

Thanks to Mike Fauscette and IDC for providing market share data for this blog.

Please note: as of the time this blog was written, SAP is a current client of the author's.

Friday, September 23, 2011

SAP HANA Makes Progress and Threatens Oracle

SAP HANA has garnered a great deal of attention in recent weeks and months. For an overview of the technology and its potential, please check my recent blog on the subject, "The real (potential) impact of SAP HANA."

Since that blog was written, there has been a great deal of news in the SAP HANA world, and the surrounding cosmos as well. Rather than write another long blog on this topic, here is a list of some highlights:
  • The pricing of SAP HANA is getting clearer. A low end (128GB to 256GB RAM) SAP HANA appliance could start at around $80K-$100K for the hardware. A few sources inside and outside the company (not under NDA) also indicated to me that the price of SAP HANA software is around $120K at the low end, stretching up to $1M to $2M at the high end. SAP says the pricing is not discountable, but early customers have told me that (at least for them), everything is negotiable. This puts the entry-level SAP HANA pricing at around $250K plus services. A pilot project could be done for less than $300K, with potential for very large business benefits. How hard is it to find a business analytics problem that is worth $300K if it can be completed 10x faster? For many businesses, there is no shortage of such analytics problems, and in some cases SAP HANA will actually perform 100x faster - or even better.
  • Pricing for higher end SAP HANA boxes is not as clear. If your data can fit into 1TB of RAM, then these single-system boxes should be OK for you. But how will you know if your data can fit into that memory size? It seems (and I would welcome a knowledgeable person's correction on this if inaccurate) that SAP HANA can't be used when data can't fit entirely into one system's memory, which currently tops out at 2TB (and at much higher pricing - an additional $250K or so, from those few vendors offering that high-end configuration).
  • How much data can fit on any SAP HANA configuration? From discussions with a number of current SAP HANA users, this is not always clear, and SAP has some work to do to deliver good sizing tools. On average, users I spoke with report compression ratios of between 4 and 10 times for data - that is, if the data would take up 400GB in an ASCII file, the same data with HANA's columnar compression would take between 40GB and 100GB in SAP HANA (your mileage may vary). Of course, the operating system and other software needs some memory to run, but this size of data should fit fine onto the smallest SAP HANA appliances. In a disk-resident database, you might need dramatically more disk space for such a data warehouse, since space will not be used efficiently (sparse data) and since the indices may take a significant amount of space - even more than the data sometimes!
  • How about this for a sizing tool - load all your data on a removable hard drive (ENCRYPTED!!!), and bring it to IBM, HP, Cisco, Fujitsu, Dell, and anyone else offering a SAP HANA appliance. Have them load it up for you on their hardware, and test out your queries. If everything is as simple as some customers and integrators have been telling me (which is pretty close to how simple SAP has been saying it will be), then the hardware partners should be willing to do a pilot like this for free. You'll know exactly how much hardware you'll need, and you'll have a very good idea of its performance!
  • As a killer new application, SAP HANA will be certified in November for running SAP BW. All BW reports, extractors, etc., should all run without changes (except MUCH FASTER) on SAP HANA after this release. Let's face it - the overwhelming majority of SAP BW data warehouses are running on Oracle databases. If you have an Oracle database license priced in the range of $800K (and many medium-sized data warehouses are on such licenses), with a 25% annual maintenance fee, you are talking about $200K per year just for the database maintenance. If you could migrate that database over to SAP HANA, you might find that you paid for it in the first year by dropping your Oracle maintenance, and at the same time you may be delivering ten times more users or ten times faster results on reports and analyses. It wouldn't be hard to imagine many Oracle databases being converted over to SAP HANA in the coming year - especially those running under SAP BW (and Business Objects soon too!).
  • SAP recently also discussed several analytical applications that will be made available on SAP HANA. These are interesting, but not where the short-term value will be for most customers - this will be SAP BW or Business Objects running on SAP HANA, and ultimately the rest of the SAP Business Suite running on SAP HANA. Or Sybase, for that matter.
  • Oracle may be feeling some heat from SAP HANA - Oracle just introduced a low end database appliance offering, with hardware and software bundled for between $100K and $300K. While it is unlikely that this appliance would be able to deliver comparable performance to SAP HANA for those applications most suited to HANA's current capabilities, this appliance would have broader application - for example, being currently suited to running production transactional applications such as SAP.
  • At the high end, a SAP HANA appliance might cost on the order of $1M for hardware and $1M for software. An Oracle Exalogic data warehouse solution might cost 10x that number, delivering slower performance, consuming a lot more energy, and taking a lot more space.
  • SAP has expanded the mechanisms for loading SAP HANA. You can now use log-based replication (replaying the logs on another database to copy it), and trigger-based replication (having a system notify SAP HANA when data is changed), as well as the previously available ETL-based replication (using BW extractors or other technology to copy data out in bulk/batch). The trigger-based replication mechanism is particularly interesting, because it updates the "data warehouse" (can you even call it that anymore with technology like this?!?) continuously, in near real-time. In addition, the trigger-based replication approach allows for consolidating data from several databases quickly and easily into a single data warehouse. If you have one database for your CRM system and another for your financials, both databases can propagate their updates into a single SAP HANA system for consolidated reporting and analytics. Trigger-based replication supports many-sources-to-many-targets replication.
  • Business Objects metadata integration with SAP HANA metadata was not announced at SAP TechEd in Las Vegas, but perhaps will be available soon. Business Objects Explorer can run today on top of SAP HANA, which gives some level of integration that will benefit many SAP customers running SAP Business Objects. The more integration at the metadata level, however, the more appealing SAP HANA will become to Business Objects customers not running SAP systems.
Conclusions:
  1. SAP HANA is getting to the point where any customer running SAP analytics (especially SAP NetWeaver Business Warehouse aka BW) should be starting or at least planning an evaluation.
  2. SAP HANA will make its biggest impact - for customers - initially as an "accelerator" for SAP BW.
  3. SAP HANA may pay for itself in reduced database maintenance payments ...
  4. ... thus its biggest impact - for vendors - in creating pricing pressure on Oracle RDBMS for data warehouse instances.
  5. We may be still a long way from seeing SAP HANA replace Oracle, IBM DB2, or Microsoft SQL Server as the transactional data manager for SAP Business Suite.
For more on the strategic impact of SAP HANA, please see http://www.enterpriseirregulars.com/39209/the-real-potential-impact-of-sap-hana/.

Disclosures:
I worked for SAP for six years, including the period when SAP originally acquired the technology at the heart of HANA. SAP is a client as of the time of this writing.